17 The Development of a Screening Schedule for Use by Teachers to Describe the Communication Abilities of Children with Severe Disabilities Anna-Marie Wium and Erna Alant Centre for Augmentative and Alternative Communication Department Communication Pathology University of Pretoria ABSTRACT The study developed a screening schedule for teachers to describe the communication abilities of children with severe disabilities Teachers were trained in the use of such an assessment procedure. Both the schedule as well as the training were evaluated. Results indicated that IKe schedule can be regarded as adequate for future use as teachers found it easy to use and applicable to their situation. Scoring the schedule requires more practise and training as this is a more advanced skill. Specific issues had an effect on the results, e.g., the teachers'familiarity with the type of disability observed, their qualifications and experience. OPSOMMING 'n Siftingsskedule vir onderwyseresse is ontwikkel wat die kommunikasievaardighede van kinders met erge gestremdhede beskryf. Die onderwyseresse moes opleiding ontvang om die skedule te gebruik. Daar is gevind dat die skedule geskik is vir toekomstige gebruik aangesien dit maklik is om te gebruik en toepaslik is vir die klaskamer. Gradenng word beskou as η gevorderde vaardigheid wat meer ervaring en opleiding verg. Aspekte wat die resultate beinvloed het, was die onderwysers se bekendheid met die tipe gestremdheid, hulle kwalifikasies en tot 'n mindere mate hulle ondervindmg met erg gestremde kinders. KEY WORDS: screening schedule, teachers, children with severe disabilities, augmentative and alternative communication. INTRODUCTION The increasing need for service delivery to all children with severe disabilities (CSD) necessitates the use of teach- ers to facilitate the children's general interaction. Teach- ers are ideally suited to assess their childrens' capabili- ties as they are familiar with their individual needs and skills. In this context, the transdisciplinary method of in- tervention whereby the teacher is trained to fulfil certain intervention functions in the classroom can be a most ef- fective way of dealing with the'severely disabled popula- tion (Hogg & Raynes, 1978). As assessment can be seen as the beginning of the in- tervention process, teachers should also be trained to per- form this task. Researchers such as Skuy, Westaway, Makula and Perold (1988) have found teachers valuable, parsimonious and accurate in rating students' perform- ances in psychometric testing. The use of teachers in the communication assessment of CSD becomes especially relevant as they are able to functionally assess students during daily class routines. A functional assessment can thus be described as an assessment method aimed at de- scribing the child's performance in real life contexts. This approach to assessment is of the utmost importance when working with the majority of children with severe disabili- ties as they experience difficulty in learning new tasks due to the severity of their cognitive and/or physical dis- abilities. It is therefore important that the tasks used in the assessment process should be relevant and applicable to daily routines to facilitate the children's increasing in- dependence. Which evaluative procedure should be used if teachers are involved in the assessment process? A very limited choice of non-verbal tests are available, e.g., the Non- speech Test (Huer, 1983), and are for exclusive use by speech and language therapists. Many speech and lan- guage therapists who work with CSD make use of tests which were developed to test language in depth. The prob- lem is that many of the children with severe disabilities are unable to speak which makes it very difficult to ob- tain reliable results. The need for an AAC assessment schedule to describe the skill areas of functioning relevant to AAC which could be used by teachers of CSD is evident. However, various issues must be taken into account in the development of such an assessment schedule. Firstly, the level of impairment in CSD often necessi- tates the use of an augmentative system for more effec- tive communication. The variation in symptoms of the child with severe disabilities clearly indicates that more than one skill area can be involved. It is therefore important to assess all skill areas involved in augmentative communi- cation, such as communication, cognitive, motor, sensory and social/emotional skills. Successful intervention should not take only abilities into account, but should also focus Die Suid-Afrikaanse Tydskrif vir Kommunikasieafwykings, Vol. 43, 1996 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) 18 on needs (Beukelman & Mirenda, 1992) Secondly the heterogeneity of this population means that every^ child has unique problems, abilities and needs. A schedule has to address the development of an individual programme. Thirdly, the characteristics of the child with severe dis- abilities such as his inconsistent behaviour, passivity, short attention span, anti-social behaviour (Durant, 1990) and motor problems (Bergen, 1990), make it necessary to ob- serve such behaviour during ordinary functional routines as was recently proposed by ASHA (1992). Researchers such as Light (1989) as well as Mirenda and Iocono (1990), regard functional communication as an integral part of all areas of development particularly in the areas of so- cial, emotional and cognitive development which must therefore also be accommodated in the assessment proc- ess of CSD. Fourthly, for a schedule to be effective for use in the classroom, it needs to be easy to administer and time effective. The development of such a screening schedule for teach- ers of CSD has various advantages in that its use would enable teachers to describe their students' problems, it would help them to know when to refer to specialised serv- ices if necessary, and lastly, they would be able to draw up an individualised program plan for each child which ena- bles them to monitor progress. It is against this background that the present study was conducted to investigate the use of an AAC screening schedule for use by teachers. METHOD AIMS Anna-Marie Wium and Erna Alant Apart from their subjective evaluation on the ease of use of the schedule, the results of their assessment were com- pared to those done by a group of three experienced AAC specialists to assess their ability to identify items and to score them. The results obtained by this group was, con- sidered as a norm or a reference to guide the training of observation skills. RESEARCH DESIGN A small group, experimental design was used, which involved elements of the single subject, multiple-baseline design (using replication across 12 subjects). This is simi- lar to the study described by Light, Dattilo, English, Gutierrez and Harts (1992). In this referred study of Light et. al (1992), data was presented for each individual sub- ject. Data for the evaluation of changes that had occurred in the teachers as a result of the training in observation skills were collected five times in total for each of the 12 teachers and then compared to a norm. This was done for reliability as it is recommended by Barlow and Hersen (1984) that at least four baselines be collected for convinc- ing results in this type of design. The general flow of events in the design of this study encompassed the following: - Firstly the development of the schedule which, in turn, was evaluated for ease of use in a pilot study with a sample of eight teachers. - After the schedule had been refined, the main study trained twelve teachers to use it. - The results were processed and analyzed. To describe the application of a schedule to identify the communication abilities of CSD as used by teachers of chil- dren with severe disabilities (CSD). More specifically the following aspects of implementation will be highlighted: - The evaluation of the ease of use of the schedule - The identification of questions in the schedule which were poorly phrased and thus poorly understood by the teachers - The identification of problematic questions which were difficult to score Teachers used the schedule to functionally assess the abilities of three children with severe disabilities (Cases A, Β and C) and were then asked to evaluate the schedule. MATERIALS USED The schedule which was used to document observation skills of the teachers was designed to cover 47 items of five skill areas associated to AAC. They are the communi- cation, cognitive, motor, sensory and social/emotional skill areas. The questions were formulated in user-friendly terms and examples of these can be seen in Tables 1 and 3. The schedule has to be completed by observing four func- tional tasks. Each task needs to be rated on a six-point rating scale (0-5). In order to guide the teacher, the rating scale is categorized as poor, sub-average and average which has to be selected prior to attributing a specific score. Ta- ble 1 has a summarized description of the schedule1. TABLE 1: Description of schedule Description of schedule Rating scale Schedule had to be completed by observing and scoring four functional tasks. Five skill areas of functioning related to AAC were included and were desribed by 47 questions (items): 1. Communication skills: (e.g. "To what extent does he want to communi- cate with others?") 2. Cognitive skills: (e.g. "How well does he search for a hidden object?") 3. Motor skills: (e.g. "How well can he reach with his right arm?") 4. Sensory skills: (e.g. " How well does the child see for communication purposes?") 5. Social/emotional skills: (e.g. " How well does he make eye contact dur- ing communication?") Six-point rating scale was guided by three categories: Poor: 0 - 1 Sub-average: 2 - 3 Average: 4 - 5 The South African Journal of Communication Disorders, Vol. 43, 1996 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) T h P D e v e l o p m e n t of a Screening Schedule for Use by Abilities of Children with Severe Disabilities DATA COLLECTION PROCEDURE Training was conducted as a workshop according to nciples r e c o m m e n d e d for adult training (Wium, 1994). TVaining took place at the Centre for Augmentative and Alternative Communication (CAAC), Dept. Communica- f r n pathology, University of Pretoria, over a two-day pe- riod The content and procedure of training are described Table 2. Data collection procedures are highlighted. Tfcble 2: Training procedure and data collection Teachers to Describe the Communication DATA ANALYSIS PROCEDURES 19 The focus of this study was to.develop an AAC assess- ment schedule which involved two aspects: Firstly, the schedule had to be evaluated and secondly, the ability of the teachers to identify (recognize) the various items and to score them in the schedule had to be described. Evaluation of the schedule by the teachers: The teachers evaluated the ease of use of the schedule by corn- Day 1:- Descriptive information of teachers: Teachers from schools for children with severe disabilities in the Pretoria area reg- istered for the workshop. Each received a folder consisting of hand- outs, three unused schedules and each of the three above-mentioned questionnaires. These teachers had to have a minimum experience of six months with children with severe disabilities. The seats were arranged in a semi-circle facing the researcher/trainer in order to encourage interaction amongst the trainees. Each seat was numbered according to their anti-clockwise position from 1-12 (from right to left) for material to be distributed and collected. - Pre-training knowledge of skill areas: Prior to training, teach- ers completed an open-ended questionnaire which recorded their untrained knowledge of the five skill areas to be assessed in AAC as well as their expectations of the course. These questionnaires were collected after completion. - Introductory and background information on a functional assess- ment was presented by means of audio-visual material (overhead projector and transparencies). The schedule (see Table 1) was in- troduced and the questions as well as the instructions for scoring were read through with them and demonstrated. Teachers were required to score every item in every observation. The assessment schedules were not collected until the teachers had scored four children and had calculated the results. - Pre-training observation skills (Al): Firstly they were shown a video (A) of an autistic child (noted as observation Al). After three consecutive viewin'gs, they were requested to complete the schedule. The use of the schedule specifies that four functional tasks should be observed and documented. This first documenta- tion was regarded as Task 1 on the schedule. After completion of the first observation, questions were answered and the scoring of some of the items was compared within the group as part of the discussion regarding their problems. - Pre-training observation skills ( B l ) : They were then shown a second video (B) of a cei-ebral palsied child (noted as observation Bl) three times consecutively and they were required to complete the schedule as for Task 2 on the schedule (see Appendix A). The same procedure as in Observation A1 was followed after training. Again teachers required that scores of some items be compared. These were then discussed in the class. - Training in the completion of the schedule was conducted by means of video material of children with severe disabilities. Atrain- ing video of a young, non-ambulatory, cognitively high-function- ing child was shown (as many times as needed) and scored by all teachers. The child was severely communicatively disabled but demonstrated all precursors to communication while playing with a speech-language therapist during therapeutic prone standing. Open discussion of all items in the schedule was continuously en- couraged. Teachers scored this child as the third of the four tasks on their schedules. Scoring of these items were compared and dis- cussed by the group. Practical demonstrations and role play were used to demonstrate the items in the schedule. Day 2: - At the beginning of the second day handouts for the specific day were distributed. The previous day's work was reviewed, ques- tions answered and handouts were discussed. - Another training video of a non-verbal child was then shown as many times as necessary. The child identified pictures and symbols and the teachers had to score this video as well. The training video was discussed and scores com- pared. Teachers have now completed the four tasks on the schedule and could then learn to calculate the results. Each teacher had to cal- culate her four observations (Al, Bl, task 3 and task 4), and present the results as a graph. The completed schedules were then collected. Docu- mentation of tasks 3 and 4 were not used for the research but merely to train teachers in the use of the schedule, the various skill areas and to calculate the results. - Post-training observation skills (A2): Af- ter tea, the first video (A) was again shown (as often as necessary) and scored on an unused schedule as Observation A2. Questions were again answered and several scores compared. - Post-training observation skills (B2): The second video (B) was then shown (as often as necessary) and then scored as Observation B2. Questions were again answered and several scores compared. - Post-training observation skills (C): A third video (of an unfamiliar child) was then shown and also scored. This observation was documented as Observation C. Results were compared and questions anwered. The second schedule (with the results of documentation af- ter training), were then collected. - Post-training evaluation of schedule: Teachers had to complete a closed-ended ques- tionnaire to evaluate the schedule. - Post-training knowledge of skill areas and evaluation of the training: They also had to complete the open-ended questionnaire after training to assess the change that had oc- curred in their knowledge of the skill areas. Comments and recommendations regarding the training were also given. - At the end of Day 2 teachers received certifi- cates of attendance. Die Suid-Afrikaanse Tydskrif vir Kommunikasieafwykings, Vol. 43, 1996 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) 20 pleting a closed-ended questionnaire. Responses were cal- culated as percentages and displayed as a distribution graph. Comments and recommendations were tabled. Evaluation of the items in the schedule: The ap- proach followed emphasised the different interpretations given to the same set of data, and focused on the ability to observe the items listed in the schedule from the observa- tion of video cases as well as an evaluation of their ability to score the items. The ability to identify items described in the schedule was evaluated by using the data obtained from the schedules completed during training. All correct responses were given a value of 1 and all errors a value of 0 which implied that they could or could not identify the skill. Responses were considered as correct when the teach- ers' responses were the same as the norm (which was es- tablished by three AAC experts prior to the main study). A distribution of all 0's and l's was calculated before (Al and B l ) and after (A2, B2, C) training for all teachers and presented in two graphs. Four types of results were ob- served. They are summarised in Table 3. The results of both Observations A and B, before (Al, Bl) and after (A2,B2) training, were calculated as percent- ages and visually presented in Figures 3 and 4. Questions in the schedule which caused confusion ( 1 - 0 ) , or where no gains were made (0 - 0), should be altered to be better understood or should be specifically focused upon in train- ing. On the other hand, questions where existing knowl- edge (1 - 1), or gained knowledge (0 - 1) were observed, could be regarded as adequate for future use. EVALUATION OF SCORING This information was obtained by assessing the mar- gin of error exhibited for each question. Therefore all scores from the completed schedules were compared to a norm (the value of which was allocated by a specialist team prior to training), and then statistically analysed.. This analy- sis was done by obtaining the Root Mean Square (RMS) (Kirkpatrick, 1974) of the deviations from the norm for all 5 observations (Al, Bl, A2, B2, C), and then comparing them. This information in turn determined not only the magnitude of errors per question, but also the degree of complexity of each case. The deviations from the norm were calculated by subtracting the teacher's score from the norm. The RMS's of these deviations were then used as basis of assessing the questions: the larger the deviation from the norm, the less accurate the observation. An over- all impression of suitable questions can be obtained by Anna-Marie Wium and Erna Alant considering the distribution of the deviations. This is pre- sented in Fig. 7, where the number of cases (expressed as a percentage of the total number), was grouped in inter- vals of 25% of the deviation from the norm. The accuracy of teachers' observations as they deviated from the norm was calculated for the individual questions for all three cases (A,B,C). The scores documented before training were compared with those after training and indi- cated questions to be changed. In calculating an average er- ror per question for all cases (A,B,C) observed, an indication of problematic questions could be obtained. Questions with a >1.5 variation were considered as those questions which elic- ited poor scoring accuracy and should therefore be changed or receive more attention in future training. Questions with a <1.5 accuracy were considered adequate for future use. RESULTS AND DISCUSSION The schedule was evaluated from two perspectives: - The teachers evaluated it for ease of use - Content and structure of the schedule were evaluated by identifying questions (items), that proved to be dif- ficult to assess. EVALUATION OF THE SCHEDULE BY TEACHERS The data from this evaluation was obtained from a closed-ended questionnaire and the results are presented as a distribution graph. The results describing the ease of use of the schedule are presented in Figure 1 below. From Figure 1 it is clear that in general the teachers regarded the schedule as good or very good, and easy to use. None of the teachers evaluated any aspect on this questionnaire as poor or unacceptable although they had these options to choose from if they wanted to. The in- structions for use as well as the questions within the sched- ule were regarded as clear, and its appearance was well received. The length of the schedule for classroom use was considered acceptable (the alternative options to choose from were "too long" or "too short") which actually reflects the optimum choice. In general, the schedule was evalu- ated very favourably by the teachers and they thought that it would be of great future use to them. j EVALUATION OF CONTENT VERSUS STRUCTURE OF THE SCHED ULE The problematic questions in the schedule were identi- fied by using a two-level approach: ] TABLE 3: Four types of results for identification of items (0-1): Gains made by training in ability to identify a function. The number of teachers who could not identify the function before train- ing but could do so afterwards. A decrease of errors after training made by the group indicates that they had gained in observation skills regarding their ability to identify functions. (0-0): No gains made. This implies that the teacher could not identify the function before train- ing and neither could she do it after training. ίΒ^ΒβΛΗ^ϋίΒΛ Existing knowledge. These results imply that the teacher could identify the function before as well as after training. e^Bp^Blie^pllll^llillii Incorrect The teacher identified the correct function before training but could not do so after training. The South African Journal of Communication Disorders, Vol. 43, 1996 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) The Development of a Screening Schedule for Use by Abilities of Children with Severe Disabilities Firstly, it was established whether teachers could rec- ognise the particular skill (described by the item in the schedule) as exhibited by the student - thus whether the skill was displayed. Secondly the accuracy with which teachers could score (rank) their observation on a six-point rating scale was investigated. It was necessary to differentiate between these two aspects in assessing a particular item to prevent confu- sion. It is much less difficult to identify an item (skill) as present or absent by attributing a positive (1) or negative (0) value than to scale (score) it from 0 - 5. Scoring could be considered a more advanced skill which requires ex- tensive training. The data (collected before and after train- ing), was used to measure the success with which teach- ers could recognise items in the schedule as well as to iden- tify questions where items were unreliably scored on a rating scale. RECOGNITION OF ITEMS FOR ALL ITEMS AND FOR INDIVIDUAL CASES The questions of concern are those where the item could not be recognised correctly after training. A summary of correct and incorrect answers (after training) was com- Teachers to Describe the Communication 21 piled, and is presented in Figure 2. From this figure it is clear that after training approxi- mately 31% of the items were identified incorrectly, while 69% were correctly recognised as being present or absent. It is significant to note that the fact that they could iden- tify 69% of the questions before training, could imply that the questions in the schedule were formulated in a user friendly manner and that most people could understand it without any training. An analysis of the schedule for Cases A and Β together may be misleading, therefore Cases A and Β were studied separately. These results are presented in Figures 3 and 4, where the results obtained prior to training were also included. Four classes of answers could therefore be dis- tinguished and are presented in Table 3. GENERAL ANALYSIS OF INDIVIDUAL CASES - The sum of the first two categories in the correct group (1:1, 0:1), corresponds with the "correct" class in Fig- ure 2, while the latter two can be regarded as being equivalent to the "incorrect" class in that figure. From Figure 3 it is apparent that for Case A, a total of 65.7% (45.7% + 20.0%) is correct after training, compared with 69.3% for both cases. S c h e d u l e Ease of feraphing Ease of Arithmetic Ease of Scoring Ease of Assessment TV clear Understood questions Understood instructions Length Appearance C o m p a r i s o n of O b s e r v a t i o n s E v a l u a t i o n o f Q u e s t i o n s Conect 69% Inconect 31% FIGURE 1: Teachers' evaluation of the schedule C o m p a r i s o n o f O b s e r v a t i o n s P r e - & P o s t T r a i n i n g : C a s e A Incorrect 22.5% Correct 45.7% Correct/incorrect 11.7% Incorrect/correct 20.0% FIGURE 2. Total of all questions C o m p a r i s o n o f O b s e r v a t i o n s P r e - & P o s t T r a i n i n g : C a s e Β Incorrect 15.4% Correct 57.3% Correct/incorrect 11.7% Incorrect/correct 15.6% FIGURE 3. Difficult questions in observation A FIGURE 4. Difficult questions in observation Β Die Suid-Afrikaanse Tydskrif vir Kommunikasieafwykings, Vol. 43, 1996 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) 22 - In Figure 4, the total of correct items in Case Β amounts to 72.9% (57.3% + 15.6%), or a difference of 7,2% between the two cases. . It is also important to evaluate the im- pact of the training: For Case A (Figure 3), the correctness of answers improved for 20% of the answers, and decreased for 11.7% of the answers (a net gain of 8.3%). For Case B, (Figure 4), a net gain of 3.9% was recorded which is much less than for Case A. (a) Questions litems in the schedule that the teachers found difficult to recognise The results were finally used to identify individual questions where teachers found it difficult to recognise the presence or ab- sence of a skill. These results are presented in Figures 5 and 6 and should be looked at as a pair in order to distinguish different patterns in shading. Particular attention should be paid to the darker and solid ar- eas as these represent correctly identified items, while the lighter areas represent incorrect observations. It is obvious when observing Figures 5 and 6, that there is a marked difference in the patterns between Cases A and B. Ques- tions which were poorly identified in Case A were much better identified in Case B, and vice versa. A good example of this is where question no. 7 was poorly identified by 9 (75%) of the teachers in Case A but only by 2 (16%) in Case Β after training. This shows that the teachers understood the questions but that they might have had other difficulties, e.g., unfamiliarity with the case presented (which is discussed later). By studying Figures 5 and 6 specific questions were identified as difficult. All the questions which could not be identified by more than 25% of the teachers after train- ing, were regarded as difficult and are listed in Table 4 below. It was only after all these questions were listed (see Table 4), that similarities could be detected which in turn identified problematic questions. Questions which were repeatedly regarded as difficult in both Cases A and B, consist of 12% (6 out of 47) of the total number of questions. These questions (all AB or BA responses), were labelled as problematic and are num- bers 21, 26, 31, 33, 38 and 39. These ques- tions need more attention during training by more demonstrations and explanations. The motor skill area seems to be rela- tively difficult as 2/3 of the questions in this skill area are listed as difficult, which also includes half of the problematic questions on this list. This indicates that teachers found the terminology and assessment of Anna-Marie Wium and Erna Alant C o m p a r i s o n o f O b s e r v a t i o n s P r e - a n d P o s t T r a i n i n g : C a s e A 12 10 c 8 ο s 1 6 h. H) Ο 4 2 11 ι τ υ y C o m m u n i c a t i o n • Incorrect [g Cor/Incorrect Ρ - Ί Cognitive M o t o r S e n s o r y S o c i a l ] Incor/Correct gg Correct FIGURE 5. Difficult items to identify in observation A C o m p a r i s o n o f O b s e r v a t i o n s P r e - a n d P o s t T r a i n i n g : C a s e Β C o m m u n i c a t i o n ^Cognitiv^^ M o t o r >4 S e n s o r y ̂ "^Socfef • Incorrect m Cor/Incorrect m Incor/Correct g C o r r e c t FIGURE 6. Difficult items to identify in observation Β A c c u r a c y in S c o r i n g S u m m a r y o f D i s t r i b u t i o n o f E r r o r s 10% 15% 20% P e r c e n t a g e of Q u e s t i o n s 25% FIGURE 7. Categorised results of the distribution of errors The South African Journal of Communication Disorders, Vol. 43, 1996 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) The Development of a Screening Schedule for Use by Abilities of Children with Severe Disabilities motor skill area difficult. The majority of teachers in this study had not yet worked with physically disabled hildren and therefore had no knowledge of this skill area. This is therefore not a reflection on the schedule, but more on the teachers' experience. (b) Teachers' accuracy in scoring (rating 0-5) the items in the the schedule The data obtained from the completed schedules also provided information on the questions which elicited poor scoring. Teachers scored their observations which were compared with the norm, on a scale from 0 to 5. The size of the deviation from the norm indicated their ability/in- ability to score a specific item, e.g., when the teachers' scores deviated more than two numerals on a scale from 0-5 then their scoring ability was considered as poor. When their scores deviated one numeral (on a scale 0-5), then Teachers to Describe the Communication 23 their scoring ability was considered as inconsistent. An overall impression of suitable questions can be ob- tained by considering the distribution of the deviations. This, is presented in Figure 7, where the number of cases (expressed as a percentage of the total number), was grouped in intervals of 25% of the deviation from the norm. From Figure 7 it is clear (when adding the number of questions in the two intervals of deviations between 26% and 75% from the norm), that there is a large percentage (45%) of questions in this section. Also, none of the ques- tions deviates more than 200% (2 numerals on the scale 0-5), from the norm. It must be made clear that the term % might be misleading and should be regarded as a unit (e.g., 100% deviates in fact 1 score from the norm). A more detailed account of the specific problematic ques- tions was obtained when the average error per question was calculated and it became clear that 12,7% of the ques- tions deviated more than 150%. The specific questions are TABLE 4: Difficult questions to identify No Question Prior tu Training After Training CO MMUNICATION SKILLS 1 How well does he respond to his name being called? A 3 To what extent does he look at preferred item to indicate choice? A 7 How well does he make sounds? A A. 11 How well does he use questions? Β Β 12 How well does he use Yes/No responses? Β Β 15 How well is his speech understood by others? Β Β CO GNITIVE SKILLS 18 How well can he imitate movements after a model? A A 21 How well does he follo.w a one-step command/request ? AB AB 23 How well does he use jan object for what it is meant for? A A MC >TOR SKILLS 26 How well is the student positioned for function? Β BA 28 How good is his muscle tone? (floppy/very stif!/mixed=0, normal=5)? Β Β 30 How well can he reach with right arm (range of motion)? Β Β 31 How well can he reach with left arm (range of motion)? AB AB 33 How good is the fine co-ordination in his dominant/user hand? AB AB 34 To what extent are uncontrolled movements (arms/legs) present? (normal=5) A A SE NSORY SKILLS 36 How well does he visually attend to a task? • A A 38 How well does student visually follow moving object? (tract) AB AB 39 How well does student visually select a preferred choice? (scan) AB AB Μ CIAL/EMOTIONAL BEHAVIOUR 45 How often does self-stimulation occur? A A 46 How well does he make eye contact during communication? Β A = Case A; Β = Case Β; AB = both Cases A and Β Die Suid-Afrikaanse Tydskrif vir Kommunikasieafwy kings, Vol. 43, 1996 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) 24 lematic to score^han any other^ ^ w a ^ ^ ^ ^ T m V r r S n g w S T s in accordance with find- S t S a M f a n " i e l d y k e (1988), who stated that the assessor should be skilled. When the scoring of the indi- vidual skill areas was studied, it became dear tha the teachers were too broadly trained in the skill areas to be tested with such a relatively fine measuring instrument. However, the repeated use of the rating scale is useful for monitoring progress in the classroom. In general, the items in the schedule were not significantly better scored after training. Scoring is considered an advanced skill which requires more training. PROBLEMATIC QUESTIONS IN THE SCHEDULE When both the ability to identify the items as well as the scoring of the schedule are taken into account, six ques- tions were found to be difficult, of which four were found in the motor skill area of the schedule. Of these only one question needs to be rephrased. Difficult questions require specific attention in future training. CONCLUSIONS The results indicated that the schedule is adequate for future use as teachers found it easy to use and the ques- tions were adequately phrased. The training of teachers in the use of this schedule, however, needs to focus more on unfamiliar skill areas depending on the experience of the teacher (e.g., teachers who work with children with only cognitive disabilities would need more familiarisa- tion with the motor skill area as their children are not physically disabled). The scoring routine of the schedule should be considered as an advanced skill which may need more practise and further training. The results obtained in this study highlight various issues which could have had an effect. This study showed that some children are more difficult to assess for specific teachers than others. Two important factors which have to be kept in mind are: - The teachers' familiarity with the disability: The ma- jority of teachers in this workshop were unfamiliar with physically disabled children as they were used to work- ing with primarily cognitively disabled children. The terminology applicable to the motor skill area was there- fore especially at risk. This was pointed out as two thirds of the questions regarded as difficult occurred in the motor skill area. The effect of familiarity with the Anna-Marie Wium and Erna Alant disability observed could be seen in their ability to iden- tify items as well as in scoring. Furthermore, the fact that the items which were poorly identified, and the items poorly scored did not match each other, supports the notion that the ques- tions in the schedule are not so much poorly phrased, but that teachers were less familiar with certain skill areas due to their experience with specific disabilities. These results underline the complexity of assessing the severely disabled child (Culp & Carlyle, 1988), and also the fact that it is not easy to learn to observe objec- tively and in depth. It is therefore essential that future initial training workshops train a specific group of teachers with a familiar disability, as more reliable re- sults could be obtained. Additional disabilities can be introduced with more advanced follow-up courses in order to make teachers better observers. Secondly, the severity of the disability: In addition to the above, teachers were also not familiar with the se- verity of the disabilities observed. The majority of teach- ers who attended this workshop had not been exposed to severely physically disabled children as their own . students were mainly severely or moderately cognitively disabled. Familiarity in the use of the schedule and the ability to observe depends on repetition (Stevens, 1978). This also became clear during training where it was observed that the more experienced and skilled teachers became in the use of the schedule , the less time was required to complete it and the more accurate their scoring became (as was continually noted in observation of Case C). Perhaps the most significant contribution of the sched- ule and the training was the effect it had on the self- confidence of the teachers. The results in Figure 1 indi- cated they felt confident of their ability to apply the schedule in future. This study has provided teachers with a screening tool as well as training in the use of the tool. The ability to effectively assess students by using the schedule made teachers feel efficient and in control. Practise and continual use of the schedule will_ make them feel even more confident and efficient in assessment. This implies that teachers who are able to use the schedule effectively, become empowered to per- form their role as teachers more successfully. Most importantly in this study, the issue of a transdis- ciplinary approach was addressed. One of the problems in AAC service delivery was that the responsibility of assessment had largely been considered as that of the professional speech therapists (Hogg & Raynes, 1987). Such measures resulted in it being an exclusive serv- ice in this country, focusing on the community with the TABLE 5: Questions poorly scored No Description of question Skill areas 2 To what extent does he want to communicate with others? Communication 6 How well can he point to an object (finger or hand)? Communication 34 Are any uncontrolled movements present? Motor 36 How well does he visually attend to a task? Sensory 41 How well does he attend auditory? Sensory 45 How often does self-stimulation occur? Social/Emotional The South African Journal of Communication Disorders, Vol. 43, 1996 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) l o o m e n t of a Screening Schedule for U s e b y The D e ^ o f Children with Severe Disabilities A I ' ancial resources to afford it. This study provides a ! p n i n g instrument w h i c h can b e used b y a m u c h crroup of people, w h i c h in turn makes the service ΐ £ Ι Ι ^ β Γ Γ ν of AAC more available and accessible to those work with children with severe disabilities. The f this schedule enables teachers to identify prob- Γ δ β ° to refer to a specialised multi-disciplinary t e a m when necessary, to plan communication objectives and to monitor progress. This in turn results in more effec- tive service delivery where problems such as limited manpower and funding are addressed. A C K N O W L E D G E M E N T S This study was funded b y the University of Pretoria. R E F E R E N C E S American Speech-Hearing-Language Association (1992). (Joint Committee for the Communicative Needs of Persons With Severe Disabilities). Guidelines for meeting the communi- cation needs of persons with severe disabilities. ASHA, J4W), Barlow D & Hersen, M. (1984). Single-Case Experimental Designs: Strategies for Studying Behaviour Change. Oxford: Pergamon Press. . . . Bereer A F Presperin, J. & Tallman, T. (1990). Positioning for Function: Wheelchair and Other Technologies. New York: Valhalla Rehabilitations Communications. Beukelman, D.R. &.Mirenda, P. (1992). Augmentative and Alternative Communication: Management of Severe Communi- cation Disorders in Children and Adults. Baltimore: Paul Brookes Publishing Co. Cuip, D. & Carlyle, M. (1988). Partners in Augmentative Teachers to D e s c r i b e the C o m m u n i c a t i o n 25 Communication Training. Tuscon, Arizona: Communication Skill Builders. Durant, V.M. (1990X Severe Behaviour Problems: A Functional Communication Training Approach. London : The Guilford Hogg, J. & Raynes, N. (1987). Assessment in Mental Handicap: A guide to Assessment Practices, lists and Checklists. London: Croom Helm. Huer, M.B. (1983). The Non Speech Ifest for Receptive/Expressive Language. Don Johnston Developmental Equipment, Inc, USA. Kirkpatrick, E.G (1974). Introductory Statistics and Probability for Engineering, Science and Technology. In W.J. Fabrycky, & J.H. Mixe (Eds.). New Jersey: Prentice-Hall. Light, J. (1989). Toward a definition of communication competence for individuals using augmentative and alternative communication systems. AAC, 5(2), 137-142. Light, J., Dattilo, J., English, J., Gutierrez, L. & Harts, J. (1992). Instructing facilitators to support the communication of people who use augmentative communication systems. Journal of Speech and Hearing Research, August, 35, 865-875. Mirenda, P. & Iocono, T. (1990). Communication Options for Persons with Severe and Profound Disabilities: State of the Art and Future Directions. Journal of American Speech and Hearing, 15(1), 3-21. Salvia, J. & Yseldyke, J.E. (1988). Assessment in Special and Remedial Education. Boston: Houghton Millin Company. Skuy, M., Westaway, M., Makula, N. & Perold, C. (1988). Development of a Screening Instrument for the Identification of Pupils with Impairments. South African Journal of Education, 8(1), 45-49. Stevens, M. (1978). Observe - Then Teach: An Observational Approach to Teaching Mentally Handicapped Children. London. Edward Arnold. Wium, A.M. (1994). The Development of a Screening Schedule for' Teachers to Describe the Communication abilities of Children with severe disabilities. Unpublished M. Log. Thesis. University of Pretoria. 0 PLAY i X A N D m S C H O O L R O O M ! S H O P 6 L T H E R O S E B A N K M E W S 1 7 3 O X F O R D R O A D 1 R O S E B A N K J H B . TESTS, PROGRAMMES, BOOKS, TEACHING AIDS, JOURNALS AND RESOURCES FOR CHILD DEVELOPMENT SPEECH & LANGUAGE LEARNING DISABILITIES SPECIAL NEEDS P H O N E 788-1304 ADULT REHABILITATION ^ S S i S w n i n SOCIAL ACTIVITIES S A X O N W O L D F A X : 8 8 0 - 1 3 4 1 Die Suid-Afrikaanse Tydskrif vir Kommunikasieafwykings, Vol. 43, 1996 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2)