Some comments on aspects of the methodology for the measurement of stuttering Lesley Caplan BA(Sp & HTherapy) MA (Clin Psych) (Witwatersrand) Tara, The H. Moross Centre, Private Bag X7 Randburg, 2125 ABSTRACT The measurement of stuttering in a conversational context presents certain problems that are difficult to resolve despite a vast Iteraure on the appeal of stuttering behaviour. This view stems from problems encountered in a study designed toguagTe effects of conflict generated in a family context, on the stuttering behaviour of the child. Conflict was defined as a social process and was induced for the purpose of this study, by a standardised communication conflict sitLtion. Theresults ofthes^ywee :°J T t Z ' h™ever-!t. n o t c 0 n d u d e d t h a t Bering and conflict are not related. Rather, there are difficulties in aspeclsof^hemethodn^ f Γ ^ ™ ^s paper is concerned irfft some aspects of the methodology for the measurement of stuttering that seem inadequate for research that has as its data conversa- tional interaction in a family context. Some alternative strategies are suggested. OPSOMMING Die diagnose van hakkelin η gespreksituasie lewer baie probleme op alhoewel daar baie literatuur oor die diagnose van hak- t £ ? \ ! e m ^ " V°re 8 e k ° m ί η 'n ^ W a t 0 n t W e r ? i s 0 m d i e ** ™ konflik in die gesins-konteks op die hakkelgedrag van die kind te evalueer. Konflik is as η sosiale proses gedefinieer en is toegepas by wyse van η standard kommunikatiewe konfliksituasie. Die resultate van die studie was nie betekenisvol nie, maar daar kan nYe^elei word ZhZel en konflik nie verwant is me. Daar is eerder struikelblokke om die verwantskap te evalueer. Een so η struikelblok is dat die meting van hakkelgedrag problematies is. Hierdie artikel lig metingsmetodes vir navorsing uit wat onvanpas is vir die verwerking van data verkry uit gespreksinteraksie in η gesinskonteks. Alternatiewe metodes geniet aandag. The quality of most research on stuttering behaviour is disap- pointing and despite attempts to enhance the standard of in- quiry and a plea for greater empirical sufficiency,22 many deficiencies are apparent. Little, if any, attention has been given in recent years to measurement conventions such as severity ratings and frequency counts, which constitute the bedrock of assessment of stuttering, or to the nature and size of the speech sample for this procedure.20 In the main, reading passages and short samples of self-formulated speech have been the data for appraisal. It seems that certain assump- tions that were made in the early years to permit "an opera- tionally meaningful appraisal of stuttering"5 have been ac- cepted and utilised with little questioning of their 'truth'. In the light of this, the measurement of stuttering in a conver- sational context presents certain problems that are difficult to resolve despite a vast literature on the methodology for the assessment of stuttering. It may well be that the measurement strategies that have been developed, mask information about stuttering, particularly when applied to conversational data. This view stems from difficulties encountered in a study on the relationship between conflict in the family and stuttering jehaviour. \ brief synopsis of the study follows. METHODOLOGY The experimental sample consisted of 20 families, each com- prising biological mother and father and their stuttering child. The stuttering children were considered to qualify as Track 1 stutterers,21 were all boys ranging in age from 8 to 12 years, coping adequately at school and from middle class, English- speaking South African backgrounds. j The standardised communication conflict situation devised by Blakar3 was used to generate conflict and to elicit the stutter- ing behaviour of the child in the family context. Briefly, the task comprises a map of a complex network of streets through a city centre, a copy of which is given to each of two (or more) participants. One of the participants has two routes marked on the map; a short simple route and a longer more complicated one. The other participant/s has/have a map on which no routes are marked. The object of the exercise is for the participant/s with the routes to explain to the other/s how to get through the city to certain endpoints via the predetermined routes. The short simple route permits a baseline measure of behaviour, in this instance stuttering, while the longer route, by virtue of a small discrepancy be- tween the maps is impossible to complete successfully, so generating conflictual interaction. S> SASHA 1983 The South African Journal of Communication Disorders, Vol. 30, 1983 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) The Measurement of Stuttering The design accommodates a parent-child constellation (a triad) and permits the ascribing of roles to the participants as either 'explainers' or 'followers'. Whatever the role assigned however, the standardised communication conflict situation constitutes a complex linguistic task demanding flexibility and ensuring a high degree of communicative responsibility for all the participants. It is intrinsically a highly propositional task, which means that language is being used intentionally and intellectually to convey meaning and information.5·8 Such a task demands precise accurate verbal communication. This limits the ability of the participants to circumlocute, and so in the case of the stuttering child avoid those words that could precipitate dysfluency. The influence of conflict in the context of the family, on stut- tering behaviour of the children, was examined by rating the severity of stuttering and by frequency counts of all dysfluen- cies as well as frequency of repetitions and prolongations - the so-called "core features" of stuttering.21 A 7-point rating scale was used for the severity of stuttering, while frequency was determined by making verbatim transcripts of the data, analysing the dysfluencies using the Iowa Categories of Dysfluency11·12 and computing ratios in relation to the total verbal output. As the standardised communication conflict situation generates conversational interaction, the data for the measure- ment of stuttering of the child in each family triad comprises a sample of discourse of variable length. There is limited experimentation directed towards ascertaining what constitutes an adequate speech sample representative of the stutterer's speech, and clearly contextual or situational aspects deserve consideration as well as the length of the sam- ple for assessment. The tradition in research on stuttering has been to use oral reading material as the data, but with the recognition that this is not representative of the communication behaviour of the stutterer, various 'spontaneous speech' tasks have been introduced.12 These However, tend to elicit monologues rather than conversational discourse. In general a 3-minute sample of such speech has been considered adequate. However, the preferred method has remained the use of reading material, dictated by the experimental control afforded over certain linguistic parameters considered relevant to stuttering. The paucity of work on so-called spontaneous speech and even less so on speech in a conversational context, is not surprising in the face of difficulties in holding constant, not only the rele- vant dimensions of the speech output,16·17 but in determining which of a gamut of factors both incidental and manipulated may be operating. For the purpose of the present study, the conversational data was segmented into observational periods of 5 minutes and for each family two, and in some instances, three such samples were used for the analysis of stuttering behaviour in the face conflict in the family. For the baseline measures of stutter- mg the entire interaction on the short simple route of the task was used.;> The design of the study was therefore, of the pretest-posttest type- Analyses of Covariance were performed to determine the statistical significance of the findings. >eSuid-Afrikaanse Tydskrif vir Kommunikasieafwykings, Vol. 30, 1983 31 RESULTS The results of the study were not significant, however, it was not concluded that conflict and stuttering are not related. Rather there are difficulties in establishing this relationship. One of the difficulties concerns the definition and measure- ment of stuttering. The complexities of the definitional pro- blem will not be considered here. While the current study followed accepted conventions for appraisal, what does differ fundamentally from 'standard' procedures is the manner in which the speech sample was elicited. It seems that the somewhat global measures used in this study, and most often in research on stuttering, may be inadequate for assessing dysfluency in a verbal interchange in a family context. A more detailed consideration of these issues follows. DISCUSSION Clearly the conversational discourse elicited by the standardis- ed communication conflict situation is a far cry from the reading material and 'monologues' of self-formulated speech traditionally used in clinical and research settings with stut- terers. Conversational discourse involves an individual's abili- ty to use language not only in terms of its grammatical struc- ture, but also as regards its appropriateness in relation to a variety of different contexts.10 Conversation taxes capacities to integrate "linguistic, cognitive and social rules",14 so that communication is realized, not only through the verbal reper- toire, but through an awareness of a "complex matrix of refe- rential codes",18 some linguistic and paralinguistic, and some of which are socioculturally determined. With this in mind, it is clear that conversational speech in a communication context is a network of multiple factors, individual and social, and any analysis of such discourse must take cognisance of them. A parameter of discourse that can be used to illustrate the com- plexity of such an approach concerns features like the postponements, hesitations and retrials that often accompany attempts to formulate and transmit meaningful information. The absence of criteria to define fluency remains a stumbling block in any consideration of dysfluency7 and given conversa- tional discourse as the data for an investigation of stuttering behaviour, even the apparently simple procedure of counting the number of words that constitute the total verbal output of an individual poses a major problem. Decisions have to be made as to whether words form an integral part of the mean- ingful context12 or not and this is not a clear cut task, given the revisions and changes that characterise conversational speech. In considering the measurement of stuttering once again, it could be argued that frequency counts, while constituting a substantial component of the degree of stuttering, are not sufficient.2 Other factors, such as the duration of stuttering moments and the tension and struggle behaviour accompany- ing speech, also contribute to assessment. These features do manifest in the overall tempo of speech and a consideration of the rate of utterance is important in a comprehensive appraisal of stuttering behaviour. As regards the rate of utterance Dalton & Hardcastle7 recommend a measure of the number of syllables uttered in each second in a sequence of speech for the rate of utterance. There are, of course, difficulties in measur- ing such short segments accurately with a stop watch. Spec- R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) 32 trographically, this may be possible, but a certain expertise and skill is required in using the equipment and analysing the results. More specifically with reference to the present study it becomes difficult to find uninterrupted sequences of speech of sufficient duration in a conversational interchange to permit accurate timing without expensive electronic aids. In summary, stuttering is clearly a variable disorder, and the moment of stuttering is a non-unitary combination of a variety of behaviours.6 That some undefined incident evaluated as stuttering has been considered to occur, remains the hallmark of measurement in clinical and experimental work in the field.6 The problems in definition and the inextricably related difficulties in delineating operations to measure stuttering as well as the reliability of these measures are not insubstantial In the light of such complexity and the absence of clearly- defined parameters, recourse to 'consistency' has been the on- ly option in the measurement of stuttering. Certain rules are specified to ensure this consistency and so permit some modicum of control.12 It is the present writer's contention however, that these measures are not necessarily capturing the problem behaviour and that given the intrinsic fluctuant, almost mercurial nature of stuttering, frequency counts and severity ratings are too global. It seems that a single rating of severity on a 3-minute sample of speech, or frequency counts of moments of stutter- ing expressed as a ratio of the total verbal output yield measures of 'mean' stuttering. Little can be said on the basis of these and most of the contemporary measurement conven- tions, about change in stuttering behaviour. In the light of the variability of stuttering, a phenomenon repeatedly noted but subjected to surprisingly little systematic research,1 attention to the 'extremities' of stuttering behaviour and attempts to track changes moment by moment could represent a more refined way of measuring stuttering than the averaging out of stuttering behaviour as a function of the measurement procedures. It may be the very imposition of consistency on the essential variability of stuttering behaviour that may be masking our knowledge of the disorder. Having presented a critique of some aspects of the methodology of the measurement of stuttering, it remains to propose some alternative strategies and some rudimentary ideas. It seems that the criticism of research on stuttering for "an in- sufficiency of empiricism"22 has in fact been perceived and the plea for a more rigorous methodology has been headed by some investigators. A consideration of some of this work follows. There seems to be a need not only for meticulous research into the phenomenology21 or overt manifestations of stuttering behaviour,15 but as already suggested, to track stuttering and relate it, moment by moment, to both language use and its social context.24 The conceptual framework for the study of communication by Blakar4 and his associates, and the model for and understanding of stuttering by Wertheim,23 seem to provide some guidelines for this endeavour. An attempt will be made to integrate some recent research in stuttering with these views. Lesley Caplan The writings of Kaasin and Bjerkan13 reveal both a recogni- tion of the subtle interplay between the individual and the multiplicity of situational and social variants in the act of communication4 and some attempt to encompass these aspects in research. They point out that two issues have been the concern of research on situational variability and stutter- ing. These are first, the actual situations in which speech takes place, and second, the locus of stuttering in the speech se- quence with actual words being attributed with properties that could precipitate the moment of stuttering. Berkjan13 coined the concept "critical word" to characterise "the relationship between a word and a situation" so that it is not the word itself that carries the complex of precipitating factors but the word "with reference to the dialogue". Similarly, the work of Wertheim23·24·25 has relevance. Her exposition of the learning of word-meaning and its importance in interpersonal relation- ships, particularly in the context of the family, not only com- plements the concept of critical words,13 but extends this to permit a definition of critical situations or "sensitive 'stut- terogenic' areas for a given individual".24 Given this, recourse to the work of Blakar4 and his associates reveals an approach to the analysis of verbal interaction on an utterance level and a categorisation system anchored in com- munication theory and social-developmental psychology that would seem to facilitate the kind of research mentioned above Concepts such as attribution from social psychology or egocentncism, one of the contributions to developmental psychology for which Piaget is renowned, have been produc- tively used in research on psychopathology and deviant behaviour. Issues such as who attributes the difficulty in what way, to what aspect of the situation, or to whom and how the other responds, are all considered.4 Using the standardised communication conflict situation already described and the conversational data elicited by the task, an utterance-by- utterance analysis of the interaction thus generated becomes possible. Every instance "of an explicit attempt at attributing the experienced communication difficulty"9 can be identified and categorised in terms, for example, of who, what, how, and the response evoked. This could be accompanied by a concur- rent and linking analysis of each moment of stuttering The compatibility of this with the work of Kaasin and Bjerkan13 is evident. CONCLUSION It seems that there are deficits in stuttering research that have become "perennials"19 and despite pleas for greater empiricism22 and an unified effort to enhance the quality of stuttering research,2» little progress has been made. It is clear that despite stuttering being deemed "an impediment in social living"21 the model underlying research efforts seems to have been that of individual psychology. As Blakar4 puts it "this model is well suited to understanding the individual as language-user in various aspects. But the model is totally inadequate with regard to the social and situational aspects of communication and even hinders questions to be posed" Given the subtle interplay between the individual and the multiplicity of situational and social variants in the act of com- munication, it seems that a single rating of severity of stutter- ing on a 5-minute sample of conversation or frequency counts of moments of stuttering expressed as a ratio of the total verbal The South African Journal of Communication Disorders, Vol. 30, 1983 R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2) The Measurement of Stuttering output are too global and inclusive. The result is a measure of 'mean' stuttering. In the light of the variability of stuttering it seems that much of the essence of stuttering is being lost' It is clear that the present paper has merely touched on the issues involved. Research designs remain simplistic subject populations are usually small and comprise college and university students with little attention to children Additional ly, the controversy as to whether suttering frequency data con- stitute interval data or not2" and the assumptions of linearity of regression and homogeneity of variance, particularly in the case of self-formulated speech, deserve consideration " Much remains to be done in research and in synthesising the wealth of data on stuttering. Only with this effort and im- provements in the quality of research in stuttering can some contribution to the elusive solution to the "riddle" of stuttering2' be made. ACKNOWLEDGEMENTS Sincere thanks are expressed to Prof. G. Straker, Head of the Applied Division of the School of Psychology, Universky of the Witwatersrand, Johannesbuig, for her su^rvision ο "the study from which this paper is drawn. REFERENCES 1. Andrews G„ & Harvey, R. (1981): Regression to the Mean in Pretreatment Measures of Stuttering. Journal of Speech and Hearing Disorders,2 204-207 2-Aron, M. L. (1967): The Relationships between Measurements of Stuttering Behaviour. Journal *7e South African U>gopedic Society. 14 15-34 f n g a l T n t o R C M · ( 1 9 7 3 ) : Λ Π E X P C r i e n t i a i M e t h o d for 4 Communication and Psychopathology: A Social-Developmental Approach to Devtant Behaviour. Universitetsforlaget, Oslo t B l 0 0 ? t l n ' (1969): Λ Handbook on Stuttering Na X X T S o c i e t y f o r C r i p p l e d - 6' S l w J· ) : S T e r m g : T°POSra?hy· Assessment and Behavior-Change Strategies in Stuttering.• A Second 7- ίΖίΤ^ΤΎ ^ ) ̂ e r & Row'New Yor^ 'Γ' ?i^CaStle· W · 1 (1977>· borders ofFluen- <^their Effects on Communication. Edward Loll, & . η Γ Γ ' ' · Τ ? " ' S t U t t e r i n g 3 S ative Behavior in buttering A Second Symposium. Eisenson, J. (Ed ) Harper & R o w , New York. ' ' o f A ^ · ' ' S ' & B l a k a r ' R · M · ^ 8 0 ) : ftttems h l t n T a V h ° f ? 0 m m U n i C a t i 0 n D i f f i c u l t i e s i n Couples " g 3 Schizophrenic', a 'Borderline' or ' 'Normal' off- 33 spring in Studies of Familial Communication and Psychopathology: A Social-Developmental Approach to Deviant Behaviour. Blakar, R. M. (Ed.Τ Unive sitetsforlaget, Oslo. e r 10- Hymes, D Η (1972): On Communicative Competence in Soaolmguistics: Selected Readings. Pride, J B & H o l i e s , I (Eds.) Penguin Education, London. ' ϊ Ζ Τ ' Γ ( 1 9 6 1 ) : M e a S U r e m e n t s Oral Reading and Speaking Rate and Disfluency of Adult Male and Femde Stutterers and Non-Stutterers. Journal of Speech aZ Hearing Disorders Monograph 7 1-20 ^ α ΐ ϊ Γ π W ' D a r l f J ' R L · ' & Spriestersbach, D. C. T Z , Z ™ t h o d s in S p e e c h Pathol°sy· 13. Kaasin, K. & Bjerkan, B. (1982): Critical Words and the ^ c u s of Stuttering i n Speech. Journal of FlueZ Disorders, 7, 433-446 riuency 14- Kagan, A. (1977): Aspects of Cohesion and Tense in the Discourse of the Older Child. Unpublished Undergraduate Research Project, University of the Wk watersrand, Johannesburg 15. Marks Wahlhaus, M. (1979): Judges Agreement on Auditory and Visual Aspects of Stuttering The South Afrcan Journal of Communication Disorders, 26 3-18 16. Minify F. D. & Cooker, H. S. (1964): A Disfluen^ n - ' m'-lll ° f a n d H e a r m g borders! 29, 17. Moore, W. E. (1954): Relations of Stuttering in Spon- ^ i e o u S speech to Speech Content and Adaptation. Zr- nal of Speech and Hearing Disorders, 19, 208-216 18. Muma, J. R. (1975): The Communication Game· Dump and Play. J o u m a l o f S p e e c h ^ ^ ^ J ^ P 1 9 ' W " η ? U O C k ' J · ( 1 9 7 ? ) : T h e h'stoncal roots of the theory and therapy of stuttering. Journal of Com- munication Disorders, 10 3-24 20. Sommers, R. K. Bobkoff-Leventhal, K„ Applegate J A & Square, P. A. (1979): A Critical Review of a Decade 0 f S p r i n g Research. Journal of Fluency Disor^l, 21. Van Riper, C . (1971): The Nature of Stuttering. Prentice- Hall, Englewood Cliffs, New Jersey 22. Webster R L. (1977): Concept and Theory in Stuttering· 2 3 ' T r T ^ B r i t i \ Τ ' ' B i ° " A d a p t i V e T h C 0 T y Stutter- 283-295 ° f M e d l C a l Oology, 45, 24. Wertheim E. S. (1972): A New Approach to the Classification and Measurement of Stuttering. JouJlof Speech and Hearing Disorders, 37, 242-251 Z T T ' h S - i 1 9 7 2 ) : a Word? British Journal of Medical Psychology, 45, 35-43. e ^frikaanse Tydskrif vir Kommunikasieafwykings, Vol. 30, R ep ro du ce d by S ab in et G at ew ay u nd er li ce nc e gr an te d by th e P ub lis he r (d at ed 2 01 2)