|Year : 2018 | Volume
| Issue : 1 | Page : 23-33
Sociolinguistic adaptation process of the Bangla Western aphasia battery-revised
Barnali Mazumdar1, Neila J Donovan2, Vaishna Narang3
1 Department of Communication Sciences and Disorders, Louisiana State University, Baton Rouge, LA, USA; Centre for Linguistics, Jawaharlal Nehru University, New Delhi, India
2 Department of Communication Sciences and Disorders, Louisiana State University, Baton Rouge, LA, USA
3 Centre for Linguistics, Jawaharlal Nehru University, New Delhi, India
|Date of Web Publication||14-Jun-2018|
Department of Communication Sciences and Disorders, Louisiana State University, 71 Hatcher Hall, Baton Rouge, LA 70803
Source of Support: None, Conflict of Interest: None
Introduction: The purpose of this study was to complete a sociolinguistic adaptation and validation of the Western Aphasia Battery-Revised (WAB-R) (Kertesz and Raven, 2007), an English aphasia assessment into the Bangla language. Two hundred and fifty million people speak Bangla/Bengali in eastern parts of India and Bangladesh. Methods: This study had two steps: first, three professional translators performed the translation and back-translation processes on the WAB-R. Second, to validate the adaptation, 27 neurologically normal individuals and 36 patients with a history of cerebrovascular accident participated in this study. Results: Three types of adaptation processes, i.e., introduction of new words or phrases, direct translation, and direct translation replacing concepts were involved. As per different adaptation processes, Record form part 1 (derives aphasia quotient [AQ]) achieved 25% of sociocultural and linguistic changes whereas Record form part 2 (derives cortical quotient and language quotient) achieved 57% of sociocultural and linguistic changes. The items of Bedside record form (shorter version of the test) were taken from Record form part 1 and part 2. Normal controls completed the test with scores of 100% on most of the sub-tests while the patients' performance was significantly lower. Eighty percentage of the patients had aphasia, based on their test scores, and investigators could categorize the patients by aphasia type based on the AQ and bedside aphasia score. There is a high correlation between the subtest scores of Record form part 1 and Bedside record form. Conclusion: Some changes were needed to adapt the WAB-R for Bangla speakers. Preliminary validation study demonstrated that the Bangla WAB-R could differentiate the normal population from the patients with aphasia by their language performance. Investigators will attempt to standardize the test in the next phase of the study.
Keywords: Adaptation, Aphasia, back-translation, Bangla/Bengali, translation, Western Aphasia Battery
|How to cite this article:|
Mazumdar B, Donovan NJ, Narang V. Sociolinguistic adaptation process of the Bangla Western aphasia battery-revised. J Indian Speech Language Hearing Assoc 2018;32:23-33
|How to cite this URL:|
Mazumdar B, Donovan NJ, Narang V. Sociolinguistic adaptation process of the Bangla Western aphasia battery-revised. J Indian Speech Language Hearing Assoc [serial online] 2018 [cited 2019 May 20];32:23-33. Available from: http://www.jisha.org/text.asp?2018/32/1/23/234484
| Introduction|| |
Stroke or cerebrovascular accident (CVA) may result from different health disorders, such as high blood pressure, diabetes, and hypertension, and it causes disability. Aphasia, an acquired language disorder, occurs in 25%–40% of stroke survivors. It also occurs due to focal brain lesions and can impair any or all language modalities – listening, speaking, reading, and writing. Aphasia is not defined as a disorder of cognition or motor functioning.
India has the third highest stroke prevalence in Asia after China and Japan. After Mumbai, Kolkata has the second highest stroke incidence at 334/100,000 people in India. Bangla/Bengali is the native language of Kolkata and Bangladesh. Worldwide, it is the 6th leading language, spoken by 250 million people. Considering the incidence and prevalence of stroke and aphasia, it is clear that there may be a significant number of Bangla speakers with aphasia.
Aphasia can be treated to improve communicative effectiveness and thus quality of life. A speech and language assessment must be completed to identify the type and severity of aphasia which will lead to proper treatment. It is the speech language pathologists' (SLPs) job to select the most appropriate assessment tools. There are numerous aphasia assessments developed for English speakers and later translated into other languages. However, many countries still lack valid and reliable aphasia assessments. There are two ways to create a test in a particular language – develop a new test or adapt an existing test in the target language. Sometimes, adapting an existing test is preferable because the adaptation process appears to be more efficient than developing a new test. In addition, in the test adaptation, task structure, scoring, and scaling models have been established, saving further time.
However, adaptation is not a simple translation of a test when the source language and target language are different and spoken in two diverse communities/cultures. If done well, adaptation provides a more culturally and linguistically equivalent version of a test. For adaptation, clinician-offered changes have to be linguistically compatible with the existing test items. Otherwise, the results will produce a high rate of error. Spontaneous translation is not an optimal way to assess aphasia because it may differ with time and person which leads to invalid results. Due to the absence of standardized aphasia tests in Bangla, SLPs in West Bengal and Bangladesh have had to resort to the spontaneous translation of existing English aphasia assessments in Bangla in the past. Adapted aphasia tests have been completed for other Indian languages, such as Kannada, Malayalam, and Telugu, but most of these tests remain unpublished or have limited circulation., The published literature includes little to no discussion on the actual adaptation processes used for these tests.
There is a progress in aphasia test adaptation for Bangla speakers. Investigators recently reported on the validation of a Bangla version of the original Western Aphasia Battery (WAB). However, they included only limited information on the adaptation process employed. Recently, Kertesz and Raven introduced the WAB-Revised (WAB-R) which included several important changes; the short version of the test (Bedside record form), a new task (Supplemental writing and reading), and new test items. In addition, the WAB-R underwent broader standardization, further improving the aphasia classification and severity metrics for people with aphasia. Thus, the WAB-R now offers a more valid aphasia test. Therefore, the new information renders the WAB obsolete. Considering this advancement, the current study was undertaken to adapt the WAB-R and validate the adaptation for Bangla speakers with aphasia.
Aims and objectives
This study aims to (a) complete a sociocultural and linguistic adaptation of the WAB-R into Bangla and (b) validate the newly adapted Bangla WAB-R using normal controls and patients with a history of CVA or brain injury.
| Methods|| |
This is a descriptive study reporting on the adaptation and preliminary validation of the WAB-R for Bangla speakers. The study was approved by the Institutional Ethical Review Board and all the participants received informed consent prior to study participation. This study was divided into two phases:
- Sociolinguistic adaptation of the assessment in Bangla considering all the cultural and linguistic differences between the target language and the source language
- Providing the adapted test to the normal controls and the patients with a history of CVA or brain injury to complete the validation process.
Sociolinguistic adaptation of Western Aphasia Battery-Revised in Bangla
There are many aphasia assessments in English available to SLPs. Commonly used assessments including the Boston Diagnostic Aphasia Examination, WAB-R, and Comprehensive Aphasia Test  differ greatly in their theoretical foundations, length, composition, and choice of tasks used to make a differential diagnosis. However, they all three allow clinicians to make valid and reliable diagnoses of the presence and severity of aphasia which should guide treatment decisions. Moreover, they may help demonstrate therapeutic outcomes by comparing changes in test scores from pre- to post-treatment. In this study, the authors had three key reasons for adapting the WAB-R in Bangla. First, the WAB/WAB-R was already the most adapted test in Indian languages.,,, Second, it takes only 45–60 min to administer, making it less burdensome for both the clinician and person with aphasia than other existing aphasia assessments. Third, the WAB-R defines the aphasia syndromes or types which may provide clinicians with treatment direction and provide researchers with metrics to study aphasia in Bangla speakers.
Investigators used the following steps to adapt the WAB-R into Bangla: first, the investigators used the translation and back-translation method introduced by Brislin. Three professional translators translated the English test into Bangla. These translators were native Bangla speakers with advanced degrees in linguistics and English. Due to time and financial constraints, the same translators completed the back-translation process 3 weeks after the initial translation to minimize the learning effect of the translators. After the back-translation process was completed, the English-translated versions of WAB-R were compared with the actual WAB-R. This comparison was necessary to investigate the linguistic and sociocultural incongruities between English and Bangla that led to the identified differences between the original English WAB-R and back-translated English WAB-R. After identifying the differences, the back-translated English WAB-R was adapted in Bangla. Translators met and discussed differences in translations of items. After reconsidering the cultural and linguistic analysis of those particular test items, the translators arrived at a consensus and accepted the more suitable and conventional forms for the Bangla WAB-R. For example, the English word “doctor” has two synonymous variations in Bangla. Some people have borrowed the English word but pronounce it differently as (ɖaktt̪aɾ), while others use the actual Bangla word (cɪkɪt̪∫ɔk). Both of these words were found in the translated Bangla WAB. After discussion, the translators decided to keep the word (ɖaktt̪aɾ) which is used more frequently by the majority of the population. A similar problem arose with the word “you” as this pronoun has different Bangla synonyms. The speaker chooses the proper form to use based on his/her relationship with the listener. Therefore, the translators decided to use two of the three synonyms, one is used for a familiar person (tt̪umɪ) and the other is the more formal version used for someone unknown, aged, or respectable (apnɪ). They decided to exclude the informal version (tt̪uɪ) from the test as the clinicians and the patients will share a formal relationship between them.
Translators adapted the entire WAB-R in Bangla including: (1) Record Form part 1, (2) Record Form part 2, and (3) Bedside record form, using the process described in the preceding paragraph. Three categories of change were identified.
- Direct translation: English test items were translated into Bangla, retaining the semantic concepts and linguistic structure of the actual test
- Direct translation replacing concepts: Semantic concepts were replaced while maintaining the linguistic structure of the actual test items
- Introduction of new words or phrases: Both the semantic concepts and linguistic structures were replaced with new phrases and words.
Based on the three adaptation processes, the investigators then analyzed the WAB-R subsections to determine what types of adaptation processes were most utilized. There were seven subsections which required two different types (direct translation replacing concepts and introduction of new words or phrases) of adaptation. [Appendix 1]a and [Appendix 1]b provide detailed information about the types of adaptation for each subsection and the types of changes (cultural/linguistic).
Bangla Western Aphasia Battery-Revised validation
Neurologically normal control group
The Bangla WAB-R was first administered on 27 neurologically typical adult native Bangla speakers who could fluently read and write Bangla. Participants were recruited through a convenience sampling method or word-of-mouth communication. They were included in the study based on self-report of no known impairments in cognition, language, vision, and hearing. All the participants were right handed and lived in Kolkata and nearby. They ranged in age from 40 to 75 years, with at least 10 years of formal education in Bangla medium schools. They belonged to the middle socioeconomic class. The data were collected from the following sites: (a) the participant's home, or, (b) a quiet spot chosen by the participant. The test was administered individually by the primary investigator. Participants completed the test (Record Form part 1 and part 2) within 1 h and Bedside record form within 10 min.
Cerebrovascular accident group
After administering the newly adapted Bangla WAB-R to normal controls, the test was administered to 36 individuals with doctor-reported CVAs. Participants were recruited from three renowned hospitals in Kolkata. The age range of the participants was 25–83 years, with minimum 7 years of formal education. All the participants were right handed and native speakers of Bangla with the ability to fluently read and write Bangla. However, some of them lost their motoric writing ability due to right hemiparesis. CVA onset for all participants ranged from 7 days to 1 year. The primary investigator administered the complete test to twenty patients, mostly to the follow-up cases and two newly admitted cases with mild stroke who were medically stable, and the Bedside record form to 16 newly admitted stroke patients. Sixteen participants were unable to complete Record form part 2 and six participants were unable to complete the last three subtests of Bedside record form due to their deficits in reading, writing, and apraxia. Thus, investigators were unable to calculate the Cortical Quotient and Language Quotient and could not validate the Record form part 2 and the complete Bedside record form.
| Results|| |
Bangla Western Aphasia Battery-Revised sociolinguistic adaptation
After the adaptation process, the data were entered into Microsoft Office Excel 2013. The number of each type of adaptation for Record form part 1 and part 2 was plotted in two bar graphs.
The results illustrated in [Figure 1] and [Figure 2] represent the amount of sociolinguistic change translators provided to make it more acceptable for Bangla. In Record form part 1, 75% was directly translated from English into Bangla and the other 25% was changed as per the sociolinguistic requirements. Within that 25%, 20% comprised introduction of new words or phrases and 5% required direct translation with replacing concepts. Thus, Record form part 1, which measures comprehension and verbal production of language (i.e., the aphasia quotient [AQ]), only required 25% of sociolinguistic changes. However, Record form part 2, which measures reading and writing modalities, required higher percentages of sociolinguistic adaptation because reading and writing are more complex than listening and speaking., In this section, 43% was directly translated to Bangla whereas 57% required change as per the sociolinguistic requirements. Within that 57%, 5% required direct translation with concept replacement while the other 52% required the introduction of new words or phrases [Figure 1] and [Figure 2].
Bangla Western Aphasia Battery-Revised validation
Investigators have tested two types of the validation process. Those are content validity and construct validity. Internal consistency was also tested to validate the fact that the subsections of the test have high intercorrelation. The content validity was addressed by involving three professional translators who conducted the careful translation and back-translation process to achieve the final version of the translated WAB-R. Considering the steps followed by the translators and investigators to develop the Bangla test, it can be said that this measurement has a high content validity.
The second phase of the validation process was testing construct validity which was conducted by comparing the means and standard deviations (SDs) of the performance of normal controls with the aphasia group. This is a widely used technique of validation by discriminating between groups with known characteristics, i.e., average differences in the performance of known group by using statistical techniques of comparing means (t-test or ANOVA) and was used by previous researchers in test development.,, In the current study, if the instrument is functioning as it should, participants with aphasia will perform differently (lower) than those who do not have aphasia (i.e., normal controls). If mean differences on the instrument are consistent with these expectations, we conclude that this is evidence that the instrument is differentiating between the groups in expected directions and supports claims about the construct being assessed. The t-test will be used for this purpose. The data obtained from the normal participants were converted into percentages for each subtest of Bangla WAB-R and were entered into MS Excel 2013. The mean and SD for each subtest of Record form part 1 and part 2 were calculated. The similar process was followed for the Bedside record form. Later, the test was given to the patients, using the same technique to analyze the obtained data. The Statistical Package for the Social Sciences, version 24.0 was used to analyze the data further. The data of Record form part 1 and Bedside record form (excluding reading, writing, and apraxia) were included in this analysis. Due to the incomplete data of Record form part 2, reading, writing, and apraxia subtests of the Bedside record form were excluded.
After administering the Bangla WAB-R to the 27 normal controls, the primary investigator administered the Bangla WAB-R on 36 patients. The results shown in [Table 1] provide the mean and SD of the Record form part 1 scores of 20 patients and Record form part 1 and part 2 scores of 27 normal controls.
|Table 1: Mean (%) and standard deviation of Bangla Western Aphasia Battery-Revised for the normal controls (Record form part 1 and Record form part 2) and patients (Record form part 1)|
Click here to view
The results shown in [Table 2] provide the mean and SD of the Bedside record form scores of 27 normal participants and for the other 16 patients (excluding reading, writing, and apraxia scores).
|Table 2: Mean (%) and standard deviation of Bangla Western Aphasia Battery-Revised Bedside record (excluding reading, writing, and apraxia scores)|
Click here to view
The results show that significant differences exist between the mean and SD of the controls and the patients. Furthermore, the results from Independent sample t-test showed that the patients' and controls' means were significantly different from each other across the subtests (P < 0.001). [Table 3] and [Table 4] provide the t-test scores and significant values and degrees of freedom (df) for Record form part 1 and Bedside record form, respectively. Thus, it signifies that Bangla WAB-R was successful to discriminate between the healthy individuals and patients with aphasia.
|Table 3: “Independent sample t-test” scores between patients' mean and controls' mean for Record form part 1|
Click here to view
|Table 4: “Independent sample t-test” scores between patients' mean and controls' mean for Bedside record form|
Click here to view
Based on the primary language skills, the Bangla WAB-R effectively calculated the AQ and also differentiated the patients as per their types of aphasia. [Table 5] shows the AQ scores and the types of aphasia of 20 patients who participated in the test (Record form part 1). [Table 6] provides the bedside aphasia score and the aphasia types of other 16 patients. Thus, the evidence shows that the Bangla WAB-R can help to calculate the AQ and bedside aphasia score. It also differentiates the types of aphasia.
Finally, the internal consistency of the test's subsections was tested based on the Pearson's product–moment correlation coefficient. The reliability of the aphasia group's test scores was verified using the Cronbach's alpha because this group had variability in their test scores. The Cronbach's alpha value was 0.814 for the Record form part 1 and 0.991 for Bedside record form. Both the Cronbach's values signify that the patients' scores are highly reliable or homogeneous. However, the reliability scores of Record form part 1 are less than that of Bedside record form. [Table 7] shows the Cronbach's alpha item-deleted values of Record form part 1 which indicates that naming and word finding subtest has the lowest item-deleted score. This score stands for the reliability score of Record form part 1 if the naming and word finding subtest is deleted from the test. Thus, this subtest has the highest reliability within all the subtests. To find the internal consistency of the test scores, two correlation matrices were produced based on the scores of Record form part 1 and Bedside record form. The correlation matrix of Record form part 1 [Table 8] identified the correlation between the different subtest scores and the correlation between the different subtest scores with AQ. The correlations between Record form part 1 subtests with AQ are above 0.75, and they are all statistically significant with the significant value <0.01. In addition, the correlations between the Record form part 1 subtest scores are above 0.60 with the significant value <0.01 which signifies that the correlations are statistically significant. [Table 8] includes the details of separate correlation values for each combination. The same correlation matrix was produced for Bedside record form to identify the correlation between the different subtest scores and between the bedside aphasia scores with different subtest scores (excluding reading, writing, and apraxia scores). [Table 9] reports that there is a high correlation between the subtest scores, which is above 0.90 with the significant value <0.001. Furthermore, the correlations of bedside aphasia scores with the different subtest scores are also above 0.90 with the significant value <0.001, which means that the correlations are statistically significant. [Table 9] includes the correlation details of Bedside aphasia form.
| Discussions|| |
This study aimed to conduct a sociocultural and linguistic adaptation of the WAB-R for Bangla speakers and to validate that adaptation. The actual WAB-R was developed in English, a typologically different language than Bangla; therefore, some linguistic adaptations were expected. Three professional translators used the translation and back-translation method introduced by Brislin (1970) to adapt the English WAB-R to Bangla. Our results indicated that numerous changes were needed to make the WAB-R culturally and linguistically acceptable in Bangla. The results of this study suggest that if clinicians perform spontaneous translations of WAB-R, then 25% of items in Record form part 1 and 57% in Record form part 2 may result in misleading aphasia diagnoses. These results have serious implications for researchers and clinicians interested in adapting tests to different languages and cultures.
The results of testing the construct validity showed that normal participants achieved full points in most of the subtests, which implies that this test was easy to perform for them. However, there was minor deterioration observed in certain subtest scores (repetition task, word fluency task, reading, and writing). Age may be considered as one of the responsible factors of this minor deterioration. However, considering the age range of the sample size, lack of attention, the complexity of or unfamiliarity with a particular task, or fatigue could have accounted for this deterioration. Due to the small sample size of the normal control group, the previous findings/considerations need to be further investigated based on a bigger sample size with a diverse age range. The other groups, adapted WAB in different languages, had the similar findings.,,, However, they explained this change by considering the age range of their sample and stated that auditory selective attention abilities decrease with increasing age. Furthermore, the greatest decline was observed in the constructional, visuospatial, and calculation tasks with normal elderly participants. The previous studies supported the current findings., According to Harada, Natelson Love, and Triebel (2013), there is a substantial decline in human cognitive functions with normal aging. However, the linguistic abilities remain intact.
The results of the patients' test scores were significantly lower than the test scores of normal participants. The mean and SD between the normal controls and patients' group were significantly dissimilar across all the subtests of Record form part 1 and Bedside record form. This finding was also supported by the previous findings.,, The patients' range of SD was between 25 and 35 for Record form part 1 and 35–45 for Bedside record form (excluding reading, writing, and apraxia scores).
The results to test the internal consistency of the Bangla aphasia assessment showed that the test is consistent with its expectation and correlation values are large. The large correlation values signify that all the subtests in Record form part 1 have a strong positive linear relationship between each other and between the AQ and different subtest scores. This means that the participants' performance was consistent. However, due to the difficulty level of some “repetition” subtest items, there is a moderate positive linear relationship between the spontaneous speech scores and repetition scores with the Pearson's R value of 0.614; auditory verbal comprehension scores and repetition scores with the Pearson's R value of 0.609. In Bedside record form, all the Pearson's R values (above 0.90) signify that there is a presence of a strong positive linear relationship between different subtests and between the subtests and bedside aphasia scores.
The results of the present study indicate that Bangla WAB-R demonstrated preliminary validity to be used in the diagnosis of severity and type of aphasia. Given that there are few alternatives at this time, clinicians might consider using the Bangla WAB-R to evaluate stroke patients suspected of having aphasia.
The “picture description” of Bangla WAB-R included the same picnic picture used in the English WAB-R. Investigators did not change the picnic scenario to a culturally suitable one due to the researcher's time and financial constraints. Review of the validation results reflects that the WAB-R picnic picture in and of itself was not problematic for the participants. However, an experimental question remains about whether a “better” picture could elicit stronger language samples. This question will be addressed in future research. Finally, as compared to the existing validation studies of the WAB in other languages,,,, the sample size of the present study is relatively smaller because the entire study was conducted to accomplish the Master's thesis with a 3-month time frame to collect the data.
The researchers of this study plan to conduct the validation study using a larger sample size in the future. After completion of this project, Bangla WAB-R will be standardized for Bangla speakers.
| Conclusion|| |
Previously, researchers reported on the adaptation and validation of WAB in Bangla. However, they adapted the older version of WAB which is obsolete after the introduction of the WAB-R. The current study adapted the WAB-R in Bangla and conducted a preliminary validation study. Results indicated that the Bangla WAB-R successfully distinguished between controls and patients with aphasia. However, more research is needed for further validation and standardization of the Bangla WAB-R for clinicians and researchers.
Financial support and sponsorship
This study was financially supported by the University Grant Commission.
Conflicts of interest
There are no conflicts of interest.
| References|| |
Engelter ST, Gostynski M, Papa S, Frei M, Born C, Ajdacic-Gross V, et al.
Epidemiology of aphasia attributable to first ischemic stroke: Incidence, severity, fluency, etiology, and thrombolysis. Stroke 2006;37:1379-84.
Chapey R. Language Intervention Strategies in Aphasia and Related Neurogenic Communication Disorders. 5th
ed. Philadelphia: Wolters Kluwer Health/Lippincott Williams & Wilkins; 2008.
Banerjee TK, Das SK. Epidemiology of stroke in India. Neurol Asia 2006;11:1-4.
Noack R, Gamio L. The World's Languages, in 7 Maps and Charts. The Washington Post; 23 April, 2015.
Ivanova MV, Hallowell B. A tutorial on aphasia test development in any language: Key substantive and psychometric considerations. Aphasiology 2013;27:891-920.
Malda M, Fons JR, Vijver VD, Srinivasan K, Transler C, Sukumar P, et al
. Adapting a cognitive test for a different culture: An illustration of qualitative procedures. Psychol Sci Q 2008;50:451-68.
Chengappa SK, Kumar R. Normative and clinical data on the Kannada version of Western Aphasia Battery (WAB-K). Lang India 2008;8:1-15.
Jenny EP. A Test of Aphasia in Malayalam. Mysore (India): University of Mysore; 1992.
Pallavi M. Development of Western Aphasia Battery in Telugu. Mysore (India): University of Mysore; 2010.
Pauranik A. Speech and communication disorders in stroke: Beyond the routine. Prog Clin Neurosci 2007;22:36-53.
Kertesz A. Western Aphasia Battery. 1st
ed. New York: Grune and Stratton; 1982.
Keshree NK, Kumar S, Basu S, Chakrabarty M, Kishore T. Adaptation of the Western aphasia test battery in Bangla. Psychol Lang Commun 2013;17:189-201.
Kertesz A, Raven JC. WAB-R: Western Aphasia Battery-Revised. 2nd
ed. San Antonio: The PsychCorp; 2007.
Goodglass H, Kaplan E, Barresi B. Boston Diagnostic Aphasia Examination. 3rd
ed. Philadelphia: Lea & Febiger; 2000.
Swinburn K, Porter G, Howard D. Comprehensive Aphasia Test. 1st
ed. UK: Psychology Press, Routledge; 2005.
Brislin RW. Back-translation for cross-cultural research. J Cross Cult Psychol 1970;1:185-216.
Hogan T, Bridges M, Justice L, Cain K. Increasing higher level language skills to improve reading comprehension. Focus Except Child 2011;44:1-20.
Rapp B, Fischer-Baum S, Miozzo M. Modality and morphology: What we write may not be what we say. Psychol Sci 2015;26:892-902.
Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull 1955;52:281-302.
Hogan HW. Test of the validity of the Wilson-Patterson conservatism scale. Percept Mot Skills 1975;40:795-801.
Hattie J, Cooksey RW. Procedures for assessing the validities of tests using the 'known-groups' method. Appl Psychol Meas 1984;8:295-305.
Barr RA, Giambra LM. Age-related decrement in auditory selective attention. Psychol Aging 1990;5:597-9.
Harada CN, Natelson Love MC, Triebel KL. Normal cognitive aging. Clin Geriatr Med 2013;29:737-52.
[Figure 1], [Figure 2]
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5], [Table 6], [Table 7], [Table 8], [Table 9]