Context: Young people expose themselves to high noise levels during leisure activities, and might thus be at risk of acquiring hearing-related problems. Therefore, information regarding risk-taking behavior is necessary to prevent future hearing problems and to optimize future preventive campaigns. Aim: This study evaluated the test–retest reliability of the Youth Attitude to Noise Scale (YANS) and beliefs about hearing protection and hearing loss (BAHPHL) instrument. Settings and Design: Forty-three young adults between 18 and 29 years filled in a questionnaire at two test moments. Materials and Methods: The YANS and BAHPHL instrument were used to evaluate the attitudes toward noise, hearing loss, and hearing protection. Each participant completed the retest within 21–55 days after the first administration of the questionnaire. Results: Paired Student’s t-tests showed no significant differences in mean scores between test and retest for both the entire YANS and BAHPHL instrument as well as their factors. Furthermore, a good agreement between test and retest scores was seen by Bland–Altman analyses. Intraclass correlation coefficients were above 0.70 for the entire YANS and the factor related to youth culture as well as for the entire BAHPHL and all the factors of the BAHPHL instrument, except for the factor related to the severity of the consequences of hearing loss. Conclusion: Reliable test–retest measurements of the YANS and BAHPHL instrument can be performed. Hence, these questionnaires can be used in longitudinal studies to explore young adults’ changes in attitudes toward noise, hearing loss, and hearing protection, with or without an educational intervention.
Keywords: Attitudes, leisure noise exposure, reliability, young adults
|How to cite this article:|
Degeest S, Maes L, Leyssens L, Keppler H. The test–retest reliability of questionnaires regarding attitudes and beliefs toward noise, hearing loss, and hearing protector devices in young adults. Noise Health 2018;20:31-6
|How to cite this URL:|
Degeest S, Maes L, Leyssens L, Keppler H. The test–retest reliability of questionnaires regarding attitudes and beliefs toward noise, hearing loss, and hearing protector devices in young adults. Noise Health [serial online] 2018 [cited 2018 May 21];20:31-6. Available from: http://www.noiseandhealth.org/text.asp?2018/20/93/31/230367
| Introduction|| |
In scientific literature and widespread media, there is a concern regarding the effects of leisure noise exposure on the auditory system of young adults. Youngsters voluntarily participate at various leisure activities such as music venues, and many of them also use personal music players.,,, Regular exposure to high noise levels during leisure activities can lead to hearing loss and/or the development of hearing-related symptoms such as tinnitus. Results regarding the prevalence of hearing loss in young people are, however, inconclusive.,,, Moreover, Carter et al. recently stated that there is insufficient evidence for the widespread or increasing prevalence of hearing loss in young populations due to leisure noise. Nevertheless, in an epidemiologic study in young adults between 18 and 30 years in Flanders, that is, the Dutch-speaking part of Belgium, chronic tinnitus due to leisure noise exposure in at least one ear was present in 6.4% of the participants. In addition to these prevalence studies, cross-sectional studies aim at evaluating the association between leisure noise exposure and hearing-related symptoms. A recent systematic review suggested an association between music and hearing loss, although the evidence is not uniform. In the previously mentioned epidemiologic study, participants with a higher lifetime noise level for nightclubs and music venues were significantly more likely to experience chronic tinnitus. However, an individual’s risk-taking behavior must also be taken into account, because it was found that young people’s attitudes and beliefs regarding noise, hearing loss, and hearing protector devices (HPDs) had a significant impact on their hearing status, as well as on the use of HPDs. Furthermore, hearing conservation programs usually provide information regarding the effects of hearing loss, thus increasing the awareness of the risk of excessive noise exposure and knowledge concerning the availability and use of HPDs, which might lead to behavioral changes.
In contrast to cross-sectional studies, longitudinal studies in young adults are limited but indicate that there are changes in leisure noise exposure during lifetime and that there is a deterioration of hearing over time.,, In addition to the investigation of the age of onset and the progression of hearing-related problems, evaluating an individual’s risk-taking behavior would make it possible to evaluate possible changes in attitudes and behavior regarding leisure noise exposure.
To evaluate an individual’s risk-taking behavior, several theoretical frameworks can be used, such as the theory of planned behavior (TPB) and the health belief model (HBM). Widen specifically developed a theoretical framework to explain young people’s attitudes and behaviors toward leisure noise exposure by combining all the factors from the TPB, that is, attitudes, subjective norms, and perceived behavioral control, with the perceived benefits and barriers to modify the behavior and triggers to action from the HBM. Within this framework, attitudes can be described as the tendency to respond positively or negatively toward a certain phenomenon, whereas subjective norms refer to the perceived social pressure to engage or not engage in a particular behavior (e.g., wearing HPDs). Perceived behavioral control deals with an individual’s perception about the ease or difficulty of undertaking a specific behavior. Finally, risk-taking behavior can be transformed into health-oriented behavior depending on the perceived benefits and barriers of performing the behavior. In addition to these factors of the TPB and the HBM, Widen added a risk perception factor to his theoretical framework, which referred to an individual’s awareness of the risks of noise exposure.
Attitudes can be evaluated through the Youth Attitude to Noise Scale (YANS). This questionnaire was first developed in Swedish by Widen and Erlandsson, and was translated in other languages.,, Furthermore, an instrument questioning the beliefs about hearing protection and hearing loss (BAHPHL) focusing on leisure noise exposure in young adults can be used to evaluate the items regarding the subjective norms, perceived behavioral control, perceived benefits and barriers to modify the behavior, and risk perception. The internal consistency of the Dutch versions of the YANS and BAHPHL instrument was investigated previously., However, the test–retest reliability of both adapted instruments is unknown. Knowledge regarding the reliability of these instruments would be valuable in longitudinal studies to explore young adults’ changes in attitudes toward noise, hearing loss, and HPDs with or without an educational intervention.
The aim of the current study is, therefore, to evaluate the test–retest reliability of the Dutch versions of the YANS and BAHPHL instrument regarding the attitudes and beliefs toward noise, hearing loss, and HPDs.
| Materials and Methods|| |
The Dutch version of the YANS consists of 19 items that are categorized into the following four factors: attitudes toward noise associated with the elements of youth culture (factor 1: eight items), the ability to concentrate in noisy environments (factor 2: three items), daily noises (factor 3: four items), and intent to influence the sound environment (factor 4: four items). All items were scored on a five-degree Likert scale ranging from “totally disagree” to “totally agree.” The answers on the YANS were coded from one to five, whereby a higher score indicated a more positive attitude, representing an attitude where noise is seen as unproblematic.
The Dutch version of the BAHPHL questionnaire contained 24 items. These items were categorized into the following seven factors: susceptibility to hearing loss (factor 1: six items), the severity of the consequences of hearing loss (factor 2: three items), the benefits of preventive action (factor 3: three items), barriers to preventive action (factor 4: four items), behavioral intentions (factor 5: three items), social norms (factor 6: two items), and self-efficacy (factor 7: three items). Consistent with the YANS, a five-degree Likert scale was used, and the answers were coded from one to five. The higher the score on the BAHPHL instrument, the more positive the attitudes, meaning that one does not care about the possible consequences of hearing loss and is unaware regarding the benefits of wearing HPDs.
Besides the YANS and BAHPHL instrument, demographic information, subjective hearing status, the presence of tinnitus, and the use of HPDs during leisure noise activities were questioned.
An electronic version of the questionnaire was completed by the same respondents at two test moments. The two test moments were planned to take place within 8 weeks to minimize the chance of contact with any educational hearing program or the emergence of hearing-related symptoms that might influence the results. On average, the time between both tests was 36.8 days [standard deviation (SD) 6.70] with a range between 21 and 55 days.
Young adults between 18 and 30 years were recruited in Flanders. Individuals were invited to participate in the study by distributing an invitation letter through email or online (school) platforms. On the basis of the invitation letter, individuals contacted the researchers and were then offered the ability to complete the questionnaire online. Forty-three respondents, of which were 30 females and 13 males, voluntarily participated in the study. Their age at the first test moment was on average 24.56 years (SD 2.98, range 18–29 years). At both test moments, 20 respondents (46.5%) were students, and the remaining 23 respondents (53.5%) were a part of the working population.
The study was approved by the local ethical committee, and all participants agreed with the informed consent in accordance with the ethical standards of the Declaration of Helsinki for research involving human participants.
Statistical analysis was performed using the Statistical Package for the Social Sciences version 23.0 software (IBM Corp., New York, USA).
Descriptive parameters were established for the questionnaire outcomes. Furthermore, Pearson correlation coefficients were calculated to examine possible correlations between the test–retest interval (in days) and the differences in the scores between test A and test B for the entire YANS and BAHPHL instrument as well as their factors.
To determine the test–retest reliability of the YANS and BAHPHL instrument, several statistical measures were applied. First, paired Student’s t-tests were executed to evaluate differences between the entire scores as well as scores on the factors of both the YANS and BAHPHL instrument at test and retest. Furthermore, Bland–Altman analysis was performed to determine the degree of agreement between the entire score on the YANS and BAHPHL instrument at both test moments. Second, a two-way random single measures intraclass correlation coefficient (ICC) was used to determine the consistency of the position of individual scores relative to others between both test moments for the entire scores on the YANS and BAHPHL instrument as well as their factors. Third, the standard error of measurement (SEM) was determined to evaluate the reliability within repeated measures in one participant. Specifically, the SEM was calculated as SEM = s√(1−ICC), where “s” represented the SD of all measurements. Finally, the SEM was used to calculate the minimum detectable difference (MDD). The MDD can be defined as the difference between the means of the YANS and BAHPHL scores at test and retest, which must exist to conclude that there is a significant effect. To indicate the 95% confidence interval to detect a real difference between the scores, the equation 1.96√2SEM was used.
For all statistical analyses, a significance level of P < 0.05 was used.
| Results|| |
The majority of the respondents (95.4%) indicated that they had good or very good hearing at both test moments, while 4.6% of the respondents evaluated their hearing as “not that good.” With regard to the presence of tinnitus due to leisure activities, 32 participants (74.4%) experienced temporary tinnitus, while six respondents (14.0%) reported to have chronic tinnitus. Five respondents (11.6%) had never experienced tinnitus after exposure to leisure noise. These results were the same at both test moments. Thirty-seven respondents (86.0%) indicated on both test moments to have used HPDs at least once.
The descriptive values of the scores on the factors of the YANS and BAHPHL instrument are reflected in [Table 1]. At both test moments, the highest mean score for the YANS was found for the factor related to daily noise (factor 3), whereas the lowest mean score for the YANS was the factor related to the intent to influence the sound environment (factor 4). For the BAHPHL instrument, the highest and lowest mean scores at both test moments were seen, respectively, for the factors social norms (factor 6) and the severity of the consequences of hearing loss (factor 2).
|Table 1: For the YANS and BAHPHL instrument, the mean, standard deviation (SD), and the range of scores are reflected for test and retest (n = 43)|
Click here to view
Comparing the scores on the YANS at test and retest resulted in a mean difference of 0.001 for the entire YANS score and mean differences ranging between −0.17 and 0.09 for the factors of the YANS. For the entire BAHPHL score, the mean difference was −0.002 between test and retest, whereas the mean differences of the scores for the factors of the BAHPHL instrument were mostly negative, ranging between −0.03 and 0.14. No significant correlation was found between the test–retest interval and the differences in the entire scores of the YANS and BAHPHL instrument as well as their factors (Pearson correlation, P > 0.05).
Paired Student’s t-tests showed no significant differences in mean scores between test and retest for both the entire YANS and BAHPHL instrument as well as their factors (P > 0.05) [Table 2]. Furthermore, the Bland–Altman analysis for the entire YANS and BAHPHL instrument is depicted in [Figure 1].
|Table 2: The mean and standard deviation (SD) of the paired differences between test and retest, 95% confidence interval (CI), and the results from the paired samples t-test are given for the entire YANS and BAHPHL scores as well as their factors (n = 43)|
Click here to view
|Figure 1: Bland and Altman plot for the entire score on the YANS (A) and the BAHPHL (B) with the black line representing the mean score, and the gray dotted lines the limit of agreement (95% confidence interval)|
Click here to view
In [Table 3], the ICCs, SEMs, and MDDs are reflected. For all factors of the YANS and BAHPHL instrument, ICCs with highly significant between-subjects variability were obtained (P < 0.001). ICCs were above 0.70 for the factor of the YANS related to youth culture (factor 1) and the entire YANS. For the remaining factors of the YANS, the ICCs were between 0.50 and 0.70. Regarding the BAHPHL, ICCs were above 0.70 for the entire BAHPHL and all factors of the BAHPHL instrument, except for the factor related to the severity of the consequences of hearing loss (factor 2). The latter factor had an ICC of 0.36 between test and retest.
|Table 3: ICCs, SEMs, and MDDs for the entire scores and the scores of the factors of the YANS and BAHPHL instrument between test and retest are presented (n = 43)|
Click here to view
| Discussion|| |
Questionnaires, such as the YANS and the BAHPHL instrument, are frequently used in cross-sectional studies to evaluate an individual’s risk-taking behavior regarding leisure noise exposure. The highest mean scores on the YANS and BAHPHL instrument found in the current study were related to daily noise and social norms, respectively, which confirms the results of previous studies.,,,, This indicates that young adults have more problematic positive attitudes toward daily noise and social norms. In addition, consistent with previous findings,, the lowest mean scores on the YANS and BAHPHL instrument were found for the YANS factor related to the intent to influence the sound environment and BAHPHL factor regarding the severity of the consequences of hearing loss. This indicates that young adults tend to do something to make the environment quieter, and that they are more aware of the consequences of hearing loss. Nevertheless, sociodemographic factors such as age, gender, and socioeconomic status, as well as cultural differences, might influence the scores on the questionnaire.,
To evaluate a change in an individual’s risk-taking behavior in longitudinal studies, knowledge regarding the test–retest reliability of the used questionnaires is necessary. The Brazilian Portuguese version of the YANS was retested in 50 high-school students within 30–90 days. In 85 students, a Chinese adapted version of the YANS was retested after 45 days. In both studies, nonsignificant mean differences of the entire YANS score between the test and retest of 0.000 and 0.002 were found. In the current study, the mean difference of the entire YANS score was 0.001, and the Bland–Altman test showed good agreement between scores on test and retest, which is consistent with these previous studies., However, the test–retest reliability of the BAHPHL instrument and its factors as well as regarding the test–retest reliability of the different factors of the YANS is unknown. Regarding the BAHPHL instrument, this study found a mean difference of the entire BAHPHL score of −0.002 as well as a good agreement between the scores at both test moments based on the Bland–Altman test. Moreover, the factors of the YANS and BAHPHL instrument also showed good agreement between test and retest, with mean differences in the scores between both test moments ranging between −0.17 and 0.09, and between −0.03 and 0.14, respectively. Furthermore, highly significant ICCs between the entire YANS and BAHPHL scores as well as the scores on the factors of the YANS and BAHPHL instrument were found, with the exception of the BAHPHL factor related to the severity of the consequences of hearing loss. Although there is no consensus regarding a value for a good ICC due to the used version and the variability of that data, the homogenous distribution of the scores could explain the lower ICC on this BAHPHL factor. However, the between-subjects variability reached significance, thereby not compromising the validity of the ICC. In addition to the ICCs, this study also calculated the SEM and MDD for both the entire YANS and BAHPHL scores and their factors. Using the MDD enables the detection of a significant change in the scores on these questionnaires. For example, if a second measurement exceeds the MDD for one or more factors of the YANS or BAHPHL, the observed difference is probably due to a real or genuine difference.
This study evaluated the short-term test–retest reliability of the YANS and the BAHPHL instrument to explore young adults’ changes in attitudes toward noise, hearing loss, and HPDs. Such short-term analysis might have led to a possible recall of the answers by our respondents. Nevertheless, the test–retest interval in this study ranged between 21 and 55 days, which made it possible to evaluate the effect of the time interval on the scores of the YANS and BAHPHL instrument. If, for example, a recall of the answer was present, one could expect that the difference in the scores between both tests would be smaller for shorter time intervals. However, no significant correlation was found between the test–retest interval and the difference in the scores between both tests for the entire YANS and BAHPHL instrument as well as their factors. Future research including test–retest reliability over a longer period of time (e.g., months or years) would be interesting to explore the reliability of both the YANS and BAHPHL in the long term. Furthermore, such longitudinal research would make it possible to also investigate the influencing factors of test–retest reliability (e.g., gender, age, cultural differences, and so on). Nevertheless, the sample used in this study was a representative subset of the population of young adults based on their sociodemographic variables, and mean scores on both instruments were consistent with previous findings.
In conclusion, this study indicates that the Dutch versions of the YANS and BAHPHL instrument have a high test–retest reliability. Hence, these questionnaires can be used in longitudinal studies to explore young adults’ changes in attitudes toward noise, hearing loss, and hearing protection, with or without an educational intervention.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Keppler H, Dhooge I, Vinck BM. Hearing in young adults. Part II: The effects of recreational noise exposure. Noise Health 2015;17:245-52.
] [Full text]
Jokitulppo JS, Bjork EA. Estimated leisure-time noise exposure and hearing symptoms in a finnish urban adult population. Noise Health 2002;5:53-62.
] [Full text]
Serra MR, Biassoni EC, Richter U, Minoldo G, Franco G, Abraham S et al.
Recreational noise exposure and its effects on the hearing of adolescents. Part I: An interdisciplinary long-term study. Int J Audiol 2005;44:65-73.
Beach EF, Williams W, Gilliver M. Estimating young Australian adults’ risk of hearing damage from selected leisure activities. Ear Hear 2013;34:75-82.
Holmes AE, Niskar AS, Kieszak SM, Rubin C, Brody DJ. Mean and median hearing thresholds among children 6 to 19 years of age: The Third National Health and Nutrition Examination Survey, 1988 to 1994, United States. Ear Hear 2004;25:397-402.
Rabinowitz PM, Slade MD, Galusha D, Dixon-Ernst C, Cullen MR. Trends in the prevalence of hearing loss among young adults entering an industrial workforce1985 to 2004. Ear Hear 2006;27:369-75.
Shargorodsky J, Curhan SG, Curhan GC, Eavey RD. Change in prevalence of hearing loss in US adolescents. JAMA 2010;304:772-8.
Henderson E, Testa MA, Hartnick C. Prevalence of noise-induced hearing-threshold shifts and hearing loss among US youths. Pediatrics 2011;127:e39-46.
Carter L, Williams W, Black D, Bundy A. The leisure-noise dilemma: Hearing loss or hearsay? What does the literature tell us? Ear Hear 2014;35:491-505.
Degeest S, Keppler H, Corthals P, Clays E. Epidemiology and risk factors for tinnitus after leisure noise exposure in Flemish young adults. Int J Audiol 2017;56:121-9.
le Clercq CM, van Ingen G, Ruytjens L, van der Schroeff MP. Music-induced hearing loss in children, adolescents, and young adults: A systematic review and meta-analysis. Otol Neurotol 2016;37:1208-16.
Keppler H, Dhooge I, Vinck BM. Hearing in young adults. Part I: The effects of attitudes and beliefs towards noise, hearing loss and hearing protector devices. Noise Health 2015;17:237-44.
] [Full text]
Peters RJ. The role of hearing protectors in leisure noise. Noise Health 2003;5:47-55.
] [Full text]
Biassoni EC, Serra MR, Richter U, Joekes S, Yacci MR, Carignani JA et al.
Recreational noise exposure and its effects on the hearing of adolescents. Part II: Development of hearing disorders. Int J Audiol 2005;44:74-85.
Biassoni EC, Serra MR, Hinalaf M, Abraham M, Pavlik M, Villalobo JP et al.
Hearing and loud music exposure in a group of adolescents at the ages of 14–15 and retested at 17–18. Noise Health 2014;16:331-41.
] [Full text]
Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process 1991;50:179-211.
Rosenstock IM. The health belief model and preventive health behavior. Health Educ Behav 1974;2:354-86.
Widen SE. A suggested model for decision-making regarding hearing conservation: Towards a systems theory approach. Int J Audiol 2013;52:57-64.
Widen SE, Erlandsson SI. Self-reported tinnitus and noise sensitivity among adolescents in Sweden. Noise Health 2004;7:29-40.
Widen SE, Holmes AE, Erlandsson SI. Reported hearing protection use in young adults from Sweden and the USA: Effects of attitude and gender. Int J Audiol 2006;45:273-80.
Zocoli AM, Morata TC, Marques JM. Youth Attitude to Noise Scale (YANS) questionnaire adaptation into Brazilian Portuguese. Braz J Otorhinolaryngol 2009;75:485-92.
Keppler H. Optimization of the Diagnosis of Noise-Induced Hearing Loss with Otoacoustic Emissions. Ghent: Ghent University; 2010.
Svensson EB, Morata TC, Nylen P, Krieg EF, Johnson AC. Beliefs and attitudes among Swedish workers regarding the risk of hearing loss. Int J Audiol 2004;43:585-93.
Gilles A, Van Hal G, De Ridder D, Wouters K, Van de Heyning P. Epidemiology of noise-induced tinnitus and the attitudes and beliefs towards noise and hearing protection in adolescents. PLoS One 2013;8:e70297.
Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med 1998;26:217-38.
Gilles A, De Ridder D, Van Hal G, Wouters K, Kleine Punte A, Van de Heyning P. Prevalence of leisure noise-induced tinnitus and the attitude toward noise in university students. Otol Neurotol 2012;33:899-906.
Degeest S, Clays E, Corthals P, Keppler H. Epidemiology and risk factors for leisure noise-induced hearing damage in Flemish young adults. Noise Health 2017;19:10-9.
] [Full text]
Widen SE, Erlandsson SI. The influence of socio-economic status on adolescent attitude to social noise and hearing protection. Noise Health 2004;7:59-70.
Zhu X, Bihi A, Hu X, Lv Y, Abbas A, Zhu X et al.
Chinese-adapted Youth Attitude to Noise Scale: Evaluation of validity and reliability. Noise Health 2014;16:218-22.
] [Full text]
Giavarina D. Understanding Bland Altman analysis. Biochem Med 2015;25:141-51.
Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res 2005;19:231-40.
C. Heymanslaan 10 (poli 1 - 2nd floor), B-9000 Ghent
Source of Support: None, Conflict of Interest: None
[Table 1], [Table 2], [Table 3]