Article Access Statistics   Viewed  4492   Printed  217   Emailed  0   PDF Downloaded  200   Comments  [Add]   Cited by others  9  




Year : 2007
 Volume
: 9  Issue : 37  Page
: 96100 

Factorial validity of the noise sensitivity questionnaire 

Martin Schutte, Stephan Sandrock, Barbara Griefahn
Institute for Occupational Physiology at the University of Dortmund, IfADo, Ardeystraße 67, D44139, Dortmund, Germany
Click here for correspondence address
and email




The Noise Sensitivity Questionnaire (NoiSeQ) aims at the measurement of global noise sensitivity as well as the sensitivity for five domains of everyday life namely 'Leisure', 'Work', 'Habitation', 'Communication' and 'Sleep'. The present investigation examined the factorial validity of the NoiSeQ to determine whether the items of the NoiSeQ cover the different factors as assumed. The analysis was done using the method of Confirmatory Factor Analysis (CFA). The linear structural model took into consideration only the scales of the NoiSeQ for which reliability could be demonstrated, namely, 'Sleep', 'Communication', 'Habitation' and 'Work'. The linear structural model presumed that each of the 28 items has a relation only to one corresponding factor. Furthermore, the model allowed for correlations between the four factors. The data base encompassed 293 persons. Parameter estimation was based on the General Least Square method. The data was checked with respect to the occurrence of multivariate outliers, deviation from multivariate normality and existing collinearities. The data met the overall requirements of a CFA. The evaluation of model fit was based on the relative χ^{2} value, the Root Mean Square Error of Approximation, the Goodness of Fit Index, the Adjusted Goodness of Fit Index and the Root Mean Square Residual. All fit indices indicated an acceptable match of the model. As the postulated structure of the NoiSeQ was consistent with the empirical data, the classification of the items as well as the claimed interdependencies between the scales can be maintained. The regression weights of all items as well as the correlations between the latent variables were statistically significant. The estimated reliability of the latent variables took values of ≥0.84. The findings generally justified the conclusion that there is no urgent need to modify the four scales of the NoiSeQ thus, indicating the factorial validity of the NoiSeQ. Keywords: Confirmatory factor analysis, factorial validity, noise sensitivity
How to cite this article: Schutte M, Sandrock S, Griefahn B. Factorial validity of the noise sensitivity questionnaire. Noise Health 2007;9:96100 
When persons are exposed to traffic noise, the predominantly occurring reaction is the experience of annoyance indicating the degree of undesirability of the particular noise. However, the same sound evokes annoyance ratings characterized by substantial interindividual differences. The individual level of noise sensitivity is considered to be one of the main causes for the large variation of annoyance data. Noise sensitivity is understood as a stable personality trait affecting the reactivity towards noise sources. According to the results of psychoacoustic studies, noise sensitivity has no relation to auditory acuity, auditory reaction time and intensity discrimination but reflects a judgmental, evaluative predisposition towards the perception of sounds.^{ [1]} Noise sensitivity thus represents a moderator variable^{ [2]} influencing the relation between noise level and annoyance.^{ [3]}
The presently available (German) questionnaires for the determination of individual noise sensitivity such as the WeinsteinScale (WNS)^{ [4]} or the "Fragebogen zur Erfassung der individuellen Lδrmempfindlichkeit (LEF)''^{ [5],[6]} focus on global noise sensitivity. Nevertheless, the analysis of the factorial structure of the LEF led to a multidimensional solution indicating that separate measurements for different areas of everyday life might be more appropriate when determining the level of noise sensitivity. Therefore, the "NoiseSensitivityQuestionnaire (NoiSeQ)" was developed for the measurement of global noise sensitivity as well as for the sensitivity concerning different domains of everyday life, namely, 'Leisure', 'Work', 'Habitation', 'Communication' and 'Sleep' where each subscale comprises seven items.
The reliability analysis was based on the GTheory. The results of the Gstudy showed that the noisesensitivity measurement is not affected by the age or gender of the respondents. Furthermore, the findings proved that a single application of the questionnaire is sufficient for the determination of individual noise sensitivity.^{ [7],[8]} If the NoiSeQ is used for determination of global noise sensitivity, the reliability (Gcoefficient) for relative and absolute measurements reaches values >0.90. According to ISO 100753, the instrument satisfies precision level 1  "accurate measurement" in this case.^{ [9]} Taking into consideration the lower limit of at least 0.70 required for orienting purposes as recommended by ISO 100753, the Gcoefficients for the subscales exceed this value with the exception of the subscale 'Leisure' which has not proved satisfactory.
The present study analyzed the factorial validity of the NoiSeQ and therefore, it sought to determine whether the items of the NoiSeQ cover the different factors ('Sleep', 'Communication' etc.) as assumed. For these purposes, a Confirmatory Factor Analysis (CFA) was undertaken. The used approach was a strictly confirmatory one because it only examined whether the pattern of variances and covariances in the data are in accordance with the specified structural model.
Method   
Structure of the linear structural model
The linear structural model took into consideration only those scales of the NoiSeQ for which reliability could be demonstrated. These were the subscales 'Sleep', 'Communication', 'Habitation' and 'Work'. Starting from the structure of the questionnaire, the linear structural model presumed that each of the 28 items has a relation only to one factor.
As empirical results concerning the situational specificity of noise sensitivity suggest that the different aspects of noise sensitivity are not completely independent from each other,^{ [5]} the model allowed for correlations between the four factors.
For this reason, the following two hypotheses formed the basis of the CFA analysis, namely, whether the four factor model with each variable loading only on one factor fits the data and whether there exist significant covariances between the four factors of noise sensitivity.
Formal aspects of the model
To get information about the determinability of the model, the number of parameters to be estimated must be calculated. As the metric of the latent variables are unknown, a constraint must be introduced. One possible way is to set the variance of each factor to 1. Such a fixation leads to a standardized solution.^{ [10]} This strategy was used because no multiple group analysis was desired. Furthermore, the errors are also latent variables and must be scaled too. In this case, it is usual to set the regression weights to 1, which permits the estimation of error variances.
Accordingly, the specified model requested estimation of 28 variances, 28 regression weights and six covariances, thus resulting in a total of 62 parameters. The empirical covariance matrix consisted of 28 variances and 378 covariances, that is to say, 406 values (28 × (28 + 1)/2). Accordingly, the model was overidentified and could be tested with 344 degrees of freedom.
CFA is based on analysis of covariances whose estimation presupposes large sample sizes whereas a relation of 10:1 between sample size and the number of variables is thought to be acceptable.^{ [11]} The sample of this study consisted of 293 persons resulting in a relation of 10 persons per variable, thus meeting the requirements.
For parameter estimation, the widelyused MaximumLikelihood (ML) method was not applied as this procedure necessitates sample sizes of >500 persons in order to get reliable results.^{ [12]} Hence, the General Least Square (GLS) approach was utilized which is more suitable if the sample size is <500. This method supplies efficient, consistent and unbiased estimators if the data follows a multivariate normal distribution.
Analysis of data distribution and outlier detection
At first for each variable, the kurtosis and skewness as well as the corresponding standard errors were calculated in order to check whether the data corresponded to a normal distribution. The ratios of kurtosis and skewness to their corresponding standard errors can be regarded as standardized scores from a normal distribution whereas absolute values exceeding 2 indicate a deviation from normality. For some of the variables, this ratio took values of >2 necessitating a normalization for all variables.^{ [13]}
The Mahalanobis distances of all test persons from the group mean were calculated in order to determine whether there were multivariate outliers. The distances were evaluated using the χ^{2} distribution with 28 degrees of freedom and p< 0.001.^{ [14]} According to this criterion, any case with a Mahalanobis distance exceeding the χ^{2} value of 56.88 would represent a multivariate outlier. The maximum of the Mahalanobis distances took a value of 46.59 due to which no outliers could be detected.
Following this step, the assumption of multivariate normality was tested. The method used is based upon the fact that the Mahalanobis distances are in accordance with the χ^{2} distribution if the empirical data correspond to multivariate normality.^{ [15],[16]} Therefore, the distances had to be sorted in ascending order and the χ^{2} values corresponding to the distances determined. The Mahalanobis distances were then plotted against the χ^{2} values. Generally, the empirical data fulfill the distribution requirements when the value pairs fall on a nearly straight line.^{ [15]} Furthermore, the KolmogorovSmirnov Test allows to test whether the peak of the empirical distance distribution conforms to the theoretically expected χ^{2} distribution.^{ [17]}
Thus, there existed close relationships between the Mahalanobis distances and the χ^{2} values [Figure  1] with the exception that in the upper part (distances > 42), the corresponding χ^{2} values showed some larger deviations from the main diagonal.
Nevertheless, 48.12% of the distances were less than the theoretical χ^{2} value for the 50^{ th} percentile (χ^{2 } = 27.34) indicating multivariate normality because the empirical gained percentage was close to the ideal value of 50%. The teststatistic D of the KolmogorovSmirnov Test took a value of 1.05 falling below the critical Dstatistic amounting to 1.07 ( p = 0.20). Therefore, the results justified the conclusion that the data correspond to a multivariate normal distribution.
Screening for multicollinearity
In principle, variables included in a CFAanalysis should neither be highly correlated nor be redundant.^{ [14]} Accordingly, the correlation matrix was tested for very high interdependencies and thus for bivariate correlations above 0.90.^{ [14]} All correlations were below this limit. The highest correlation took a value of 0.68 and appeared between the item "When people around me are noisy, I don't get on with my work" (scale 'Work'item 5) and the item "I find it very hard to follow a conversation when the radio is playing" (scale 'Communication'item 5). Additionally the squared multiple correlations (SMC) of each variable with all other variables were calculated as part of a further screening for multicollinearity [Table  1]. The highest proportion of common variance amounted to 66% (scale 'Sleep': items 3 and 4), likewise confirming that multicollinearity was not a problem.
The socalled condition number of the covariance matrix was then calculated indicating the numerical stability of the matrix. The parameter reflects the relation between the maximal and minimal Eigenvalue of the matrix taking a value of 45.62 (8.014/0.177) showing that the matrix possessed acceptable stability.^{ [18]} The data thus fulfilled the conditions precedent to the accomplishment of a CFA.
Proving the model fit
The evaluation of model fit can be based on various indices. Generally, it is recommended that different parameters be reported acting on different conceptualizations of goodness of fit.^{ [19],[20]} All coefficients should suggest the same conclusions concerning the adjustment of the model. The relative χ^{2} value (χ^{2Min} /df) reflects the discrepancy between the observed and the estimated population covariance matrix. This index should not pass over the upper limit value of 2. A value of 1.66 resulted for the existing model allowing the conclusion that the model has an acceptable fit [Table  2]. The Root Mean Square Error of Approximation (RMSEA) reflects the lack of fit in a model in relation to a perfect model. Values <0.08 point to an appropriate fit. This parameter took a value of 0.048 clearly falling below the upper limit value.
The Goodness of Fit Index (GFI) expresses the explained proportion of variance and covariance of the model. Therefore, the GFI corresponds to the determination coefficient in regression analysis. The calculated value (0.86) exceeded the lower limit value of 0.80. A value of 0.835 was obtained for the adjusted goodness of fit index (AGFI), which takes into consideration the number of the estimated model parameter, also exceeding the lower limit value of 0.80.
The Root Mean Square Residual (RMR) specifies the mean difference between the sample variances and covariances and estimated population variances and covariances. Therefore, a small value indicates good fit. This quantity should at least fall into the range between 0.05 and 0.10. Again, the calculated value of 0.069 conformed to this requirement. All fit indices indicated an acceptable if not optimal match of the model.
Results   
A satisfying model fit is a necessary but not a sufficient precondition for the validity of a model. An analysis of the estimated parameter hints to the statistical plausibility of the model. A few rough guidelines are available helpful for the assessment of the estimated model parameters. Accordingly, all parameter estimations should significantly deviate from zero. Furthermore, the regression weights (factor loadings) should take values around mainly 0.6 to ensure that reliable relations exist between indicator and latent variable (factor). Additionally, correlations between factors should deviate from 1.0 at least by one better by three standard errors since very high correlations could be indicative for a nonsatisfying model specification.^{ [21]}
All regression weights of the items belonging to the subscale 'Work' significantly deviated from zero. With the exception of item 2 ("I have no problems to do routine work in a noisy environment") reaching a regression weight of 0.392, the standardized coefficients of all other items exceeded the lower limit value of 0.60. Accordingly, the squared multiple correlations indicating the proportion of variance in the items accounted for by the factor 'Work' varied between 15 and 61 per cent [Table  3]. The construct reliability (workrelated noise sensitivity) took a value of 0.84 even though item 2 possessed a rather small weight.
Comparable findings concerned the subscale 'Habitation'. All regression weights significantly deviated from zero [Table  3]. Other than item 5 ("When other peoples' children are noisy, I would prefer that they should not play in front of my house") reaching a standardized regression weight of 0.520, the remaining items had loadings of 0.60 and more. The proportion of variance in the items explained by the factor 'Habitation' varied between 27 (Item 5) and approximately 60% (item 2). Even if item 5 showed a lower relation to the factor, the estimated reliability of the latent variable 'Habitation' amounted to 0.87.
Similar outcomes arose for the scale 'Communication' for which all regression weights were significantly different from zero. In the same way, one item, namely, number 2 ("When I am absorbed in a conversation, I do not notice whether it is noisy around me") was striking as the regression weight fell below the lower limit value of 0.6. The remaining items were characterized by loadings in the range between 0.611 and 0.771. The proportion of variance which can be traced back to the factor 'Communication' varied between 18 (item 2) and 59% (item 5) [Table  3]. The reliability of the factor added up to 0.84 despite the somewhat deficient characteristics of item 2.
The regression weights obtained for the subscale 'Sleep' also significantly deviated from zero. Likewise, one item, in this case, item 7 ("The sound of loud thunder does not usually wake me up") did not meet the lower limit value of 0.60. The loadings of the other items varied from 0.643 (item 6) to 0.849 (item 3). The corresponding proportions of variance accounted for by the factor 'Sleep' took values ranging from 10 (item 7) to 72% (item 3). The estimated reliability of the factor took a value of 0.89 although item 7 was characterized by an inferior measurement quality.
The postulated interrelations of the subscales could also be confirmed [Table  4] as all correlations were statistically significant ( p<0.01). Increased noise sensitivity in one of the four areas of everyday life was accompanied by enhanced noise sensitivity in the other areas and vice versa.
All correlation coefficients numerically differed more than three standard errors from 1.0. This gave support to the assumption that the model had not been misspecified.
Discussion   
The accomplished CFA verified that the specified model in fact did not show a perfect but a sufficient fit with the observed data. As the postulated structure of the NoiSeQ was consistent with the empirical data, the classification of the items as well as the claimed interdependencies between the scales could be maintained. The regression weights of all items were statistically significant. The estimated reliability of the latent variables in each case exceeded the lower limit value of 0.8. The reliability conforms to measurement precision class 2 of ISO 100753. Therefore, the instrument seems to be adequate for screening measurements. The overall findings indicate the factorial validity of the NoiSeQ.
Furthermore, the results confirmed that the measurement of noise sensitivity should take into consideration different domains of daily life. Nevertheless, it was assumed that a person characterized by increased noise sensitivity in one domain of everyday life will also show an extended noise sensitivity in other domains. The findings of this study demonstrated that such relationships do exist. The highest correlation occurred between the scales 'Sleep' and 'Habitation' which is a plausible result because sleeping usually takes place at home and therefore, it is quite possible for the noise sensitivity of both domains to be associated with each other. However, the correlationcoefficient did not reach a level warranting an aggregation of both scales.
Based on the available results concerning the measurement characteristics of the NoiSeQ, it could be assumed that the four subscales of the NoiSeQ not only correspond to the criterion of reliability but also fulfill the criterion of factorial validity.
Nevertheless, further validation studies are necessary. If noise sensitivity represents a moderator variable, it should be possible to demonstrate effects of the sensitivity measures using the NoiSeQ, for example, the relationship between the indoor sound level and resulting annoyance ratings. Thus, a significant interaction between the sound level and noise sensitivity should be detectable. If noise sensitivity has a primary influence on the affective reactivity towards noise as results of psychoacoustic studies suggest,^{ [1]} then it should be verifiable that noise sensitivity is more relevant for evaluative variables like annoyance than for performancerelated variables such as speed of task solutions. These are questions for future studies concerning the analysis of the validity of the NoiSeQ.
Moreover, it must be taken into consideration that the CFA is based only on four scales of the NoiSeQ. Correspondingly, after revision of the subscale 'Leisure', the analysis should be repeated taking into consideration all five subscales. As the NoiSeQ is available in various European languages,^{ [22] } it has to be analyzed whether the model is the same for all versions of the NoiSeQ.
References   
1.  Ellermeier W, Eigenstetter M, Zimmer K. Psychoacustic correlates of individual noise sensitivity. J Acoust Soc Am 2001;109:146473. [PUBMED] [FULLTEXT] 
2.  Baron RM, Kenny DA. The mediatormoderator variable distinction in social psychological rsearch: Conceptual, strategic and statistical consideartions. J Personality Soc Psychol 1986;51:117382. 
3.  Job RF. Noise sensitivity as a factor influencing human reaction to noise. Noise Health 1999;3:5768. 
4.  Zimmer K, Ellermeier W. A German version of the noise sensitivity scale of Weinstein. Zeitschrift für Lδrmbekδmpfung 1997;44:10710. 
5.  Zimmer K, Ellermeier W. Design and evaluation of a questionnaire for recording individual noise sensitivity. Diagnostica 1998;44:1120. 
6.  Zimmer K, Ellermeier W. A short questionnaire for recording noise sensitivity. Umweltpsychologie 1998;2:5463. 
7.  Schütte M, Marks A. Development of the Dortmunder noise sensitivity questionnaire (DoLe). In : Society of Work Science (GfA), editior. Health + work in efficient work systems. GFA Press: Dortmund; 2004. p. 38790. 
8.  Schütte M, Marks A, Wenning E, Griefahn B. The development of the noise sensitivity questionnaire (NoiSeQ). Noise Health 2007;9:1524. 
9.  ISO 100753. Ergonomic principles related to mental workload  Part 3: Measurement and assessment of mental workload. International Organization for Standardization: Genf; 2004. 
10.  MacCallum RC. Model specification  Procedures, strategies and related issues. In : Hoyle RH, editor. Structural equation modeling  Concepts, issues and applications. Sage: Thousand Oaks; 1995. p. 1636. 
11.  Ullman JB. Structural equation modeling. In : Tabachnick BG, Fidell LS, editors. Using multivariate statistics, 4th ed. Allyn and Bacon: Boston; 2001. p.653771. 
12.  Hu LT, Bentler PM, Kano Y. Can test statistics in covariance structure analysis be trusted? Psychol Bull 1992;112:35162. 
13.  Harter HL. Expected values of normal order statistics. Biometrika 1961;48:15165. 
14.  Tabachnick BG, Fidell LS. Using multivariate statistics, 4^{ th} ed. Allyn and Bacon: Boston; 2001. 
15.  Johnson RA, Wichern DW. Applied multivariate statistical analysis, 3^{ rd} ed. PrenticeHall: Englewood Cliffs NJ; 1992. 
16.  Thompson B. Multinor: A fortran program that assists in evaluating multivariate normality, Educ Psychol Measurement 1990;50:8458. 
17.  Bortz J, Lienert GA, Boehnke K. Non parametric methods in biostatistics. Springer: Berlin; 1990. 
18.  Sponsel R, Hain B. Numerically unstable matrices and collinearity in psychology. IEC Verlag: Erlangen; 1994. 
19.  Bollen KA. Structural Equations with latent variables. Wiley and Sons: New York; 1989. 
20.  Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Multivariate data analysis, 6th ed. Upper Saddle River. Prentice Hall: New Jersey; 2006. 
21.  Lutz MT. Validity and factorial invariance of a neuropsychological test battery for recording intelligence of patients with epilepsy, unpublished doctoral thesis. Faculty of psychology and sports science at the University of Bielefeld: Bielefeld; 2006. 
22.  Sandrock S, Schütte M, Griefahn B. The reliability of the noise sensitivity questionnaire (NoiSeQ) in a crossnational analysis. Noise Health 2007;9:814. 
Correspondence Address: Martin Schutte Institut für Arbeitsphysiologie an der Universität Dortmund, Ardeystraße 67, D44139 Dortmund Germany
Source of Support: None, Conflict of Interest: None  Check 
DOI: 10.4103/14631741.37425
[Figure  1]
[Table  1], [Table  2], [Table  3], [Table  4] 

This article has been cited by  1 
Noise effect on comfort in openspace offices: development of an assessment questionnaire 

 M. Pierrette,E. Parizet,P. Chevret,J. Chatillon   Ergonomics. 2014; : 1   [Pubmed]  [DOI]   2 
An eventrelated analysis of awakening reactions due to nocturnal church bell noise 

 Mark Brink, Sarah Omlin, Christian Müller, Reto Pieren, Mathias Basner   Science of The Total Environment. 2011;   [VIEW]  [DOI]   3 
Mental strain and annoyance during cognitive performance in different traffic noise conditions 

 Sandrock, S., Schütte, M., Griefahn, B.   Ergonomics. 2010; 53(8): 962971   [Pubmed]   4 
Development of Attitudes towards Socioscientific Issues Scale for undergraduate students 

 Topcu, M.S.   Evaluation and Research in Education. 2010; 23(1): 5167   [Pubmed]   5 
Exploring the Relationship between Noise Sensitivity, Annoyance and HealthRelated Quality of Life in a Sample of Adults Exposed to Environmental Noise 

 Daniel Shepherd,David Welch,Kim N. Dirks,Renata Mathews   International Journal of Environmental Research and Public Health. 2010; 7(10): 3579   [Pubmed]  [DOI]   6 
Exploring the relationship between noise sensitivity, annoyance and healthrelated quality of life in a sample of adults exposed to environmental noise 

 Shepherd, D., Welch, D., Dirks, K.N., Mathews, R.   International Journal of Environmental Research and Public Health. 2010; 7(10): 35793594   [Pubmed]   7 
Impairing effects of noise in high and low noise sensitive persons working on different mental tasks 

 Stephan Sandrock,Martin Schütte,Barbara Griefahn   International Archives of Occupational and Environmental Health. 2009; 82(6): 779   [Pubmed]  [DOI]   8 
Impairing effects of noise in high and low noise sensitive persons working on different mental tasks 

 Sandrock, S., Schütte, M., Griefahn, B.   International Archives of Occupational and Environmental Health. 2009; 82(6): 779785   [Pubmed]   9 
Modelling annoyance from combined traffic noises: An experimental study 

 Kuhnt, S., Schürmann, C., Schütte, M., Wenning, E., Griefahn, B., Vormann, M., Hellbrück, J.   Acta Acustica united with Acustica. 2008; 94(3): 393400   [Pubmed]  






