Evaluating Validity And Reliability Of A Survey Instrument

Reliability is most commonly used to refer to the degree of consistency with which measurement can be conducted, and it focuses primarily on the instruments used in research. In this most simple consideration of reliability, a researcher must demonstrate that an instrument yields consistent results. The attributes of instruments must not produce variability in research outcomes that could be misconstrued as changes to the variables being measured. Two common data collection methods are referred to in this paper: Surveys and interviews. The data collection instrument for a survey could be a written questionnaire, while the data collection instrument for an interview could be a protocol for the interviewer or a video filmed while the research participant was being interviewed. For example, consider a questionnaire used to survey people about their use of tobacco. If the questionnaire language did not differentiate among the various forms of tobacco that people us, the lack of clarity and specificity of the survey instrument could evoke inaccurate responses from participants. These inaccuracies could mistakenly be attributed to the research variables.

The NWI-R has been proven to be a reliable survey tool and it has been demonstrated with Cronbach’s alpha of 0.96 for the entire NWI-R, and the subscale COP alpha noted at 0.91 (Aiken & Patrician, 2000). The survey questions administrated to the participants addresses their

There are multiple types of survey methods utilized in research. Three of the main survey methods include interviews, electronic surveys, and written surveys. In interviews, the assessor works directly with the respondent to obtain responses to the survey. Utilizing interviews allow researchers to obtain comprehensive and thorough responses. Moreover, the interviewer is able to follow-up on certain responses if more information is needed. Despite these benefits, interviews have some potential disadvantages. It is difficult to obtain a representative sample of a population willing to participate in an interview. Additionally, this type of survey is often costly in time and money. Furthermore, there is potential for interviewer bias to affect

Cognitive interviewing is a technique to improve questionnaire design by evaluating sources of response error in survey questionnaires (Willis, 1999). This process offers insights that can identify potential problems and thus enhance understandings of the survey questionnaires (Drennan, 2003).

generalizable results because of large sample sizes, results can be threatened by many factors including: faulty questionnaire design; sampling and non – responses errors; biased, questionnaire design & wording; respondent unreliability; ignorance, misunderstanding, or bias, errors in coding, processing & statistical analysis; and faulty interpretation of results. Questionnaire research can be seen as over-reliant on instruments & thus, disconnected from everyday life, with measurement processes creating a

Validity is an important aspect of the research design. For instance, in research the uses statistics as the primary form of measurement. Validity applies to the truth of a standard. A measure is valid, in general, when it (Renata, 2011, 1) includes what it devised to measure. Renata (2011) explained, "Internal and external validity are the two primary types of validity" (para. 1). However, both display diverse aspects of a study’s design and results.

The strength of questionnaires is it can give an insight into respondent’s thoughts and opinions and also cost efficient as it is inexpensive.

In an effort to gain a better insight a new survey was compiled, issued, completed and received. The new survey was conducted as an exit interview. Much of the same information was obtained such as gender, length of service, work division, training, pay, and organizational communication but question wording and response wording changed. Appendix C shows the initial results of the BIMS survey which correlated responses 1=Very Negative-5=Very Positive. Appendix D shows BIMS changed the survey format for 1=Strongly Do Not Agree-5=Strongly Agree.

Some of these characteristics include using appropriate sampling methods to ensure that the sample is random and as equally representative of the population as possible (Wasserman & Bracken, 2012). The psychometric properties of psychological assessments are validity and reliability. The test score validity of a test shows that the assessment is measuring what it claims to measure (Wasserman & Bracken, 2012). In addition to having high validity, a psychometric test has to have high reliability. The Satisfaction with Life Scale has been used in various studies where the samples have ranged from college students to elderly participants. The use of different sample groups allows the findings to be generalized to a broader population if the findings of various samples prove to have similar findings. Overall the sample groups have to be representative of the population in order to summaries the findings and use them as an explanation for other’s behaviors. The closer that the sample is to the characteristics of the population, the more accurately the findings represent the population. In order for psychological tests to be seen as reliable the findings have to be accurate, and be able to reproduce the same findings every time that the assessment is given (Wasserman & Bracken, 2012).

The participants were surveyed twice over a period of one year; the surveys were mailed out to the facilities and were self-administered to the participants. Participants had three weeks to complete and mail the survey back to the research facility using the return envelope provided. The survey response rate was sixty-five percent of those surveyed and included

Teachers are sometimes busy, so it is convenient to use questionnaires to answer my second research question without taking too much of their precious time. So this method saves time.

Among the most important aspects of the survey design is the imperative to prevent the instrument from carrying any bias. This means that quite a number of variables have entered into consideration in every aspect of the survey from its size to its scope. According to the text by Hogan (2007), in developing any data-collection instrument, and most particularly one which relies on self-report, "the general design of the test must be considered. Preliminary design considerations

Questionnaires are very useful in the collection and organization of facts and statistics. A pro of questionnaires is how they lend themselves very well to establishing and

In survey method research, participants answer questions administered through interviews or questionnaires. After participants answer the questions, researchers describe the responses given. In order for the survey to be both reliable and valid it is important that the questions are constructed properly. Questions should be written so they are clear and easy to comprehend.

Questionnaires are a popular means of collecting data, but are difficult to design and often require many rewrites before an acceptable questionnaire is produced.