Evaluation Research Design Literature

19283 Words Sep 2nd, 2011 78 Pages
253 Chapter 6 Evaluation Research Design: Literature Reviews & Synthesis Frequently a research question or hypothesis can be answered through secondary research, i.e., a literature review or synthesis. Both strategies requires the researcher to mine existing data sources; ―pull out‖ relevant data or information; summarize it; logically analyze and/or statistically treat it; and report results. In many instances, the issue, problem, question, etc. which prompted the idea for an evaluation study is resolved or answered by studying and reporting previous research reports in the literature or synthesizing, either logically, statistically, or both, data drawn from existing databases. In program evaluation, it is often necessary to describe or …show more content…
51). The meta-analytical approach advocated by Glass (1976) includes the aggregation of relevant findings from empirical studies as summarized by the effect size, as well as an analysis of relevant variables which may operate on the dependent and/or independent variables of each empirical study included in the analysis. Suri describes advantages of the meta-analytic approach over the traditional narrative review; these include: (1) identification of effects, (2) analysis of operating moderating variables, (3) an explicit explanation and rationale for study inclusion criteria, and (4) the methodological flexibility to include a large number of empirical studies. Suri reports that criticisms include a tendency to over generalize findings, the potential to include poorly designed empirical studies, overreliance on published juried research, and ignoring studies where effect size isn't computed. D. Finally, Suri (2000) examines Slavin's (1986) best-evidence synthesis. 1. Slavin (1986) asserts that best-evidence synthesis, "is designed to draw on the strengths of each approach [traditional reviews and meta-analysis] and to avoid the pitfalls and characteristics of each‖ (pp. 5-6). Slavin goes on to explain that best-evidence synthesis includes the "application of rational, systematic methods of selecting studies to be included and use of effect size
Open Document