Page 49 - DLIS401_METHODOLOGY_OF_RESEARCH_AND_STATISTICAL_TECHNIQUES
P. 49
Methodology of Research and Statistical Techniques
Notes Also, it has the advantage that it saves time and money, and you can study long periods of
time. Moreover, unobtrusive historical research can fulfill several purposes : (1) the parallel
testing of theories, to apply a theory to several historical cases; (2) the interpretation of contrasting
contexts, to reveal the particularities of historical events; and (3) analyzing causalities, to
explain why historical events took place.
The main weakness of historical research is the historical fact that it is probably the least
developed method of social-science research. Although many reputed sociologists used historical
research methods (e.g., Durkheim on the division of labor, Marx and Weber on capitalism,
Merton on science and technology), the idea that a study of the past can be meaningful in and
by itself, or to grasp the present, only rarely inspires research.
In addition, historical research can only reveal the past inasmuch as it is still present today:
important documents, for instance, may be lost or destroyed (bad on validity). Finally, because
of the often less rigid nature of this method of inquiry, the researcher can (invalidly) affect
his/her picture of what has happened. Therefore, corroboration, the cross-checking of various
sources, is helpful.
E. Evaluation Research
Evaluation research is intended to evaluate the impact of social interventions, as an instance
of applied research, it intends to have a real-world effect.
Just about any topic related to occurred or planned social intervention can be researched.
Basically, it intends to research whether the intended result of an intervention strategy was
produced.
1. Measurement in Evaluation Research
The basic question is coming to grips with the intended result: how can it be measured, so the
goal of an intervention program has to be operationalized for it to be assessed in terms of
success (or failure).
The outcome of a program has to be measured, best by specifying the different aspects of the
desired outcome. The context within which an outcome occurred has to be analyzed. The
intervention, as an experimental manipulation, has to be measured too. Other variables that
can be researched include the population of subjects that are involved in the program. Measurement
is crucial and therefore new techniques can be produced (validity), or older ones adopted
(reliability).
The outcome can be measured in terms of whether an intended effect occurred or not, or
whether the benefits of an intervention outweighed the costs thereof (cost/benefit analysis).
The criteria of success and failure ultimately rest on an agreement.
The evaluation can occur by experiment, or by quasi-experiment. Time-series analysis, for
instance, can analyze what happened for a longer period before and after an intervention, and
with the use of multiple time-series designs, we can also compare with a pseudo control
group.
2. The Context in Evaluation Research
There are a number of problems to be overcome in evaluation research. First, Logistical problems
refer to getting the subjects to do what they are supposed to do. This includes getting them
motivated, and ensuring a proper administration. Second, ethical problems include concerns
over the control group (which is not manipulated, and whose members may experience deprivation).
It is hard to overlook what is done with the findings of an evaluation research, for instance,
because the findings are not comprehensible to the subjects, because they contradict ‘intuitive’
beliefs, or because they run against vested interests.
44 LOVELY PROFESSIONAL UNIVERSITY