Page 187 - DLIS401_METHODOLOGY_OF_RESEARCH_AND_STATISTICAL_TECHNIQUES

Methodology of Research and Statistical Techniques

Notes approach does not necessarily help practitioners improve their work, and it requires a very
good and credible evaluator to do it well.
Subjectivist, elite, true evaluation
Accreditation / certification programs are based on self-study and peer review of organizations,
programs, and personnel. They draw on the insights, experience, and expertise of qualified
individuals who use established guidelines to determine if the applicant should be approved
to perform specified functions. However, unless performance-based standards are used, attributes
of applicants and the processes they perform often are overemphasized in relation to measures
of outcomes or effects.
Connoisseur studies use the highly refined skills of individuals intimately familiar with the
subject of the evaluation to critically characterize and appraise it. This approach can help
others see programs in a new light, but it is difficult to find a qualified and unbiased connoisseur.
Subjectivist, mass, true evaluation
The adversary approach focuses on drawing out the pros and cons of controversial issues
through quasi-legal proceedings. This helps ensure a balanced presentation of different perspectives
on the issues, but it is also likely to discourage later cooperation and heighten animosities
between contesting parties if “winners” and “losers” emerge.
Client-centered studies address specific concerns and issues of practitioners and other clients
of the study in a particular setting. These studies help people understand the activities and
values involved from a variety of perspectives. However, this responsive approach can lead
to low external credibility and a favorable bias toward those who participated in the study.

14.4 Summary

• The Joint Committee on Standards for Educational Evaluation has developed standards
for educational programmes, personnel, and student evaluation.
• The international organizations such as the I.M.F. and the World Bank have independent
evaluation functions.
• Stufflebeam and Webster place approaches into one of three groups according to their
orientation toward the role of values, an ethical consideration.
• Politically controlled and public relations studies are based on an objectivist epistemology
from an elite perspective.
• Decision-oriented studies are designed to provide a knowledge base for making and
defending decisions. This approach usually requires the close collaboration between an
evaluator and decision-maker, allowing it to be susceptible to corruption and bias.

14.5 Keywords

Competence : Evaluators provide competent performance to stakeholders.
Responsibilities for General : Evaluators articulate and take into account the diversity of
and Public Welfare interests and values that may be related to the general
and public welfare.

182 LOVELY PROFESSIONAL UNIVERSITY