formative evaluation


Also found in: Dictionary, Thesaurus, Legal, Financial, Encyclopedia, Wikipedia.
Related to formative evaluation: Formative assessment, Summative evaluation, process evaluation

evaluation

 [e-val″u-a´shun]
a critical appraisal or assessment; a judgment of the value, worth, character, or effectiveness of something; measurement of progress. A broad view of evaluation in health care includes three approaches, directed toward structure, process, and outcome, depending on the focus of evaluation and the criteria or standards being used.

Structure evaluations are concerned with physical facilities, equipment, staffing, and other characteristics of the facility or agency that have an effect on the quality of care being provided. Process evaluations center on the activities of the provider and what the provider has done to assess, plan, and implement nursing care. The criteria used in process evaluations in nursing are the Standards of Nursing Practice developed by the American Nurses' Association. Structure and process evaluations are primarily concerned with quality assurance and nursing audits. Outcome evaluations focus on the patient and goals set forth in the care plan and therefore are patient- and goal-oriented. Thus, outcome evaluation is the measurement of a patient's progress or lack of progress toward achievement of specified goals.

The purpose of the evaluation is to determine whether outcome criteria have been met and how care for the patient might be improved. Evaluation is not done to find fault or lay blame for inefficiency, incompetence, or carelessness. It is done for the purpose of improvement, by identifying specific areas that need change for the better. Some weaknesses that could be found during evaluation are vague or inaccurate statement of the problem because of poor assessment or faulty analysis and interpretation of data, unrealistic goal-setting due to overestimating capabilities of the patient or available resources, and well-intentioned but inappropriate nursing interventions that do not effectively meet the hoped-for outcome criteria.

Evaluation of direct care and the effectiveness of care plans and interventions is an ongoing activity. It serves to direct reassessment of patient status, the reordering of priorities, new goal-setting, and revision of nursing care as indicated.

The basic components of evaluation are (1) identifying the parameters of the subject of appraisal, (2) developing criteria specific to the topic within the parameters, (3) data gathering, (4) measuring the data against the criteria, and (5) employing the results of assessment for improvement of the process, status, behavior, or activity evaluated.

Parameters are the exact dimensions or fixed limits that clearly define the area of evaluation. They establish the frame of reference within which the process will take place and are essential to accurate interpretation and meaningful use of the results of the evaluation. Parameters to be considered might include the framework of time within which the data gathering will take place, description of the kinds of data to be obtained, and specification of the patient population selected for evaluation of patient care. In a nursing audit, for example, the medical records chosen for audit might be those of patients whose admission and discharge dates were within a specific period of time, and whose age range and diagnoses were similar. Since it is a nursing audit, the kind of data collected should be limited to information related to the area of nursing activities and the resulting patient care outcomes recorded on the patient's chart.

In the assessment of a patient's status on the health/illness continuum, the parameters might limit the appraisal to respiratory function, neuromuscular function, emotional status, or any of a number of areas that are important to accomplishing the overall goals and objectives of health care for that specific patient.

Data gathering involves the collection of information that gives factual and objective evidence about the subject being evaluated. The evidence may be obtained through observation, interview, the review of patient records, and, as in the case of assessment of a patient's health/illness status, through such procedures as laboratory analysis and testing, radiologic studies, and other diagnostic techniques, as well as a physical assessment or examination and history taking.

The data collected become documented evidence, which is then measured against the established criteria. If the evidence indicates that all of the criteria are being met, there is no indication of a problem in the area of evaluation. If the evidence shows that certain criteria are not met, these deficiencies are identified as the ones needing attention so that there can be progress toward the stated goals.
The evaluation process using occupational therapy as an exemplar. From Pedretti and Early, 2001.
criterion-referenced evaluation evaluation of performance by judging an individual's behavior, performance, or knowledge against specific criteria or standards. See also criterion-referenced testing.
formative evaluation evaluation that involves feedback regarding progress being made; it involves the continuous gathering of evaluative data throughout a learning experience.
normative-referenced evaluation evaluation in which the scores of an individual are interpreted in light of the norm or distribution of scores of others taking the same test; progress is determined by how well the individual compares with peers.
outcome evaluation see evaluation.
process evaluation see evaluation.
product evaluation in the nursing interventions classification, a nursing intervention defined as determining the effectiveness of new products or equipment.
structure evaluation see evaluation.
summative evaluation evaluation that involves one statement of the extent of achievement of objectives or goals; it involves the gathering of evaluative data at the end of a learning experience.

formative evaluation

[fôr′mətiv]
1 judgments made about effectiveness of nursing interventions as they are implemented.
2 (in nursing education) periodic evaluation of a student during a course, usually a clinical practicum.
References in periodicals archive ?
AHRQ cited several key methods that are fundamental to formative evaluations, including use of logic models to frame the evaluation, use of interview and focus group techniques to collect data, triangulation of results from multiple stakeholders, and feedback about the findings to help
Two such programs in New England, one implementing a center-based model and the other providing home-based services, contracted with the University of Rhode Island Head Start Research Team to design and implement a formative evaluation to support program improvement efforts.
In this session, developers could ask additional formative evaluation questions as desired.
The purpose of the formative evaluation was to assess the effectiveness of the computer-mediated learning process in teaching the requisite course objectives and related child welfare practice competencies, while promoting reflective practice skills for generalist social work practice.
This emphasis is reflected in the current 2002-2003 school year, with approximately 700 schools across the nation using tools and strategies developed by CREP in its Formative Evaluation Process for School Improvement (FEPSI).
The author also provides useful information on summative and formative evaluation of teachers.
Abstract: This paper reports the formative evaluation findings of a tobacco counter-marketing campaign and recommendations based on those findings.
An evaluation plan for both project and partnership is also important to identify early warning signs in partnerships in an objective and timely manner Hawe and Stickney (16) have demonstrated how the use of formative evaluation can improve practice through regular feedback and discussion by partnership members.
At Morry's Camp, campers are involved in ongoing formative evaluation activities where they describe various aspects of camp in addition to evaluating their overall experience at the end of the season.
In the case study of the development of a web/CD hybrid application, Rob Phillips explores the relationships between educational design, software design, project management, and formative evaluation, leading to a set of general principles that inform the development of interactive learning environments.
This article describes how formative evaluation provided by students and teachers interacting with a multimedia program led to the modification of the program design.