Program Evaluation Basics for the LMSW Exam
Understand formative and summative evaluation, logic models, and outcome measurement for the LMSW licensing exam.
Program Evaluation on the LMSW Exam
Program evaluation is a research application that social workers use to assess whether programs are effective and to guide improvements. The LMSW exam includes questions about evaluation methods, terminology, and application. This guide covers the essential concepts you need to know.
Why Program Evaluation Matters
Social workers have an ethical obligation to provide effective services and to evaluate their own practice. Program evaluation serves several purposes:
- Determining whether a program achieves its intended outcomes
- Identifying areas for improvement in service delivery
- Demonstrating accountability to funders and stakeholders
- Contributing to the evidence base for social work practice
- Supporting informed decision making about resource allocation
Types of Evaluation
Formative Evaluation
Formative evaluation occurs during program implementation and focuses on improving the program while it is in progress. It answers questions like "Is the program being implemented as planned?" and "What adjustments are needed?" Process evaluation, a type of formative evaluation, examines how services are delivered and whether they reach the intended population.
Summative Evaluation
Summative evaluation occurs after a program is completed and measures outcomes and effectiveness. It answers the question "Did the program work?" Outcome evaluation and impact evaluation are types of summative evaluation.
Needs Assessment
While not strictly an evaluation, needs assessment is a related process that identifies gaps between current conditions and desired conditions. It helps determine whether a new program or service is needed and what it should look like.
Logic Models
A logic model is a visual tool that illustrates the theory of change behind a program. It shows the connections between:
- Inputs: Resources invested in the program, such as funding, staff, and materials
- Activities: What the program does with those resources, such as workshops, counseling sessions, and outreach
- Outputs: Direct products of program activities, such as the number of clients served or sessions conducted
- Outcomes: Changes that result from the program, typically measured at short term, intermediate, and long term levels
The LMSW exam may ask you to distinguish between outputs and outcomes. Outputs measure quantity of service (how many people were served), while outcomes measure quality and change (did participants improve?).
Outcome Measurement
Measuring outcomes requires clear, measurable indicators of success. Effective outcome measures are:
- Specific: Clearly defined and tied to program goals
- Measurable: Quantifiable using reliable and valid instruments
- Achievable: Realistic given the program's resources and timeframe
- Relevant: Connected to the changes the program seeks to create
- Time bound: Measured at defined intervals
Data Collection Methods
Common data collection methods used in program evaluation include surveys, interviews, focus groups, case record reviews, standardized assessment tools, and administrative data analysis. The choice of method depends on the evaluation questions, available resources, and the type of data needed.
Exam Tips for Evaluation Questions
On the LMSW exam, distinguish between formative and summative evaluation based on timing and purpose. Remember that formative evaluation improves a program during implementation, while summative evaluation judges a program's overall effectiveness. When asked about the best way to demonstrate program effectiveness, look for answers that use measurable outcomes and comparison groups.
Practice What You Learned
Study with 2,000+ flashcards and 240 practice exams across LCSW, LMSW, NCE, and NCMHCE.