NCE Research and Program Evaluation: A Study Guide

Research and Program Evaluation on the NCE

Research and Program Evaluation is the eighth CACREP content area on the National Counselor Examination, contributing 20 scored questions. Many candidates approach this section with anxiety because they associate it with complex statistics. In reality, the NCE tests foundational research concepts and their application to counseling practice. With targeted study, this can be one of your strongest areas.

Types of Research Designs

Understanding the major research designs is essential for the NCE. You should be able to identify and distinguish between the following:

• Experimental design: Includes random assignment to treatment and control groups, allows for causal conclusions
• Quasi-experimental design: Similar to experimental but lacks random assignment, common in real-world counseling research
• Correlational design: Examines relationships between variables without manipulation, cannot establish causation
• Survey research: Collects self-report data from a sample, useful for describing attitudes and behaviors
• Qualitative research: Uses interviews, observations, and document analysis to understand experiences and meanings
• Single-subject design: Studies one participant over time, common in clinical settings

Key Statistical Concepts

Descriptive Statistics

Descriptive statistics summarize data. The mean, median, and mode describe the center of a distribution. Standard deviation and variance describe the spread. Skewness describes the shape of the distribution. In a positively skewed distribution, the mean is pulled toward the higher scores. In a negatively skewed distribution, the mean is pulled toward the lower scores.

Inferential Statistics

Inferential statistics allow researchers to draw conclusions about a population based on a sample. Key concepts include statistical significance (typically p less than .05), Type I errors (false positive, rejecting a true null hypothesis), Type II errors (false negative, failing to reject a false null hypothesis), and effect size (the practical significance of findings).

Common Statistical Tests

Know when to use each test: t-tests compare means of two groups, ANOVA compares means of three or more groups, chi-square analyzes categorical data, and correlation coefficients measure the strength and direction of relationships between variables. You do not need to perform calculations, but you should know which test to use in a given scenario.

Program Evaluation

Program evaluation questions on the NCE focus on the systematic assessment of counseling programs and services. Key concepts include needs assessment (identifying gaps between current and desired outcomes), process evaluation (examining how a program is implemented), outcome evaluation (measuring the results of a program), and formative vs. summative evaluation.

Evidence-Based Practice

The NCE increasingly emphasizes evidence-based practice (EBP), which integrates the best available research evidence with clinical expertise and client values. You should understand the hierarchy of evidence, from randomized controlled trials to case studies, and know how to locate and evaluate research relevant to counseling practice.

Threats to Internal and External Validity

Be able to identify common threats to research validity. Internal validity threats include history, maturation, testing effects, instrumentation changes, statistical regression, selection bias, and attrition. External validity concerns whether results can be generalized to other populations, settings, or times.

Study Strategies

Focus on understanding when and why each research design and statistical test is used rather than memorizing formulas. Practice identifying research designs from brief descriptions. Create a chart comparing experimental, quasi-experimental, and correlational designs on key dimensions such as random assignment, manipulation of variables, and ability to establish causation.