2007 National Conference on Tobacco or Health

Thursday, October 25, 2007
Exhibit Hall

Comprehensive Evaluation of Process and Outcome Measures in Community Programs

Lisa M. Brown, MS, Virginia Tobacco Settlement Foundation, lbrown@vtsf.org

Learning Objectives: Understand the compents you must have to conduct a multi-faceted evaluation of evidence-based youth tobacco prevention and cessation programs.

Problem/Objective: In 2005-2006 the Virginia Tobacco Settlement Foundation (VTSF) provided funding to 70 organizations implementing tobacco prevention or cessation programs for youth (programs were recognized as a promising or effective tobacco prevention program model).

VTSF developed a multi-faceted evaluation of the process and outcome measures of these community-based programs.

Methods: 1) Statewide Evaluation of Outcome Measures Virginia Commonwealth University (VCU) developed pre and post-tests designed to measure five core objectives: Current Tobacco Use, Intentions to Smoke, Perceived Benefits of Remaining Tobacco Free, Knowledge About the Harmful Effects of Tobacco, and Self-Efficacy. The pre and post-tests were implemented with two age groups: 2-5 grade (Level 2- 10,000 youth), and 6-12 grade (Level 3- 14,000 youth).

2) Evaluation of Process Measures A Quarterly Grant Progress Report form captures information on the Program Targets (targeted number of participants expected to be served) and Program Outputs (number of participants who completed the program). The report serves as a work plan with Goals, Objectives and Strategies.

3) Site Visits VTSF conducts site visits once per year with each program to gauge effectiveness and fidelity.

Results: Level 2 outcome survey produced a positive change in two of the five core measures. The Level 3 programs achieved success on three of the six core measures.

Conclusions: Evaluating youth tobacco prevention programs benefit from a multi-faceted approach. Results are gained with evaluating outcome measures with a standardized evaluation tool and by information included in the Quarterly Grant Progress Reports and through site visits.