Learning Objectives: Assess benefits and costs for implementation of a web-based reporting system for community program monitoring. Describe how process/output information collected through a web-based reporting system can be integrated with surveillance data to describe the success of a statewide comprehensive tobacco control program. Identify techncial requirements and resources for building a web-based reporting system.
Abstract: Objective: Measuring “what happened” (process measures, short-term outcomes) among many diverse local tobacco control programs is key to describing the success of a comprehensive statewide tobacco control program. Process data can be combined with surveillance data as part of the state’s comprehensive evaluation plan, and to identify best practice approaches for local programs.
Methods: The Washington State Department of Health’s (DOH) Tobacco Control Program Evaluation staff, in partnership with a technical contractor, developed a web-based reporting system for local programs. The system is called CATALYST (Community Action on Tobacco evALuation sYSTem). Program staff create an annual workplan by selecting from a standardized menu of activities, describing their localized approach, and identifying their target audience by attributes. This workplan becomes the statement of work for their contract with DOH, and staff report progress toward meeting workplan goals by using the system. Standardized evaluation tools (pre/post tests, surveys) are associated with specified activities, and CATALYST generates reports to describe outcomes for participants.
Results: The web-based reporting system was implemented successfully in 2001. DOH staff are able to query the system for summary or individual contract process measures and outcomes. Local program staff are able to query the system for information about activities planned by staff across the state.
Discussion: Use of a participatory process with local staff in development and enhancement of the system, and provision of ongoing training and technical support, has been key for the success of statewide implementation with a diverse range of staff.
Back to Web-Based Reporting and Computerized Tracking and Evaluation Systems
Back to Evaluation and Surveillance
Back to The 2002 National Conference on Tobacco or Health