Home > Adolescence, Health, and Sexuality > Sexual Health > Sexual Health and Communities > CAPP > Evaluation Tools

CAPP

 
ACT for Youth Highlight
What's the thinking behind the CAPP evaluation process? Jane Powers, director of ACT for Youth Center of Excellence, offers an overview in these narrated presentations.

CAPP Evaluation: Implementing Evidence-Based Programs in NYS

Narrated PresentationNarrated Presentation

PowerPoint PresentationPowerPoint Presentation (1.6M)

CAPP Evaluation August 2011 Update

Narrated PresentationNarrated Presentation

PowerPoint PresentationPowerPoint Presentation (1.7M)

CAPP Evaluation Tools

Together, Comprehensive Adolescent Pregnancy Prevention (CAPP) providers and ACT for Youth Center of Excellence (COE) are evaluating the evidence-based programs that are being implemented throughout New York State. Through CAPP evaluation, we will be able to troubleshoot challenging areas and improve program implementation over time.

For this to happen, we need accurate evaluation data. This page details the process and gives instructions for each of the data collection tools that CAPP providers are asked to use. Links to evaluation tools for each evidence-based program (EBP) are provided in the "Tools and Instructions" section below.

Process and Contact information

Each CAPP provider is asked to complete a set of evaluation tools, most of which will be returned to the COE for analysis. Using this information, the COE will compile information from across the state and report findings to providers.
When Form What To Do
During 1st session
of program cycle
Demographic Survey Each participant completes the form, turning it in to the facilitator
After 1st session
of program cycle
Demographic Survey
and
Attendance Record
(in Evaluation Packet)
Facilitator uses the Demographic Surveys to complete demographics information on Attendance Record
After each session
of program cycle
Attendance Record Facilitator documents who participated in the session
Fidelity Checklist
(in Evaluation Packet)
Facilitator indicates which module(s)/activities were covered during the session and describes any adaptations
When program cycle
is complete
Attendance Record Facilitator or CAPP Coordinator removes all names from Attendance Record
Evaluation Packet Working with the program facilitator, CAPP Coordinator uses the Cover Sheet to review and finalize the Attendance Record and Fidelity Checklist, checking for completeness, clarity, and accuracy. Data from any hand-written forms are entered into the appropriate Word document.
Evaluation Packet CAPP Coordinator emails Evaluation Packet (including Cover Sheet, Attendance Record, and Fidelity Checklist) to Amanda Purington at the COE: ald17@cornell.edu

Questions?
Contact Amanda Purington, Research Support Specialist, ACT for Youth Center of Excellence

Tools and Instructions

Demographic Survey

The demographic survey asks each participant to report age, ethnicity, race, and gender. Collecting these demographics helps us identify which groups are being served. This process also allows participants to identify their own gender, ethnicity, and race, rather than asking program facilitators to make these determinations.

Instructions

  • There are two surveys on the page (to save paper). Cut the pages in half before distributing.
  • At the first session, ask each participant to complete the survey and return it to you.
  • Facilitators will use the surveys when completing the Attendance Record.
  • Note: To preserve participant confidentiality, these surveys should not be returned to the COE.
Demographic Survey (PDF: 154K)

Evaluation Packet

Cover Sheet. The Cover Sheet highlights some of the important details in the Attendance Record and Fidelity Checklist that should be reviewed before the Evaluation Packet is sent to the COE. After each bulleted item is reviewed, check it off! Please be sure to send this as part of the Evaluation Packet.
 

Attendance Record. The Attendance Record is a tool for keeping track of who attends each session of the program cycle. This is essential information that will help us document any fluctuations in attendance and record the actual "dosage" of the EBP received by each participant. This form is also where you will report age, ethnicity/race, and gender of participants, using information from the Demographic Survey. At the end of the program cycle, names must be removed before sending the document to the COE.

Instructions

  • Complete header information in full.
     
  • For each participant, record which EBP sessions were attended.
     
  • Using the Demographic Survey (see above) completed by each participant, fill in the age, ethnicity/race, and gender for each person.
     
  • Assign each participant a number in the column on the far right.
     
  • Important! After the form is complete but before sending it in to the COE, please remove participant names to preserve the confidentiality of the young people involved.
     
Fidelity Checklists. Evidence-based programs are designed in a particular way, based in theory, to achieve results. They are popular with funders because they have been rigorously tested and shown to produce results. When these programs are offered in new settings, a high level of fidelity to the original program -- implementing every session and activity with the target populations in approved settings -- is the best way to achieve the same results. When programs are changed without regard to the core components that are believed to make them effective, they are unlikely to achieve the same results.

However, no program is implemented exactly the same way twice. Some adaptation is inevitable. Because fidelity is so important, the Department of Health requires the COE to pre-approve all major adaptations to CAPP programs. In addition, facilitators may find that they must make certain adjustments on the spot. The Fidelity Checklist will help you document both pre-approved adaptations and changes you were forced to make on the ground. It also allows you to report how and when you carried out the program activities, as well as successes and challenges that you faced.

Completing the Fidelity Checklist will give you a way to reflect on the program cycle and the work that has been done. It will also teach us more about implementation in diverse settings across the state.

Instructions

  • Complete the header, recording facilitators' names, cycle date range, and site location.
     
  • Record each session date, indicating the date of the session and the module(s) completed that day.
     
  • At the end of each program session (while your memory is fresh), record any adaptations made to program activities, including both why and how the activity was changed. Add any additional comments regarding each module in the space provided.
     
  • Add any additional comments at the end of the form, including any particular successes or challenges related to program implementation.
     
Download the Evaluation Packet for the program you are using:

(The following Word documents are each under 350K)
 

Microsoft Word Aban Aya - Grade 5
Microsoft Word Aban Aya - Grade 6
Microsoft Word Aban Aya - Grade 7
Microsoft Word Aban Aya - Grade 8
Microsoft Word Be Proud! Be Responsible!
Microsoft Word Be Proud! Be Responsible! (2012 edition)
Microsoft Word Be Proud! Be Responsible! Be Protective!
Microsoft Word Becoming a Responsible Teen
Microsoft Word Cuídate
Microsoft Word Draw the Line / Respect the Line - Grade 6
Microsoft Word Draw the Line / Respect the Line - Grade 7
Microsoft Word Draw the Line / Respect the Line - Grade 8
Microsoft Word It's Your Game...Keep It Real - Grade 7
Microsoft Word It's Your Game...Keep It Real - Grade 8
Microsoft Word Making Proud Choices
Microsoft Word Making Proud Choices (2011 edition)
Microsoft Word Project AIM
Microsoft Word Rikers Health Advocacy Program
Microsoft Word Reducing the Risk
Microsoft Word Safer Choices - Level 1
Microsoft Word Safer Choices - Level 2
Microsoft Word Safer Sex Intervention
Microsoft Word SiHLE
Microsoft Word Teen Health Project
Microsoft Word Teen Outreach Program (TOP)
Copyright © 2012 ACT for Youth Center of Excellence. All rights reserved. Web Site and Database Development by RMF Designs