CTF EVALUATION

The Auburn University Evaluation Team is the independent, non-biased program evaluator for all state funded programs of The Alabama Department of Child Abuse and Neglect Prevention (ADCANP). ADCANP is the state lead agency designated to prevent child abuse and neglect and is explicitly focused on educating Alabama communities in the Strengthening Families™ framework. ADCANP oversees 165 plus community-based prevention programs focused on reducing risk factors for child maltreatment. The ADCANP/CTF Evaluation project conducts systematic data collection and evaluation of all of ADCANP funded programs. All funded agencies invest time and effort in the collection of data from program participants throughout the year, using uniform surveys within each program type. This allows for the aggregation of data within program categories and results in meaningful information regarding the experiences of the average participant in each program area. This systematic empirical assessment of prevention programs throughout the state is one of few such efforts in the United States. Although each program varies in approach, curriculum, and delivery method, common objectives are shared by programs in each area of emphasis. All funded programs have objectives that center on reducing risk factors for child maltreatment and promoting protective factors Because of the large number of citizens served, survey research methods are utilized and program participants respond to questions regarding their background and demographics, as well as their understanding, knowledge, and skills in many different areas relevant to healthy families and communities. The questionnaire uses a validated and efficient method of gathering information on baseline and post-program levels of each measure in order to assess for changes, using statistical analyses. At program completion, participants report their level of knowledge and skill in specific areas before and after their participation in the program. Previous research has supported the use of this retrospective-pre and post-program evaluation design as efficient and meaningful documentation of participants’ perceptions of benefit from the program and the extent to which specific program objectives have been met. Research also indicates this design may be a more accurate strategy for documenting change. Participants tend to answer more honestly when taking a retrospective pre/post as compared to separate pre- and post-program surveys since participants may respond in a more socially desirable way prior to program start. They also tend to have better knowledge on which to assess pre-program levels after they have received information and skills training in the program. (For more information on this survey research design and its validity, please contact a member of the CTF Evaluation team at Auburn University at ctfeval@auburn.edu.) For analyses, data are aggregated across programs within each program type. Paired sample t-tests are conducted on each measure (some are global, singular items; some are multi-item scores) to identify statistically significant changes from pre-program mean levels to post program mean levels. Effect sizes for documented changes were calculated using the appropriate formula for paired data. For the past seven years, the Auburn University evaluation team has had the extraordinary opportunity to partner with and document the work of ADCANP-funded programs. We wish to express our appreciation to Sallye R. Longshore, the visionary ADCANP Director, for entrusting us with this important responsibility for the past 7 years. We are energized and excited about the planned work together in the years ahead. Words cannot adequately express how much we value the years of collaboration and partnership with Sallye, her dedicated staff and Board of Directors. The unwavering support and continued investment in the evaluation of prevention programs is a model for the rest of the country. Working for you, with you, and with the people of Alabama is truly an honor and privilege for us, the evaluation team.