Mass.gov
Massachusetts Department of Elementary and Secondary Education
Go to Selected Program Area
Massachusetts State Seal
News School/District Profiles School/District Administration Educator Services Assessment/Accountability Family & Community  
Special Communities Adult Basic Education Alternative Learning Students & Families <  
arrow
arrow
 
 
 
 
 
 
 
 
 
 
 
arrow

21st Century Community Learning Centers (CCLC) Grant Program
(Federally funded through ESSA Title IVB - Fund Code 647)

Survey of Academic Youth Outcomes
SAYO Evaluation System

The Survey of Academic Youth Outcomes (SAYO) captures changes in youth in academics and social emotional learning (SEL) that are associated with participation in a high-quality 21st CCLC programs and likely to occur over a one-year period.

Dr. Beth M. Miller and Wendy B. Surr of the National Institute on Out-of-School Time worked with the Massachusetts Department of Elementary and Secondary Education over a three-year period to develop the SAYO. Results from two rounds of field-testing with over 5,000 students indicate that the SAYO is a valid and reliable instrument for measuring change in youth. The system exceeded scientifically accepted levels for both boys and girls at early elementary, later elementary, and middle school ages. In addition, program results indicated statistically significant, positive changes in most outcome areas.

What is the SAYO and how does it work?

The SAYO uses brief pre-participation and post-participation surveys to collect data from school day teachers, 21st CCLC program staff, and participating youth. The SAYO System is based on a "menu" approach, in which programs collect data on those outcomes that are aligned with their goals and program practices.

SAYO-Teacher (SAYO-T) and Staff (SAYO-S) Outcomes

  • Homework/Learning Skills (SAYO-T only)
  • Critical Thinking
  • Self Regulation
  • Leadership
  • Perseverance
  • Relationships with Adults

SAYO-Youth (SAYO-Y) Outcomes

  • Program Experiences: Enjoyment/Engagement, Challenge, Choice/Autonomy, Perceptions of Social Environment, Support Relationships, Responsibility and Leadership
  • Sense of Competence: Reading, Writing, Math, Science, and Getting Along with Others
  • Future Expectations: Future Planning, Expectations and Aspirations

Each outcome area is measured by asking teachers and staff to respond to four or five questions related to observable youth behaviors. These items have been extensively tested and found to work as a single scale that effectively captures the outcome being measured. Teacher,staff, and/or youth responses to these surveys can be completed for all participating youth or for a sample of youth in a program.

The SAYO was primarily designed as a program assessment tool and looks at changes in students linked to their program participation. The SAYO is not designed as an individual youth assessment tool.



Last Updated: March 9, 2017
E-mail this page| Print View| Print Pdf  
Massachusetts Department of Elementary and Secondary Education Search · Public Records Requests · Site Index · Policies · Site Info · Contact ESE