Assessment/Accountability
Program Quality Assurance Services Compliance and Monitoring
Public School Coordinated Program Review System
Scope of Coordinated Program Reviews
As one part of its accountability system, the Department of Elementary and Secondary Education oversees local compliance with education requirements through the Coordinated Program Review (CPR). All reviews cover selected requirements in the following areas:
Special Education (SE)
selected requirements from the federal Individuals with Disabilities Education Act (IDEA-2004), the federal regulations promulgated under that Act at 34 CFR Part 300, M.G.L. c. 71B (Chapter 766 of the Acts of 1972), and the Massachusetts Board of Elementary and Secondary Education's Special Education regulations (603 CMR 28.00), as amended effective March 1, 2007. Federal requirements selected for the 2009-2010 reviews include, among others, the requirements specified by the federal Office for Special Education Programs (OSEP) and the requirements revised by IDEA-2004 and described in the Department's Special Education Advisories.
Civil Rights and Other General Education Requirements (CR)
selected federal civil rights requirements under Title VI of the Civil Rights Act of 1964, the Equal Educational Opportunities Act of 1974, Title IX of the Education Amendments of 1972, Section 504 of the Rehabilitation Act of 1973, and Title II of the Americans with Disabilities Act of 1990, together with selected state requirements under M.G.L. c. 76, Section 5 (Chapter 622 of the Acts of 1971) and other Massachusetts General Laws.
selected requirements from the Massachusetts Board of Elementary and Secondary Education's Physical Restraint regulations (603 CMR 46.00).
selected requirements from the Massachusetts Board of Elementary and Secondary Education's Student Learning Time regulations (603 CMR 27.00).
English Learner Education (ELE) in Public Schools
selected requirements from M.G.L. c. 71A, the state law that governs the provision of education to limited English proficient students, and 603 CMR 14.00, as well as the No Child Left Behind Act of 2001 and Title VI of the Civil Rights Act of 1964. During the 2009-2010 school year, all districts that enroll limited English proficient students will be reviewed using a combination of updated standards and a self-assessment instrument overseen by the Department's Office of Language Acquisition and Academic Achievement (OLAAA), including a request for information regarding ELE programs and staff qualifications.
Some reviews also cover selected requirements in: Career/Vocational Technical Education (CVTE)
- career/vocational technical education programs under the federal Carl D. Perkins Vocational and Technical Education Act of 1998 and M.G.L. c. 74.
Districts providing Title I services participate in Title I program monitoring during the same year they are scheduled for a Coordinated Program Review. Details regarding the Title I program monitoring process are available at: http://www.doe.mass.edu/titlei/monitoring/
Coordinated Program Review Elements
| Team: | Depending upon the size of a school district and the number of programs to be reviewed, a team of two to eight Department staff members conducts a Coordinated Program Review over two to eight days in a school district or charter school. |
| Timing: | Each school district and charter school in the Commonwealth is scheduled to receive a Coordinated Program Review every six years and a mid-cycle special education follow-up visit three years after the Coordinated Program Review; about fifty-two school districts and charter schools are scheduled for Coordinated Program Reviews in 2009-2010. The Department's 2009-2010 schedule of Coordinated Program Reviews is posted on the Department's web site at http://www.doe.mass.edu/pqa/review/cpr/schedule.html. The statewide six-year Program Review cycle, including the Department's Mid-cycle Review schedule, is posted at http://www.doe.mass.edu/pqa/review/cpr/6yrcycle.html. |
| Criteria: | The Program Review criteria for each program encompass the requirements that have been selected for review. The requirements selected for review in all of the regulated programs are those that are most closely aligned with the goals of the Massachusetts Education Reform Act of 1993 to promote student achievement and high standards for all students. |
| Methods: | Methods used in reviewing programs include:
- Review of documentation about the operation of the charter school or district's programs.
- Interviews of administrative, instructional, and support staff across grade levels.
- Interviews of parent advisory council (PAC) representatives and telephone interviews as requested by other parents or members of the general public.
- Review of student records for special education (and for student accommodation plans under Section 504), English learner education, and career/vocational technical education. The Department selects a representative sample of student records for the onsite team to review, using standard Department procedures, to determine whether procedural and programmatic requirements have been implemented.
- Surveys of parents of students with disabilities and parents of English learners. Parents of students with disabilities whose files are selected for the record review, as well as the parents of an equal number of other students with disabilities, are sent a survey that solicits information regarding their experiences with the district's implementation of special education programs, related services, and procedural requirements; parents of English learners whose files are selected for the record review are sent a survey of their experiences with the district's implementation of the English learner education program and related procedural requirements.
- Observation of classrooms and other facilities. The onsite team visits a sample of classrooms and other school facilities used in the delivery of programs and services to determine general levels of compliance with program requirements.
Note on collaborative programs and services. Where the district is a member of a collaborative approved by the Department of Elementary and Secondary Education and is a site for programs or services operated by the collaborative within the district's schools, interviews, student record review, and observation of classrooms are conducted for those particular collaborative programs. |
| Report: | Preparation:
At the end of the onsite visit, the onsite team will hold an informal exit meeting to summarize its comments for the Superintendent or Charter School Leader and anyone else he or she chooses. Within approximately 45 business days of the onsite visit, the Onsite Chairperson will forward to the Superintendent or Charter School Leader (and Collaborative Director where applicable) a Draft Report containing specific comments from the Program Review. The district (and collaborative) will then have 10 business days to review the report for factual accuracy before the publication of a Final Report. The Final Report will be issued within approximately 60 business days of the conclusion of the onsite visit and posted on the Department's website at http://www.doe.mass.edu/pqa/review/cpr/reports/.
Content: Ratings. The onsite team gives a rating for each compliance criterion it reviews; those ratings are "Commendable," "Implemented" (meaning at least substantially implemented), "Partially Implemented," "Not Implemented" (meaning at least substantially not implemented), and "Not Applicable."
Findings. The onsite team includes a finding for each criterion that it rates "Commendable," "Partially Implemented," or "Not Implemented," explaining the basis for the rating. It will also provide a narrative statement explaining the designation of "Not Applicable." |
| Response: | Where criteria are found "Partially Implemented" or "Not Implemented," the district or charter school must propose corrective action to bring those areas into compliance with the relevant statutes and regulations. This corrective action plan will be due to the Department within 20 business days after the issuance of the Final Report and is subject to the Department's review and approval. Department staff will offer districts and charter schools technical assistance on the content and requirements for developing an approvable CAP.
Department staff will provide ongoing technical assistance as the school or district is implementing the approved corrective action plan. School districts and charter schools must demonstrate effective resolution of noncompliance identified by the Department as soon as possible but in no case later than one year from the issuance of the Department's Final Program Review Report. |
The Department believes that the Coordinated Program Review is a positive experience and that the Final Report is helpful in planning for the continued improvement of programs and services in each school district, charter school, and educational collaborative.
The Web-based Approach to Special Education Monitoring
Starting with the 2007-2008 SY, the Department commenced the piloting of a new web- based approach to comprehensive special education monitoring. The web-based monitoring system (WBMS) allows both districts and the Department to submit, review and exchange documents and information through the Department's security portal. This new approach combines familiar elements from the standard CPR procedures in combination with new features that strengthen district/school accountability and oversight for special education on a continuous basis.
| Criteria: | The Program Review criteria for each WBMS program review begins with the district/school conducting a self-assessment across all special education criteria. Program Quality Assurance, through its Desk Review procedures, examines the district/school's self-assessment submission and determines which criteria will be followed-up on through onsite verification activities. For more details, please see the section on Special Education Program Review Criteria (Document #2) in this School District Information Package for Special Education. |
| WBMS Methods: | Methods used in reviewing special education programs include:
Self-Assessment Phase: This is a requirement for all districts participating in the web-based monitoring system and is completed in the year prior to the onsite review.
- District/school review of special education documentation for required elements including document uploads. Upon completion of this portion of the district/school's self-assessment, it is submitted to the Department for review.
- District/school review of a sample of special education student records selected across grade levels, disability categories, and level of need. Additional requirements for the appropriate selection of the student record sample can be found in Appendix II: Student Record Review Procedures of the School District Information Package for Special Education. Upon completion of this portion of the district/school's self-assessment, it is submitted to the Department for review.
Desk Review Phase: The chairperson assigned to each district/school reviews the district's responses to questions regarding the critical elements for appropriate policies, procedures, and practices, as well as actual documents and data submissions by criteria. The district's student record review data and explanatory comments are examined by focus area and by criteria. The outcome of this review, along with Indicator data collected by the Department and 3-year trend data from the Problem Resolution System, is used to determine the scope and nature of the Department's onsite activities.
Onsite Verification Phase: This includes activities selected from the following:
- Interviews of administrative, instructional, and support staff consistent with those criteria selected for onsite verification.
- Interviews of parent advisory council (PAC) representatives and other telephone interviews as requested by other parents or members of the general public.
- Review of student records for special education: The Department selects a sample of student records from those the district reviewed as part of its self-assessment to verify the accuracy of the data. The Department also conducts an independent review of a sample of student records that reflect activities conducted since the beginning of the school year. The onsite team will conduct this review, using standard Department procedures, to determine whether procedural and programmatic requirements have been implemented.
- Surveys of parents of students with disabilities: Parents of students with disabilities whose files are selected for the record review, as well as the parents of an equal number of other students with disabilities, are sent a survey that solicits information regarding their experiences with the district's implementation of special education programs, related services, and procedural requirements.
- Observation of classrooms and other facilities: The onsite team visits a sample of classrooms and other school facilities used in the delivery of programs and services to determine general levels of compliance with program requirements.
Note on collaborative programs and services: Where the district is a member of a collaborative approved by the Department of Elementary and Secondary Education and is a site for programs or services operated by the collaborative, interviews, student record review, and observation of classrooms are conducted for the collaborative. |
| Methods: | Methods for all other programs in the Coordinated Program Review:
- Review of documentation about the operation of the charter school or district's programs such as Civil Rights (CR), English Learner Education (ELE), and Career Vocational Technical Education (CVTE).
- Interviews of administrative, instructional, and support staff across all grade levels.
- Telephone interviews as requested by other parents or members of the general public.
- Review of student records for English learner education and career/vocational technical education. The Department selects a representative sample of student records for the onsite team to review, using standard Department procedures, to determine whether procedural and programmatic requirements have been implemented.
- Parents of English language learners are sent a survey, in the language of the home, of their experiences with the district's implementation of the ELE program and related procedural requirements, if their student's record was selected for review by the onsite team.
- Observation of classrooms and other facilities. The onsite team visits a sample of classrooms and other school facilities used in the delivery of programs and services to determine general levels of compliance with program requirements.
|
| Report: | Preparation:
At the end of the onsite visit, the team will hold an informal exit meeting to summarize its comments for the superintendent or charter school leader and anyone else he or she chooses. Within approximately 45 business days of the onsite visit, the chairperson will forward to the superintendent or charter school leader (and collaborative director where applicable) a Draft Report containing comments from the Program Review. The Draft Report comments for special education are provided to the district/school online through the Web-based Monitoring System (WBMS). These comments will, once the district has had an opportunity to respond, form the basis for any findings by the Department. The district (and collaborative) will then have 10 business days to review the report for accuracy before the publication of a Final Report with ratings and findings (see below). The Final Report will be issued within approximately 60 business days of the conclusion of the onsite visit and posted on the Department's website at http://www.doe.mass.edu/pqa/review/cpr/reports/.
Content of Final Report: Ratings. In the Final Report, the onsite team gives a rating for each compliance criterion it has reviewed; those ratings are "Commendable," "Implemented," "Partially Implemented," "Not Implemented," and "Not Applicable."
Findings. The onsite team includes a finding in the Final Report for each criterion that it rates "Commendable," "Partially Implemented," or "Not Implemented," explaining the basis for the rating. It will also provide a narrative statement explaining the designation of "Not Applicable." |
| Response: | Where criteria are found "Partially Implemented" or "Not Implemented," the district or charter school must propose corrective action to bring those areas into compliance with the relevant statutes and regulations. This corrective action plan (CAP) will be due to the Department within 20 business days after the issuance of the Final Report and is subject to the Department's review and approval. Department staff will offer districts and charter schools technical assistance on the content and requirements for developing an approvable CAP.
Department staff will provide ongoing technical assistance as the school or district is implementing the approved corrective action plan. School districts and charter schools must demonstrate effective resolution of noncompliance identified by the Department as soon as possible but in no case later than one year from the issuance of the Department's Final Program Review Report. |

| | Schedule
 | 6-Year Cycle |
|
| | Coordinated Program Review Instruments
 | Special Education |
 | English Learner Education in Public Schools - Chapter 71A |
 | Civil Rights |
 | Career/Vocational Technical Education |
|
 | Coordinated Program Review Reports |
 | Public School Mid-cycle Review |
 | Mid-cycle Review Announcement |
 | Mid-cycle Review Reports |
last updated: November 4, 2009
|