Test Design and Development

Overview

The MCAS test development process involves an extensive review and field testing before each test question (item) counts toward students' scores. It takes a total of two to three years for each question to be initially written, reviewed, and edited (by multiple educator committees, experts, and editorial staff), field tested by Massachusetts students, and then reviewed again with statistical information. Each step in the process is designed to ensure that test results are valid and reliable. The following graphic shows a simplified version of the development process for a single MCAS question.

The order of the steps varies slightly across content areas but always includes each of the processes outlined in the above graphic. Additionally, ELA passages are also reviewed by both content and bias & sensitivity committees prior to questions being written.

Select: English Language Arts | Mathematics | Science and Tech/Engineering | History and Social Science

Assessment Development Committees (ADC)

ADCs (content committees) are made up of Massachusetts educators that assist the Department in the review of MCAS questions, scoring materials, and ELA passages. Each MCAS test has an ADC committee. The current committee members are listed on the Department's website: ELA, Mathematics, STE, and Civics. The role of ADC members is to review testing materials prior to field-testing and make suggestions and refinements to the test questions. This review of testing materials includes ensuring alignment to the standards, grade-level appropriateness, instructional worthiness, and content accuracy. After field-testing, ADC members review the materials with field-test performance data.

Bias and Sensitivity Committee (BSC)

The BSC is made of Massachusetts educators that assist the Department with the review of all MCAS questions and ELA passages. All questions and passages are reviewed before they are field tested and again with their field-test performance data. Members review questions and passages for bias and sensitivity concerns based on considerations including ability, age, culture, ethnicity, gender, geography, languages spoken, race, religion, sexual orientation, and socioeconomic status. Members identify and make recommendations to the Department for questions and passages with potential bias or sensitivity issues.

Committee Recruitment

ADC and BSC members serve on the committees for a two-year term. The Department will be recruiting educators to serve on these committees in late summer-early fall 2021 for the next term that will begin in January 2022 and last through December 2023. If you would like to be notified when the recruitment for these committees begins, please provide your contact information.

Committee members typically commit to attending 3–6 days of meetings throughout the school year and 2–5 days during the summer (depending on the committee). To support educators' ability to participate, either a reimbursement for substitute teachers (during the school year) or an honorarium (during the summer) is provided. Professional development points (PDPs) are also given to members based on their hours of participation on an ADC or BSC. Additional information will be provided during the recruitment period.

Last Updated: July 9, 2021