[MCAS Logo] The Massachusetts Comprehensive Assessment System Guide to the 2007 MCAS for Parents/Guardians Massachusetts Department of Education [Massachusetts Department of Education Star Logo] Massachusetts Department of Education This document was prepared by the Massachusetts Department of Education. Jeffrey Nellhaus, Acting Commissioner of Education Commissioner’s Foreword Dear Parent or Guardian: MCAS tests are an important part of our state’s effort to improve the achievement of every child in Massachusetts. The tests are designed to measure students’ acquisition of important knowledge and skills in core academic subjects. They are also used to show whether schools and districts are helping their students, including subgroups of students, make adequate yearly progress toward becoming proficient. This guide is designed to assist you in reviewing your child’s results on the spring 2007 MCAS tests and in understanding how MCAS test scores are reported. The guide supplements your child’s Parent/Guardian Report. If you have questions about the meaning of the results or your child’s performance, I encourage you to meet with your child’s teacher(s) to discuss the results and identify ways that you can partner with your school to support your child’s education. Your support is extremely important in helping your child to be successful in school and in strengthening education for all Massachusetts students. Sincerely, Jeffrey Nellhaus Acting Commissioner of Education Copyright © 2007 Massachusetts Department of Education Permission is hereby granted to copy any or all parts of this document for non-commercial educational purposes. Please credit the "Massachusetts Department of Education." This document is printed on recycled paper. 350 Main Street, Malden, Massachusetts 02148-5023 781-338-3000 www.doe.mass.edu Table of Contents Commissioner’s Foreword I. What Are the Purposes of MCAS?.......................................... .........2 Participation Guidelines.............................................................2 Students with Disabilities ..........................................................2 Limited English Proficient (LEP) Students............................................3 II. What MCAS Tests Were Administered in Spring 2007?................................4 Retests .............................................................................5 III. What Types of Questions Appear on MCAS Tests?...................................5 IV. How Will Your Child’s Test Results Be Used?......................................6 V. How Are MCAS Results Reported?....................................................8 A. Section I: Your Child’s Performance...............................................8 Performance Level....................................................................8 Scaled Scores........................................................................8 Raw Scores...........................................................................9 Display of Scores and Probable Range of Scores.......................................9 B. Section II: Information about your child’s performance on MCAS test questions.................................................................10 C. Section III: How did your child’s performance compare to school, district, and state performance?..............................................................10 D. Section IV (Grades 4, 7, and 10): Descriptions of your child’s writing performance ................................................................11 E. What Information Does the Parent/Guardian Report Provide if Your Child Participated in the Alternate Assessment?................................11 F. Under What Circumstances Do Students Not Receive MCAS Scores?........................................................................11 VI. Where Can I Find More Information?..............................................12 A. Additional Reports Available.....................................................12 B. Other Resources..................................................................12 C. What Can You Do to Help Your Child?..............................................13 I. What Are the Purposes of MCAS? The Massachusetts Comprehensive Assessment System (MCAS) is designed to meet the requirements of the Education Reform Law of 1993. This law specifies that the testing program must * test all public school students in Massachusetts, including students with disabilities and limited English proficient students; * measure performance based on the Massachusetts Curriculum Framework learning standards; * report on the performance of individual students, schools, and districts. As required by the Education Reform Law, students must pass the grade 10 tests in English Language Arts (ELA) and Mathematics as one condition of eligibility for a high school diploma (in addition to fulfilling local requirements). Beginning with the class of 2010, students also must pass one of the four high school tests in Science and Technology/Engineering listed on page 4. In addition, the MCAS program holds schools and districts accountable, on a yearly basis, for the progress they have made toward meeting the goal set by the No Child Left Behind Law of proficiency in reading and mathematics for all students by 2014. Participation Guidelines In 2007, all public school students in grades 3-8 and grade 10 were required to participate in MCAS testing. Schools were also required to administer a test to any grade 9 student who was enrolled in a Biology, Chemistry, Introductory Physics, or Technology/ Engineering course and who chose to participate in the corresponding MCAS test. Students with Disabilities During the year prior to scheduled statewide assessments, an Individualized Education Program (IEP) or 504 team meets to determine how an individual student with a disability will participate in MCAS testing. This information is documented in the student’s IEP or 504 plan. For students with disabilities who cannot be tested using the standard MCAS test with or without accommodations, the Department of Education administers the MCAS Alternate Assessment. Parents of students who participate in the Alternate Assessment receive two Parent/Guardian Reports - one standard report, which indicates that the student took the Alternate Assessment and shows the student’s performance level, and one report that provides detailed information on the student’s performance on the Alternate Assessment. MCAS results for students with disabilities, including students who participate in the Alternate Assessment, are included in school, district, and state results. More information about participation requirements and the range of available accommodations may be found in the Requirements for the Participation of Students with Disabilities in MCAS (Spring 2007 Update), which is on the Department’s Web site at www.doe.mass.edu/mcas/participation. Limited English Proficient (LEP) Students An LEP student is "a student whose first language is a language other than English who is unable to perform ordinary classroom work in English." The determination of LEP status is made according to district identification procedures. Federal and state law requires that all LEP students enrolled in Massachusetts public schools and in private schools at public expense must participate in MCAS tests given at their grade level in Mathematics and Science and Technology/Engineering. For LEP students in their first year of enrollment in U.S. public schools, the district has the option of having students participate in the ELA test at their grade level. The results for first-year LEP students are used for diagnostic purposes only. Therefore, these students do not receive scaled scores or performance levels. In addition, all LEP students are required to participate in the Massachusetts English Proficiency Assessment (MEPA) and the Massachusetts English Language Assessment- Oral (MELA-O) to measure their annual progress toward learning English. In spring 2007, K-2 LEP students in Title III districts also participated in a reading and writing assessment called the IDEA Proficiency Test (IPT). In 2007, eligible Spanish-speaking LEP students who had been enrolled in schools in the continental U.S. for fewer than three years had the option of taking an English/Spanish dual-language version of the grade 10 Mathematics test if they could read and write at or near grade level in Spanish. More information about participation guidelines for LEP students may be found in the Requirements for the Participation of Students with Limited English Proficiency in MCAS and MEPA (Spring 2007 Update), which is on the Department’s Web site at www.doe. mass.edu/mcas/participation. II. What MCAS Tests Were Administered in Spring 2007? The table below shows the 2007 MCAS tests administered at each grade level. Grade 3 ELA Reading Comprehension Mathematics Grade 4 ELA (Composition; Reading Comprehension) Mathematics Grade 5 ELA Reading Comprehension Mathematics Science and Technology/Engineering History and Social Science* Grade 6 ELA Reading Comprehension Mathematics Grade 7 ELA (Composition; Reading Comprehension) Mathematics History and Social Science* Grade 8 ELA Reading Comprehension Mathematics Science and Technology/Engineering Grade 10 ELA (Composition; Reading Comprehension) Mathematics High School Science and Technology/Engineering * Biology * Chemistry * Introductory Physics * Technology/Engineering U.S. History* * No student-, school-, or district-level results were produced based on the History and Social Science or U.S. History tests. Retests Each fall and spring, the Department offers an opportunity for eleventh-graders, twelfth- graders, and out-of-school youth to participate in MCAS retests. All students who had not yet earned a Competency Determination were eligible to participate in the MCAS ELA and Mathematics retests during the past year. Eleventh-grade students attempting to improve their MCAS score(s) to attain a Certificate of Mastery were allowed to participate in the standard 2007 MCAS grade 10 ELA and Mathematics tests. Other grade 11 students with medically documented absences for their grade 10 tests or who transferred into Massachusetts public schools after grade 10 were allowed to participate in the standard 2007 MCAS grade 10 tests in an attempt to qualify for the John and Abigail Adams Scholarship. III. What Types of Questions Appear on MCAS Tests? The MCAS tests use a variety of question formats to measure student learning. * Multiple-choice questions are used in all subject area tests except the ELA Composition test. Students select the correct answer from four options. A correct answer is assigned a score of 1 point, and an incorrect answer is assigned a score of 0 points. * Open-response questions are used in all subject area tests except the ELA Composition test. Depending on the subject area tested, students create a written response that consists of one or more paragraphs and/or a chart, table, diagram, illustration, or graph. Points are awarded based on scoring guides that are tailored to each open-response question. For grade 3 math only, each answer receives a score from 0 to 2 points. For all other grades and subjects, each answer receives a score from 0 to 4 points. * Short-answer questions are used in only Mathematics tests. Students generate a brief response, which usually consists of a numeric solution or short statement. A correct answer is assigned a score of 1 point, and an incorrect answer is assigned a score of 0 points, based on scoring guides. * Writing prompts are used in ELA Composition tests. In grades 4, 7, and 10, students write a composition in response to a writing prompt. The ELA Composition test includes two sessions, which are administered on the same day with a short break between sessions. In the first session, students respond to the writing prompt by preparing a first, unscored draft of their writing. Following a break, students return to revise their first draft into a final composition, which is submitted for scoring. Each ELA Composition is scored independently by two scorers, based on a scoring guide, in the following two areas: * Topic Development (2-12 points) * Standard English Conventions (2-8 points) IV. How Will Your Child’s Test Results Be Used? As you review your child’s results, please keep the following in mind: * The Parent/Guardian Report provides important information about your child’s academic performance in the subjects tested by MCAS during the 2007 administration. Use the MCAS results, along with teacher evaluations and your child’s day-to-day schoolwork, to assess how well your child is doing in school. Your interest and encouragement are important. * Your child’s MCAS Parent/Guardian Report becomes part of his or her temporary student record. Your child’s temporary student record includes all of the information the school maintains about your child that is not contained in his or her transcript. Generally, these records cannot be examined by anyone other than the student, the student’s parent or guardian, and authorized school personnel without the consent of the student or the student’s parent or guardian. A student’s temporary record is destroyed no later than five years after the student transfers, graduates, or withdraws from the school system. For more information about this topic, refer to the Department’s Web site at www.doe.mass.edu. * Students must pass the grade 10 MCAS tests in ELA and Mathematics as one requirement for earning a high school diploma. In addition to passing the MCAS tests, students must also meet local requirements for high school graduation. If your child does not attain a scaled score of 220 or higher on the grade 10 MCAS ELA and Mathematics tests, he or she will be able to participate in retests(s) for the subject areas not passed. Students will have multiple opportunities to take these retests. * Beginning with the class of 2010, students must also pass a high school test in one of the four Science and Technology/Engineering subject tests listed on page 4. Beginning in spring 2008, students who did not pass a high school Science and Technology/Engineering test on their first attempt will have additional opportunities to take the test in the same subject area, or in one of the other three subject areas. The opportunity to take the high school Biology test will be offered twice each year, beginning in 2009: first in January/February, and again at the end of the spring term. * The ELA and Mathematics results for tenth-graders (and for eleventh-graders who had not previously participated in the grade 10 ELA and/or Mathematics tests) are used to determine eligibility for the John and Abigail Adams Scholarship. A Massachusetts public high school student automatically qualifies for the Adams Scholarship if his or her results satisfy the following three requirements: 1. a score in the Advanced category in either grade 10 ELA or Mathematics; 2. a score in the Proficient or Advanced category in the second subject (ELA or Mathematics); and 3. a combined MCAS score on these assessments that ranks in the top 25% in their school district. Students who participate in school choice or METCO are eligible for the scholarship if they meet the eligibility requirements for the district in which they live. Students in charter schools are eligible for the scholarship if they meet the minimum performance criteria and have a combined score in the top 25% of their charter school district or for the district in which they live. * Educators use student, school, and district results to review curriculum and instruction and to plan for improvement. This practice fulfills, in part, the intent of the Education Reform Law, which is to improve the instruction and achievement of Massachusetts students based on the Curriculum Framework learning standards. * The Department of Education uses MCAS results to gauge each school’s progress toward all students being proficient in ELA and Mathematics. Achieving this goal by 2014 is the principal objective of the federal No Child Left Behind Law. Each year, the state releases Adequate Yearly Progress (AYP) determinations for all public schools and districts in the state and for subgroups of students in each school and district. These student subgroups include the following: * limited or formerly limited English proficient students * students with disabilities * low income students * African American/Black, Asian, Hispanic/Latino, Native American, White, and Multi-Race-Non-Hispanic/Latino students V. How Are MCAS Results Reported? Parents of each student in grades 3-8 receive a Parent/Guardian Report that shows the results for all spring 2007 MCAS tests taken by their child. Two Parent/Guardian Reports are provided for each grade 10 student: one report for ELA and Mathematics test results, and a separate report for high school Science and Technology/Engineering results, if the student participated in a Biology, Chemistry, Introductory Physics, or Technology/ Engineering course. Parent/Guardian Reports are not provided for the History and Social Science or U.S. History tests. Results from these tests are not officially reported but are used to provide information regarding the performance of test questions. Results for selected items from the History and Social Science and U.S. History tests are provided to schools for diagnostic purposes. A. Section I: Your Child’s Performance Section I of the Parent/Guardian Report lists the subjects tested at your child’s grade, your child’s performance level in each subject, your child’s score in each subject, and your child’s probable range of scores. Performance Level Performance levels relate a student’s performance to the Curriculum Framework learning standards. Classroom teachers, administrators, higher education faculty, and community members participated in standard-setting panels for each test to identify the minimum total test score associated with each performance level. The Department uses the standards that were set to report a student’s performance level for each test. At grades 4 through 8, MCAS results are reported according to four performance levels: Advanced, Proficient, Needs Improvement, and Warning. For grade 10 ELA and Mathematics tests and for high school Science and Technology/Engineering tests, performance levels are Advanced, Proficient, Needs Improvement, and Failing. For grade 3 ELA and Mathematics tests, performance levels are Above Proficient, Proficient, Needs Improvement, and Warning. For retests, performance levels are Passing and Failing. MCAS Alternate Assessments include the performance levels of Progressing, Emerging, and Awareness. The back cover of the Parent/Guardian Report provides general definitions of the MCAS and MCAS Alternate Assessment performance levels. Scaled Scores For grades 4 and above, a student’s scaled score ranges from 200 to 280. Scaled scores make MCAS results comparable from year to year. For example, a scaled score of 240 on any MCAS test always indicates that the student scored at the low end of the Proficient performance level. No scaled scores are reported for grade 3. 2007 MCAS Scaled Score Ranges, Grades 4 and Above Performance Level Scaled Score Points Advanced 260-280 Proficient 240-258 Needs Improvement 220-238 Warning (grades 4-8) Failing (grade 10 and high school Science and Technology/Engineering) 200-218 Raw Scores Raw score points are shown in the Display of Scores and Probable Range of Scores portion of the report. The raw score represents the number of points your child earned on the test. Display of Scores and Probable Range of Scores This portion of section I shows your child’s score and probable range of scores using a horizontal gray bar with a vertical line in the middle. The vertical line represents your child’s scaled score (raw score for grade 3) on each test. The horizontal bar indicates the range of scores your child might receive if he or she took the test many times. The range of scores is shown in relation to MCAS performance levels. B. Section II: Information about your child’s performance on MCAS test questions Section II of the Parent/Guardian Report indicates how your child answered every common test question in each subject tested. The first row of this section lists a number or abbreviation for each question. The table below shows the number of questions for each grade and subject. 2007 MCAS Tests Number of Common Questions for Each Grade and Subject Grade English Language Arts Mathematics Science and Technology/Engineering 3 42 35 -- 4 40 plus Composition 39 -- 5 40 39 39 6 40 39 -- 7 40 plus Composition 39 -- 8 40 39 39 10 40 plus Composition 42 -- High School -- -- 45 (Biology) 45 (Chemistry) 45 (Introductory Physics) 45 (Technology/Engineering) The number of questions varies from one grade and subject to another. Depending upon the number and type of questions on the test, your child’s report may have some reporting category and score spaces shaded out. To interpret the codes used in the reporting category and score rows, refer to the legend on the reverse side of the Parent/Guardian Report. The actual questions and correct answers are available from the Department Web site at www.doe.mass.edu/mcas/testitems.html in the document Release of Spring 2007 MCAS Test Items. Material from this document can be selected and printed by grade level and subject. C. Section III: How did your child’s performance compare to school, district, and state performance? This section of the Parent/Guardian Report compares your child’s performance on each subject area test with the performance of students in the same grade at your child’s school, in your child’s local school district, and in the state overall. Your child’s performance level from Section I has been shaded on the left-hand side of each graph (A = Advanced; P+ = Above Proficient [grade 3 only]; P = Proficient; NI = Needs Improvement; W = Warning; F = Failing [grade 10 and high school Science and Technology/Engineering only]). The bars in the middle of the graph show the percentage of students in your child’s school (SCH) and district (DIS), and in the state (STA), who performed at each performance level. D. Section IV (Grades 4, 7, and 10): Descriptions of your child’s writing performance Students in grades 4, 7, and 10 were administered the Composition (writing) test and the Reading Comprehension test. Results from both tests were combined to arrive at a performance level and scaled score for each student’s ELA test. For these grades, section IV of the Parent/Guardian Report provides descriptions of your child’s writing performance. Descriptions associated with your child’s score for topic development are shown on the left and those associated with your child’s score for use of standard English conventions are shown on the right in this section of the report. E. What Information Does the Parent/Guardian Report Provide if Your Child Participated in the Alternate Assessment? If your child took the Alternate Assessment, the Parent/Guardian Report shows a performance level, but no scaled score for the standard test. More detailed information about your child’s performance on the Alternate Assessment is provided on a separate report for parents/guardians, the MCAS-Alt Parent/Guardian Report. F. Under What Circumstances Do Students Not Receive MCAS Scores? * If your child was absent from testing with a medically documented excuse, the Parent/Guardian Report shows a performance level of medically excused. * If your child was absent from test sessions and make-up sessions without a medically documented excuse, the Parent/Guardian Report shows a performance level of absent. * If your school indicated that your child is a limited English proficient (LEP) student who was enrolled in U.S. schools for the first time after March 1, 2006, the Parent/Guardian Report shows a performance level of LEP. The Report also provides item analysis for any parts of the test(s) that your child attempted. * In a small number of cases, the Parent/Guardian Report may indicate a performance level of Incomplete or Transferred. Contact your child’s school if you would like more information concerning this designation. VI. Where Can I Find More Information? A. Additional Reports Available The resources listed in this section are provided to schools and districts following MCAS test administration. Please contact the school at which your child took the MCAS tests for access to these resources. * ELA Composition (grades 4, 7, and 10 only) Students’ ELA Compositions are made available to schools in electronic format from a secure Web site. They are available to parents/guardians upon request. * School and District Reports These reports are available online and provide information about subgroups of students tested, distribution of results by scaled score interval, performance level results, and three-year comparisons of results. * Test Item Analysis Report Summaries These reports show the average item score and the percentage of total student responses for each multiple-choice answer, short-answer, or open-response score point. B. Other Resources The publications listed in this section are available on the Department’s Web site. Many are also available at your child’s school. * Release of Spring 2007 MCAS Test Items, which is available at www.doe.mass.edu/ mcas/testitems.html, contains all 2007 MCAS test questions used to determine student results. * Requirements for the Participation of Students with Disabilities in MCAS (Spring 2007 Update), which is available at www.doe.mass.edu/mcas/participation, outlines the participation requirements and allowable accommodations for students with disabilities. * Requirements for the Participation of Students with Limited English Proficiency in MCAS and MEPA (Spring 2007 Update), which is also available at www.doe.mass. edu/mcas/participation, outlines the participation requirements for LEP students. * Curriculum Frameworks in English Language Arts, Mathematics, Science and Technology/Engineering, and History and Social Science, which are available at www.doe.mass.edu/frameworks/current.html, describe what students should know and demonstrate based on their grade spans. * MCAS Performance Appeals, which is available at www.doe.mass.edu/mcasappeals, provides information about a process that enables students to demonstrate, through their coursework, that they meet or exceed the English and/or mathematics passing standard of 220 on MCAS tests even though they have been unable to pass the tests or retests. C. What Can You Do to Help Your Child? Supporting your child is critical now and in his or her future academic career. Here are some tips for helping your child prepare for the next MCAS test administration. * Have regular discussions with your child’s teacher(s) to see what you can do at home to support your child’s work in school. * Make sure your child gets enough rest, eats properly, and arrives at school on time every day. Send your child to school prepared to learn. * Discuss with your child subjects that need improvement. Talk about whether he or she thinks there has been improvement. If the answer is no, find out why. * Ask your child about homework that is due tomorrow and next week, and make sure this homework is completed. * Ask your child to explain what he or she is studying. These conversations help you follow your child’s progress, and help your child to remember what he or she has learned. * If your child has a disability, ask his or her teacher(s) how MCAS fits into your child’s IEP or 504 plan. * Help your child practice MCAS test questions, and review the tests together so you will all become familiar with the expectations. English version