Family & Community Adult Education Adult & Community Learning Services
Adult and Community Learning Services

Required BEST Plus Refresher and Recertification

First, thank you to all who have taken part in assessing students this year. While the process has become more routine, we know it continues to take time and careful attention on your part. It is so important that we continue to administer and score the standardized assessments correctly. If we are to maintain accurate scores statewide, then it is vital to make sure all administrators and scorers are following the same test protocols. A significant part of this process is ensuring that all BEST Plus test administrators are scoring strictly according to the BEST Plus rubric, and re-familiarizing themselves with the scoring process (known as recalibration) each time before they test.

To ensure scoring accuracy in FY07, all BEST Plus test administrators need to be recertified, and receive notification that they successfully accomplished the recertification process. This will involve:

1. Taking part in a Scoring Refresher, and
2. Successfully completing a 30-minute scoring activity to receive recertification as a BEST Plus test administrator.

During the week of December 4, you will be mailed (via UPS) a packet containing the following:

• A 3-ring binder entitled, "BEST Plus Scoring Refresher Toolkit, "with two accompanying DVDs or VHS videos

• A white booklet entitled, "BEST Plus Scoring Refresher Workbook, Test Administrator's Edition"

• A memo giving instructions on how the Toolkit and Workbook are to be used by all BEST Plus test administrators

The Toolkit enables test administrators to review and recalibrate their scoring, and provides a structured forum for test administrators to share their insights and questions about administering and scoring BEST Plus tests. Test administrators may view the Toolkit DVD/video either individually or as a group with a facilitator (the preferred method). The Toolkit also includes very helpful information for using the video and the binder materials. Additionally, each test administrator must have a BEST Plus Workbook with which to follow along with the DVD/VHS, and to write their answers to questions asked as part of the refresher. Additional information about the Toolkit and procedures for the refresher process will be included in the packet.

Programs will receive the Toolkit and Workbooks at no cost to programs. Last spring, former ACLS staff Stacey Lubets contacted your program and confirmed the number of Toolkits you needed, depending on the number of sites in your agency that do BEST Plus testing. Each program will receive the number of Workbooks needed for each test administrator to have his/her own. If you receive fewer Workbooks than you need, you may order more for $6 each from the Center for Applied Linguistics using the PDF file, "Test Administrator Guide (TAG) and Scoring Refresher Toolkit Order Form" found at their website, http://www.cal.org/bestplus/order.html.

Who should be the Refresher Facilitator?

Directors will want to think now about who will be most effective in facilitating the BEST Plus refresher. Ideally, the staff person who is in charge of assessment at your site, or an on-staff BEST Plus certified trainer should do it. If you do not have either, please choose a staff member who is experienced with BEST Plus and the adult ESL student population and is experienced in facilitating discussions. The Toolkit contains helpful information and a Workbook with extra information for the facilitator. You may also hire a BEST Plus trainer to facilitate.

When you receive the packet:

If you will be using a staff person as facilitator, please give her/him the Toolkit to use for this purpose. Give each BEST Plus test administrator a Workbook. The refresher will take approximately 2 .5 hours to complete and all BEST Plus test administrators are required to participate in it. The Toolkit is the property of the program.

When to use the Toolkit:

Since there has been concern about the relative accuracy of some BEST Plus scores this year, BEST Plus test administrators are strongly encouraged to review the video right away to help them score as accurately as possible. Please remember that any potential decrease in test scores between future and previous BEST Plus testing will be shared by the field as a whole, and that ACLS will be closely monitoring learning gains and their impact on performance standards.

Required Recertification:

Up to a week after the refresher, BEST Plus test administrators are required to watch and score responses to a 30-minute scoring activity (located in the Toolkit) and submit the scores to your SABES Regional Center between now and Friday, March 30, 2007 . By April 30, your Regional SABES Curriculum and Assessment Coordinator will review your work and inform you of your status. Scores will fall into three categories, based on the scoring system developed by BEST Plus test developers: "Recommended," "Acceptable," or "Unacceptable." Staff successfully completing the scoring activity will receive a letter and certificate good though April 30, 2008. Staff that receive a borderline "Acceptable" or "Unacceptable" score in any one of the three rubric areas will have an opportunity to receive remediation in order to continue to administer the BEST Plus.

The scoring activity must be done within a week after the refresher. However, program staff may decide to go through the refresher once soon after receiving it, but then schedule the scoring activity some time later before the end of March. This is acceptable so long as another refresher precedes the scoring activity by one week maximum, so please plan accordingly. If you have any questions, please feel free to contact me at janes@doe.mass.edu. Thank you for your continued hard work.