Mass.gov
Massachusetts Department of Elementary and Secondary Education
Go to Selected Program Area
Massachusetts State Seal
Students & Families Educators & Administrators Teaching, Learning & Testing Data & Accountability Finance & Funding About the Department Education Board  
>
 
 
>
 
 
 
 
 
 
>
 
 
>
 
   

Office of Planning and Research

How will I know how strong the evidence is for my intervention?

The evidence-based approach encourages state and district leaders to examine the strength of the evidence in making decisions. Selecting evidence-based practices supports the use of limited resources-people, time, and money-in ways that are more likely to have an impact. The strongest evidence comes from well designed and well implemented randomized control experimental studies. However, plenty of other research, including quasi-experimental designs and correlational research, can provide credible evidence.

The federal Every Student Succeeds Act (ESSA) provides one useful way of thinking about the spectrum of evidence quality. In the law, evidence ranges from randomized control trial experiments, which provide strong evidence, to research conducted on a program based on a strong rationale or theory of action. Districts should seek out interventions with the strongest evidence, while at the same time considering whether and how the research reflects its students and context. That is, seek out the strongest evidence that reflects your context. The figure below illustrates how districts might locate the quality of evidence along the strength and context continuums.

The figure illustrates how districts might locate the quality of evidence along the strength and context continuums.
Strength Continuum: Demonstrates A Rationale, Correlational Studies, Quasi-experimental Studies, Randomized Control Trials
Context continuum: Strongly Reflects Local Context, Fails to Reflect Local Context

Tier 1 - Strong Evidence1: Supported by one or more well designed and well implemented randomized control experimental studies.

Tier 2 - Moderate Evidence: Supported by one or more well designed and well implemented quasi-experimental studies.

Tier 3 - Promising Evidence: Supported by one or more well designed and well implemented correlational studies (with statistical controls for selection bias).

Tier 4 - Demonstrates a Rationale: Practices that have a well defined logic model or theory of action, are supported by research, and have some effort underway by an SEA, LEA, or outside research organization to determine their effectiveness.

 

Note:
line



Last Updated: May 22, 2018
E-mail this page| Print View| Print Pdf  
Massachusetts Department of Elementary and Secondary Education Search·Public Records Requests · A-Z Site Index · Policies · Site Info · Contact DESE