Search Results

ESSA includes four levels of evidence, determined by study design, study results, negative findings from related studies, sample size and setting, and the match between study population and setting, and the population and setting for implementation.

ARP guidance features three tiers of evidence: Strong evidence requires “one or more well-designed and well-implemented experimental studies conducted on the proposed program with positive findings on one or more intended outcomes.” Moderate evidence requires “one or more quasi-experimental studies with positive findings on one or more intended outcomes OR two or more non-experimental studies with positive findings on one or more intended outcomes.” Preliminary evidence requires at least one non-experimental study.

This grant program uses the following evidence tiers: (i) Demonstrates a statistically significant effect on improving student outcomes or other relevant outcomes based on— (A) Strong evidence from at least one well-designed and well-implemented experimental study; (B) Moderate evidence from at least one well-designed and well-implemented quasi-experimental study; or (C) Promising evidence from at least one well-designed and well-implemented correlational study with statistical controls for selection bias; or (ii)(A) Demonstrates a rationale based on high-quality research findings or positive evaluation that such activity, strategy, or intervention is likely to improve student outcomes or other relevant outcomes; and (B) Includes ongoing efforts to examine the effects of such activity, strategy, or intervention. (Page 5)

The program’s NOFO requires grant recipients to collect data demonstrating their ability to meet performance standards established in the program’s authorizing legislation and detailed in regulation. Grant recipients must collect and report these data through a federally sponsored management information system. Among other data elements, the system includes information about client characteristics, length of stay and the type of residence they move to when they leave the program.

The program’s NOFO requires grant recipients to “collect and report information on program implementation and program outcomes through a common set of performance measures.” Among others, data elements include attendance, reach and dosage provided; and participants’ “characteristics, behaviors, program experiences, and perceptions of effects (through participant entry and exit surveys).”

Authorizing Statute vs. Annual Appropriations Language Designating funds for evaluation in an…