Learning Gains and Intervention ROI: Maximizing Impact in Florida's FAST System

Learning Gains and Intervention ROI

Strategic student targeting relies heavily on the concept of Return on Investment (ROI). In the context of school accountability, ROI can be mathematically defined as the accountability points generated per unit of instructional resource invested. The transition to the B.E.S.T. standards and the associated rule changes for calculating School Grades have fundamentally altered this equation.

Understanding where to invest limited intervention resources for maximum impact is the difference between a school that improves and a school that stagnates.

The Learning Gains Game Changer

Under previous accountability iterations, moving a student from the bottom of Level 1 to the top of Level 1 often resulted in zero accountability points. This "dead zone" discouraged investment in the lowest-performing students. The FAST system operates under Rule 6A-1.09981(2)(b)1.b, which introduces a granular definition of learning gains that effectively monetizes growth at the bottom of the scale.

Five Distinct ROI Zones Below Proficiency

The sub-level architecture creates five distinct zones where growth counts:

The strategic implication: A student at the top of "Level 1-Low" is now, strategically, as valuable as a student at the top of "Level 2." Moving them just 2-3 scale score points can cross an internal threshold, earning a Learning Gain point.

Research on Response to Intervention (RTI) Bands

Empirical research on intervention effectiveness suggests a curvilinear relationship between a student's initial performance level and their rate of growth. This helps identify which "bands" respond best to targeted support.

The Sweet Spot: 15th-30th Percentile (High ROI)

Students performing in the 15th to 30th percentile (typically High Level 1 to Low Level 2) represent the highest-ROI intervention targets.

Why these students respond best: - They typically exhibit "swiss cheese" gaps: specific, isolated deficits in fluency or particular math strands, rather than global cognitive impairments - Targeted Tier 2 intervention (small group, standards-aligned) can often plug these gaps rapidly, resulting in steep growth trajectories - They are the "moveable middle" that research consistently identifies as most responsive to school-based intervention

The Diminishing Returns Zone: Below 10th Percentile

Students below the 10th percentile (Level 1-Low) present a different profile:

• While these students can grow, the intensity of intervention required to produce that growth is significantly higher
• They often require Tier 3 support (1:1 or very small group), daily pull-outs, and highly specialized staff
• The "time-to-improvement" is longer because the intervention must often address deficits from 2-3 grade levels prior before current-grade growth becomes visible on a summative assessment
• From a strictly "points harvesting" perspective, this group represents a "high cost / steady yield" investment rather than a "low cost / high yield" windfall

Important: This does not mean these students should be abandoned. Ethical practice demands they be served. But schools cannot rely solely on the lowest quartile to drive school grade improvements. A balanced portfolio approach is required.

Time-to-Improvement Benchmarks

Understanding the "velocity" of student growth is crucial for planning intervention cycles. Data from Curriculum-Based Measures (CBM) like AIMSweb and i-Ready provides benchmarks for realistic growth rates.

Ambitious Growth Targets

Ambitious growth is defined as the 85th percentile of growth slopes in national norms. This is the target required to close significant gaps.

Realistic Timelines by Student Group

Critical Planning Implication

The timelines above confirm that intervention for lower-performing students must start immediately in August to yield results by PM3 in May. Schools that wait until PM1 data arrives in October have already lost 8-10 weeks of the intervention window.

Best practice: Use prior-year PM3 data and/or beginning-of-year diagnostic data to pre-assign intervention groups before the school year begins. Adjust after PM1, but do not wait for PM1 to start.

The Floor Effect and Resource Intensity

Understanding Diminishing Returns

Research highlights that intensive interventions for the lowest 5% of performers often encounter diminishing marginal utility:

• High Cost: Moving a student from the 1st percentile to the 5th percentile often requires 1:1 intervention, daily pull-outs, and highly specialized staff (e.g., Reading Recovery trained specialists)
• The Accountability Yield: Under the new sub-level learning gains, this move does count as a learning gain (L1-Low to L1-Mid). This is a crucial improvement over the old system.
• The Trade-off: However, the same amount of instructional resource (e.g., 5 hours of specialist time) applied to a group of five students in the "Moveable Middle" (Tier 2) might yield five separate learning gains and potentially five proficiency points.

The Honest Conclusion

The cost-per-point is significantly higher for the lowest performers. This does not mean they should be abandoned. Ethical practice demands they be served. But it suggests that schools cannot rely solely on the lowest quartile to drive school grade improvements. A balanced portfolio approach is required.

The Portfolio Approach to Intervention

High-performing Florida schools avoid the binary choice of "focus on L1 OR L2." Instead, they apply a nuanced Instructional Triage that aligns with what might be called the "Portfolio Theory" of investment:

The Growth Fund (Level 2 Strategy)

• Students: Level 2, especially those within 8-10 points of the Level 3 cut
• Intervention: Tier 2 support within the core block (differentiated instruction, small group scaffolding, targeted feedback)
• Goal: Efficiency. Maximize yield with moderate resource input.
• Expected outcome: Proficiency point + Learning Gain point

The Value Fund (Level 1 Strategy)

• Students: Level 1, targeting sub-level boundary crossings
• Intervention: Tier 3 support outside the core block (intensive reading/math labs, extended school day programs)
• Goal: Long-term rehabilitation and equity, accepting a higher resource cost
• Expected outcome: Learning Gain points through sub-level advancement

The Protection Fund (Level 3 Maintenance)

• Students: Low Level 3, at risk of sliding back to Level 2
• Intervention: Progress monitoring and targeted check-ins, not full intervention
• Goal: Maintain proficiency while earning a maintenance learning gain
• Expected outcome: Preserved proficiency point + Learning Gain point

Beware the Fadeout Effect

Research warns of the "fadeout effect" where gains from intensive interventions disappear once the support is removed. This is particularly prevalent in "bubble" students who are "boosted" over the line with test-prep strategies rather than deep learning.

Sustainable growth requires that interventions build independent capacity, not just dependent performance. The goal is not to get a student to score Level 3 once. It is to make them a Level 3 student who will maintain and grow from that foundation.

Key Takeaways

1. The FAST sub-level system creates ROI opportunities at every level, not just the L2/L3 boundary
2. The 15th-30th percentile is the highest-ROI band for targeted intervention
3. Start intervention in August, not after PM1. Use prior-year data to pre-assign groups.
4. Apply the portfolio approach: Invest across all levels with different strategies and intensity levels
5. Build for sustainability: Avoid test-prep-only interventions that produce temporary gains