Analyze & Decide

Analyze pilot data to determine the extent to which the edtech product solved your need, and whether to scale up implementation. Consider the goal, size, and complexity of the pilot when deciding how to analyze data.
Districts can make the strongest claims and clearest decisions by comparing outcomes for pilot participants with those for teachers and students who did not participate.
Comparing pre- and post-pilot data
“By creating our own templates in Excel, we can get the fields that we know we need, which align with how we measure outcomes. …[When we] pilot a program, we can send the company our template and say, ‘You need to figure out how to align whatever your metrics are with these.’” —Eian Harm, West Ada School District
Tips for Success!

- If possible, compare results to a control group
- Consider multiple types of data in your analysis
- Ensure claims are supported by the data