A tablet showing planning software

When planning a pilot, districts must clearly articulate what they are trying to accomplish and how they will collect evidence to make an informed decision.

Pilots produce the most useful results when everyone involved can answer the question, “What does success look like?”

Process Matters

Tips for Success!

A list of tips
  • Clearly articulate goals, measures, and timelines
  • Identify data that will be used to determine success
  • Ensure pilot rigor matches the risk associated with product adoption (cost, teacher training, implementation time, etc.)

Tools & Resources

For definitions of our taxonomies, see our About section.

Resource
Tool

Classroom Implementation Guidance From Highline Public Schools

This resource, developed in partnership with Highline Public Schools, provides a thoughtful implementation discussion framework to support your team when implementing a new edtech in a classroom, school, or district.

Tool

Cycle-based Budgeting Toolkit From Cycle-based Budgeting

The Cycle-based Budgeting (CBB) calls for a new approach to funding new initiatives or programs as well as tackling ineffective existing programs. Specifically, it provides a solution that allows districts to: 1) demonstrate alignment with districts priorities, 2) describe budget needs and intended use, 3) identify target measurable outcomes (either academic or non-academic), and 4) articulate time needed to achieve the target outcomes, which becomes the cycle for the program to be implemented and reviewed. By addressing the challenges districts face for budgetary decisions through Cycle-based Budgeting, the tool empowers educations leaders to make informed and tough decisions, with a goal of more optimal use of taxpayer money to improve student learning.

Tool

Data-Goal Alignment Document

This worksheet will help you think about what data you need to collect in your pilot study.

Tool

Pilot Planning Checklist

A checklist to help you plan for a successful edtech pilot.

Tool

West Ada Workflow Chart From West Ada

A flowchart from West Ada School District for piloting and determining whether to purchase an edtech product.

Resource

A Discussion Guide: Working with your Ed Tech Provider From Ed Tech RCE Coach

The discussion guide developed by the Ed Tech RCE Coach provides a framework for initiating and maintaining a meaningful partnership with the edtech developer involved in the pilot.

Resource

Choosing a Good Comparison Group From Ed Tech RCE Coach

This report reviews processes for identifying and selecting a valuable comparison group in edtech pilots.

Resource
Tool

Classroom Implementation Guidance From Highline Public Schools

This resource, developed in partnership with Highline Public Schools, provides a thoughtful implementation discussion framework to support your team when implementing a new edtech in a classroom, school, or district.

Resource

Cohort Support Discussion Focus Areas From Citizen Schools

An overview of key discussion topics for pilot leaders meeting across school contexts to share practices and provide feedback to each other.

Resource

Digital Promise Sample Pilot Timeline

A sample timeline for running a pilot study in your school.

Resource

Ed Tech RCE Coach From Mathematica Policy Research, Inc

The Ed Tech Rapid Cycle Evaluation (RCE) Coach is a tool that guides you, step by step, through an evaluation of educational technology in your school or district.

Resource

Ed Tech RCE Coach: Craft Your Research Question From Mathematica Policy Research, Inc

This document guides you through a formulaic process to craft a good research question, an essential first step in conducting a pilot.

Resource

Ed Tech RCE Coach: Determine Your Approach From Mathematica Policy Research, Inc

This decision tree will help you determine the best research design for your school or district’s goals.

Resource

Ed Tech RCE Coach: Think About How You’ll Use Results From Mathematica Policy Research, Inc

This worksheet will help you think about the steps to take after receiving pilot results.

Resource

Evaluation Taxonomy From Learning Assembly

The Learning Assembly Evaluation Taxonomy describes various types of evaluations as well as examples of engaging with educators and learnings, in real life education environments, with products and practices designed to demonstrate a positive effect on student learning, teacher practice, and/or learning environment.