Plan - Edtech Pilot Framework


A tablet showing planning software

When planning a pilot, districts must clearly articulate what they are trying to accomplish and how they will collect evidence to make an informed decision.

Pilots produce the most useful results when everyone involved can answer the question, “What does success look like?”

Tips for Success!

A list of tips
  • Clearly articulate goals, measures, and timelines
  • Identify data that will be used to determine success
  • Ensure pilot rigor matches the risk associated with product adoption (cost, teacher training, implementation time, etc.)

Tools & Resources

For definitions of our taxonomies, see our About section.

Cycle-based Budgeting Toolkit 
From Cycle-based Budgeting

The Cycle-based Budgeting (CBB) calls for a new approach to funding new initiatives or programs as well as tackling ineffective existing programs. Specifically, it provides a solution that allows districts to: 1) demonstrate alignment with districts priorities, 2) describe budget needs and intended use, 3) identify target measurable outcomes (either academic or non-academic), and 4) articulate time needed to achieve the target outcomes, which becomes the cycle for the program to be implemented and reviewed. By addressing the challenges districts face for budgetary decisions through Cycle-based Budgeting, the tool empowers educations leaders to make informed and tough decisions, with a goal of more optimal use of taxpayer money to improve student learning.

Data-Goal Alignment Document

This worksheet will help you think about what data you need to collect in your pilot study.

Pilot Planning Checklist

A checklist to help you plan for a successful edtech pilot.

West Ada Workflow Chart 
From West Ada

A flowchart from West Ada School District for piloting and determining whether to purchase an edtech product.

A Discussion Guide: Working with your Ed Tech Provider 
From Ed Tech RCE Coach

The discussion guide developed by the Ed Tech RCE Coach provides a framework for initiating and maintaining a meaningful partnership with the edtech developer involved in the pilot.

Choosing a Good Comparison Group 
From Ed Tech RCE Coach

This report reviews processes for identifying and selecting a valuable comparison group in edtech pilots.

Cohort Support Discussion Focus Areas 
From Citizen Schools

An overview of key discussion topics for pilot leaders meeting across school contexts to share practices and provide feedback to each other.

DAT, DIT, DET Resources 
From Vancouver Public Schools

As part of the district Design II Chapter 2 strategic plan, multiple district teams have worked together to develop new processes for evaluating and integrating digital content and services. This memo seeks to explain these new structures and processes and what you need to do if you are considering the purchase of most types of digital content and services. The goal of these new systems is to ensure that new digital content and services will work as intended for users.

Digital Promise Sample Pilot Timeline

A sample timeline for running a pilot study in your school.

Ed Tech RCE Coach 
From Mathematica Policy Research, Inc

The Ed Tech Rapid Cycle Evaluation (RCE) Coach is a tool that guides you, step by step, through an evaluation of educational technology in your school or district.

Ed Tech RCE Coach: Craft Your Research Question 
From Mathematica Policy Research, Inc

This document guides you through a formulaic process to craft a good research question, an essential first step in conducting a pilot.

Ed Tech RCE Coach: Determine Your Approach 
From Mathematica Policy Research, Inc

This decision tree will help you determine the best research design for your school or district’s goals.

Ed Tech RCE Coach: Think About How You’ll Use Results 
From Mathematica Policy Research, Inc

This worksheet will help you think about the steps to take after receiving pilot results.

Evaluation Taxonomy 
From Learning Assembly

The Learning Assembly Evaluation Taxonomy describes various types of evaluations as well as examples of engaging with educators and learnings, in real life education environments, with products and practices designed to demonstrate a positive effect on student learning, teacher practice, and/or learning environment.

Continue to Step 4

Sign Up For Updates! Email icon

Sign up for updates!