Running Rigorous Evaluations in Personalized Learning

This document is a guide focused on the methodologies and practices for conducting rigorous evaluations in personalized learning environments. It outlines the importance of evaluations in understanding the effectiveness of educational technologies and personalized learning programs. The guide discusses various evaluation methods, including randomized control trials (RCTs), and emphasizes the need for a credible comparison group to assess the impact of interventions accurately. It details the process of randomization, including different units of randomization and the selection of comparison groups. The document also addresses the ethical considerations involved in conducting evaluations, such as access to programs and the implications of randomization on participant selection. Furthermore, it highlights the significance of understanding the mechanisms and contexts that influence the outcomes of personalized learning initiatives, aiming to improve educational practices through evidence-based approaches.