When it comes to student learning outcomes, what happens in the classroom does not stay in the classroom.
Teacher-student interactions, student engagement, and teacher application of professional development can have critical impacts on student outcomes in any form of CS education. Measuring student outcomes while ignoring dimensions of classroom implementation leaves the evaluator open to making faulty assumptions about program effectiveness.
At CISE EHR 2018, Professor Tiffany Berry, PhD described in detail why measuring classroom implementation is important and provides a guiding framework for implementation measurement. Check out her slides below: