Publications

2014
(2014). NCTE Newsletter - Fall 2014 [AUDIO] . National Center for Teacher Effectiveness.Abstract

In this newsletter we highlight a new NCTE study, Developing Common Core Classrooms Through Rubric-Based Coaching, and interview one of the Co-Principal Investigators, Dr. Matthew Kraft. 

This newsletter is part of a series originally intended for NCTE study participants. 

Listen to the full interview here:

NCTE Newsletter Fall 2014 Read the interview transcript
(2014). SDP College-Going Diagnostic for Albuquerque Public Schools . Strategic Data Project.Abstract

This report examines Albuquerque Public Schools (APS) students’ high school performance, college enrollment, and college persistence patterns, and compares these patterns across a variety of student characteristics and academic experiences. To conduct the analyses, researchers connected APS administrative student data (including demographics and test scores) to college enrollment records and to student surveys conducted by SDP Data Fellows at several APS high schools. These data sources allowed the diagnostic to track students’ progress through high school to graduation, and to examine their college-going aspirations and actual college outcomes.

Download full report
(2014). SDP Course-Grades Diagnostic for Denver Public Schools . Strategic Data Project.Abstract

In the fall of the 2012–13 school year, the Denver Public Schools and SDP engaged in a research collaboration aimed at providing the district with preliminary evidence that could inform some of these questions, potentially help refine existing reform efforts, and motivate support for future initiatives, such as establishing consistent grading policies rooted in new Common Core standards. This report presents findings from our research diagnostic, illuminating the extent to which average GPAs, standardized assessment scores, and college remediation rates vary across the district and within DPS high schools; how GPAs differ for students from different racial/ethnic backgrounds; and whether knowing a student’s middle school helps predicts her subsequent success.

Download full report
(2014). SDP Human Capital Diagnostic for Albuquerque Public Schools . Strategic Data Project.Abstract

The Human Capital Diagnostic is the result of a partnership between SDP and APS designed to bring data to bear on policy and management decisions to improve student outcomes. Researchers connected student demographics and test scores to teacher human resource data and calculated objective measures of teacher effectiveness that are linked to teacher characteristics. The diagnostic analyses leverage these measures of effectiveness to explore their relationship with characteristics of teachers, schools, and students. They are not intended to draw conclusions about the contribution made by any individual teacher but rather to understand overall district trends.

sdp-diagnostic-hc-albuquerque.pdf
(2014). SDP College-Going Diagnostic for Colorado . Strategic Data Project.Abstract

Initiative (CEI) to produce the SDP College-Going Diagnostic. The diagnostic analyses focus on describing college enrollment and persistence rates of high school graduates across Colorado; describing patterns in students’ participation in college-level coursework (in particular, AP classes and concurrent enrollment participation) in high school; and investigating the extent to which students’ participation in AP classes and concurrent enrollment programs is associated with persistence at both two-year and four-year colleges.

Download full report
(2014). SDP College-Going Diagnostic for Delaware . Strategic Data Project.Abstract

The Delaware Department of Education collaborated SDP to produce the SDP College-Going Diagnostic. The diagnostic analyses examine students’ high school performance, college enrollment, and college persistence patterns, and compares these patterns across a variety of student characteristics and academic experiences.

Download full report
(2014). SDP College-Going Diagnostic for Massachusetts . Strategic Data Project.Abstract

The Massachusetts Department of Elementary and Secondary Education collaborated with the Strategic Data Project (SDP) to conduct the SDP College-Going Diagnostic. This report examines key findings related to students’ college enrollment and college persistence patterns, and compares these patterns across a variety of student characteristics and academic experiences. The report highlights results primarily at the state level and, for illustrative purposes, for a handful of school districts and high schools.

Download full report
(2014). SDP Human Capital Diagnostic for Denver Public Schools . Strategic Data Project.Abstract

Denver Public Schools (DPS) collaborated with the Strategic Data Project to conduct the SDP Human Capital Diagnostic. The analysis focused on teacher recruitment, placement, development, evaluation/compensation, and retention/turnover. Because of the uniqueness of the data from DPS' ProComp teacher compensation system and its relevance to current policy discussions, we describe the evaluation/compensation analyses in depth and summarize the key findings from the other components of the diagnostic. These analyses have the potential to inform important education policy both in Denver and across the nation as education agencies consider revising traditional “lockstep” pay systems.

Download full report
(2014). SDP Human Capital Diagnostic for the New York State Education Department . Strategic Data Project.Abstract

The New York State Education Department collaborated with SDP to produce the SDP Human Capital Diagnostic. The diagnostic is designed to identify patterns of teacher effectiveness and areas for policy change that could leverage teacher effectiveness to improve student achievement. It is also intended to demonstrate how education agencies can capitalize on existing data to understand its current performance, set future goals, and strategically plan responses.

Download full report
Kraft, M. A., & Papay, J. P. (2014). Can Professional Environments in Schools Promote Teacher Development? Explaining Heterogeneity in Returns to Teaching Experience. Educational Evaluation and Policy Analysis , 36 (4), 476-500. Publisher's VersionAbstract

Although wide variation in teacher effectiveness is well established, much less is known about differences in teacher improvement over time. We document that average returns to teaching experience mask large variation across individual teachers, and across groups of teachers working in different schools. We examine the role of school context in explaining these differences using a measure of the professional environment constructed from teachers’ responses to state-wide surveys. Our analyses show that teachers working in more supportive professional environments improve their effectiveness more over time than teachers working in less supportive contexts. On average, teachers working in schools at the 75th percentile of professional environment ratings improved 38% more than teachers in schools at the 25th percentile after ten years.

Download full report
Blazar, D., Gogolen, C., Hill, H. C., Humez, A., & Lynch, K. (2014). Predictors of Teachers' Instructional Practices.Abstract

We extend this line of research by investigating teacher career and background characteristics, personal resources, and school and district resources that predict an array of instructional practices identified on a mathematics-specific observational instrument, MQI, and a general instrument, CLASS. To understand these relationships, we use correlation and regression analyses. For a subset of teachers for whom we have data from multiple school years, we exploit within-teacher, cross-year variation to examine the relationship between class composition and instructional quality that is not confounded with the sorting of "better" students to "better" teachers. We conclude that multiple teacher- and school-level characteristics--rather than a single factor--are related to teachers' classroom practices.

Read the working paper
West, M. R., Kraft, M. A., Finn, A. S., Duckworth, A. L., Gabrieli, C. F. O., & Gabrieli, J. D. E. (2014). Promise and Paradox: Measuring Students' Non-cognitive Skills and the Impact of Schooling.Abstract

The authors used self-report surveys to gather information on a broad set of non-cognitive skills from 1,368 eighth-grade students attending Boston Public Schools and linked this information to administrative data on their demographics and test scores. At the student level, scales measuring conscientiousness, self-control, grit, and growth mindset are positively correlated with attendance, behavior, and test-score gains between fourth- and eighth-grade. Conscientiousness, self-control, and grit are unrelated to test-score gains at the school level, however, and students attending over-subscribed charter schools with higher average test-score gains score lower on these scales than do students attending district schools. Exploiting charter school admissions lotteries, the authors replicate previous findings indicating positive impacts of charter school attendance on math achievement, but find negative impacts on these non-cognitive skills. The authors provide suggestive evidence that these paradoxical results are driven by reference bias, or the tendency for survey responses to be influenced by social context. The results therefore highlight the importance of improved measurement of non-cognitive skills in order to capitalize on their promise as a tool to inform education practice and policy.

Download full report
Braslow, D., & Humez, A. (2014). Using Surveys as Proxies for Observations in Measuring Mathematics Instruction.Abstract

Using data from elementary mathematics teachers, we examine the correspondence between self-reports and observational measures of two instructional dimensions--reform-orientation and classroom climate--and the relative ability of these measures to predict teachers' contributions to student learning.

Read the working paper
Hill, H. (2014). Lessons Learned from Instruction | Results from a Study of Upper-Elementary Mathematics Classrooms. Beyond the Numbers Convening.Abstract

While research has generated substantial information regarding the characteristics of effective mathematics teachers and classrooms, scholars have rarely tested multiple aspects of teachers or teaching within a single study. Without testing multiple variables simultaneously, it is difficult to identify specific aspects of mathematics teachers and teaching that may be particularly impactful on student learning, and to understand the degree to which these characteristics are related to one another. This plenary draws on data from a three-year study measuring multiple components of teacher and teaching quality to investigate these issues.

Lessons Learned from Instruction: Summary Lessons Learned from Instruction: PowerPoint
2013
(2013). SDP Toolkit for Effective Data Use . Strategic Data Project. Learn more and download [SDP website]Abstract

The SDP Toolkit for Effective Data Use is a resource guide for education agency analysts who collect and analyze data on student achievement. Completing the toolkit produces a set of basic, yet essential, human capital and college-going analyses that every education agency should have as a foundation to inform strategic management and policy decisions.

Castleman, B. L., Page, L. C., & Snowdon, A. L. (2013). SDP Summer Melt Handbook: A Guide to Investigating and Responding to Summer Melt . Strategic Data Project.Abstract

The SDP Summer Melt Handbook is a resource for education leaders interested in examining whether summer melt is occurring in their agency. The handbook not only serves to diagnose the phenomenon, but also helps leaders understand what they can do to address it.
Learn more about the Summer Melt Handbook on the SDP Website

(2013). SDP College-Going Diagnostic for Boston Public Schools . Strategic Data Project.Abstract

Boston Public Schools collaborated with SDP to produce the SDP College-Going Diagnostic for its district. The diagnostic is designed to identify potential areas for action to increase students’ levels of academic achievement, preparedness for college, and postsecondary attainment. It is also intended to demonstrate how districts can capitalize on existing data to understand its current performance, set future goals, and strategically plan responses.

Download full report
(2013). SDP College-Going Diagnostic for The School District of Philadelphia . Strategic Data Project.Abstract

The School District of Philadelphia partnered with SDP to produce the SDP College-Going Diagnostic. The diagnostic analyses summarized in this report focus on 1) student performance in the district during high school and into college, 2) critical junctures along the way that affect student success, and 3) student characteristics and other factors that are most strongly related to college enrollment and persistence.

Download full report
(2013). SDP College-Readiness Diagnostic for Los Angeles Unified School District . Strategic Data Project.Abstract

Los Angeles Unified School District (LAUSD) partnered with SDP to produce the SDP College-Readiness Diagnostic for its district. The diagnostic analyses focus on 1) how students across the district progress toward high school graduation, 2) whether and how students who fall off track for graduation recover and go on to graduate, and 3) the progress of students toward the completion of A-G requirements.

sdp-lausd-cg.pdf
(2013). SDP Human Capital Diagnostic for Boston Public Schools . Strategic Data Project.Abstract

Boston Public Schools collaborated with SDP to produce the SDP Human Capital Diagnostic for its district. The diagnostic is designed to identify patterns of teacher effectiveness and areas for policy change that could leverage teacher effectiveness to improve student achievement. It is also intended to demonstrate how districts can capitalize on existing data to understand its current performance, set future goals, and strategically plan responses.

Download full report

Pages