National Center for Teacher Effectiveness
Location: Massachusetts, Georgia & Washington, D.C.
There are three key strands of the work:
- The core study Developing Measures of Effective Mathematics Teaching, which included a extensive data collection effort, and the development of valid and reliable tools to the field of education. Read the research overview.
- Supplementary studies that aim to be responsive to the needs of education practitioners and policymakers. These studies investigate professional environments, teacher effects, teacher evaluation systems, and item response theory.
- National leadership activities such as conferences and webinars. You can learn more about these topics by accessing our resources below.
The project is led by Harvard Graduate School of Education Professors Thomas J. Kane and Heather Hill, Dartmouth College Professor Douglas O. Staiger, and Project Director Corinne Herlihy.
Partners
People
Resources
News
Methods
In the fall of 2010, NCTE commenced three years of data collection and observations of math instruction across approximately 50 schools and 300 classrooms, respectively. Data was collected from several sources, including multiple classroom observations, student assessment data, and teacher surveys to accurately capture how teachers impact student achievement.
Learn more about the findings in the teacher effectiveness section of our publications.
Data Collection Components:
- Video observations of math instruction (in classroom, length of math lesson)
- three video observations per year
- coding of practices along multiple rubrics
- Survey of teacher characteristics and measures of teachers’ mathematical knowledge for teaching (take home, 60 min.)
- Student engagement surveys (in classroom, 10 min.)
- captures interest and effort in math, interaction with their teachers, and attitudes and behaviors in school
- Supplemental measures of student achievement (in classroom, 60 min.)
- focus on a handful of math concepts that are fundamental to progressing in mathematics in these grade levels.
School Eligibility Requirements:
In order to have been eligible to participate in the study, schools must have had at least two teachers of math in Grade 4 and/or two teachers of math in Grade 5. The school principal and teachers must also have agreed to have teachers assigned to classes in Year 3 (2012–13) through the following process:
- The principal/teachers will draw up classroom rosters as usual.
- Working with NCTE staff, the principal will assign participating teachers to classes (or math class rosters) in their grade by lottery.
Featured Resource
Working Paper
Tools
NCTE sought to provide valid and reliable tools for the field of education. The links below will connect you to the instruments that NCTE developed and/or used in the core study. Additionally, NCTE developed a Video Library that contains video examples of a range classroom mathematics instruction in the United States, and project data from the core study is archived at the Interuniversity Consortium for Political and Social Research (ICPSR).
The NCTE data is currently housed at the Inter-university Consortium for Political and Social Research (ICPSR) at the University of Michigan. The data may be accessed by creating an account on the ICPSR website. The datasets include:
- Class Observations (ratings using CLASS instrument)
- Mathematical Quality of Instruction
- Student Questionnaire
- Value Added Scores
- Student Administrative Data
- Teacher Background Questionnaire
- Teacher Fall and Spring Questionnaires
- Student Alternative Math Assessment Responses
- Student Random Assignment Roster
- Main Study Codebook
Teacher background information includes number of years of experience, education, race, and gender. Student respondent demographic and household information includes race, gender, household makeup, free and reduced lunch status, English proficiency, number of books in the household, and number of rooms in the home.
The MQI Video Library contains video examples of a range classroom mathematics instruction in the United States. The collection is an extension of the National Center for Teacher Effectiveness main study Developing Valid Measures of Effective Mathematics Teaching.
One of these measures, the Mathematical Quality of Instruction (MQI) observation instrument, contains several dimensions that capture different aspects of classroom mathematics instruction:
- Richness of the Mathematics
- Working with Students and Mathematics
- Common Core-Aligned Student Practices
- Errors and Imprecision, and
- Classroom Work is Connected to Mathematics
Within each of these dimensions, there are individual codes that capture more specific and detailed aspects of mathematics instruction.
In the video we have collected of mathematics classrooms, there exists a range of practice on each of these codes and dimensions. The MQI Video Library contains over one hundred short video clips of mathematics lessons from grades three through nine. These clips provide examples and benchmarks for different features of instruction and levels of quality of mathematics instruction in the United States. The Video Library contains video examples that have been used with teachers, administrators, professional developers, and researchers interested in improving the quality of mathematics instruction.
Use of the video library is limited to research and educational purposes. If you would like more information on how to access the MQI Video Library, please contact mqicoaching@gse.harvard.edu. To learn more about the MQI instrument, visit the MQI coaching website.
The Mathematical Quality of Instruction (MQI)
The Mathematical Quality of Instruction (MQI) is the classroom observation scoring system developed by Heather Hill's research group. It measures the quality of mathematical instruction in 4 dimensions. It was used in the Measures of Effective Teaching Study, the evaluation of Math Solutions, and is used to measure the quality of mathematics instruction in NCTE's core study, Developing Measures of Effective Mathematics Teaching. The MQI is aligned to the Common Core State Standards of mathematics.
NCTE Student Assessments
The NCTE students assessments were developed as a joint venture between NCTE Researchers at Harvard and Educational Testing Services (ETS). These eight assessments are aligned with the Grade 4 and Grade 5 Common Core State Standards for Mathematics (CCSSM), and were designed to measure gains resulting from teacher professional development and also be sensitive to variation in teachers’ mathematical knowledge for teaching and instruction. They are available for educational use (not commercial ventures) along with all other materials required for administration (test administration manual, scoring guide, practice items, etc.).
Student Survey
The student survey, adapted with permission from the Tripod Student Survey developed by Ron Ferguson of Harvard University, is one of the measures used in the Developing Measures of Effective Mathematics Teaching. This instrument is available via the NCTE data archive at ICPSR. The full Tripod Student Survey has been used in the Measures of Effective Teaching (MET) project, which includes technical appendices. For more information on Tripod, contact Rob@TripodEd.com or visit www.TripodEd.com.
Mathematical Knowledge for Teaching (MKT)
The Mathematical Knowledge for Teaching (MKT) measures were developed by the Learning Mathematics for Teaching (LMT) Project at the University of Michigan. The measures are used in the Developing Measures of Effective Mathematics Teaching Study to measure teachers' specialized knowledge for teaching mathematics. The LMT Project offers training on the use of the measures and technical materials. The NCTE teacher questionnaires included MKT items, as well as questions related to teaching and professional responsibilities. This instrument is available via the NCTE data archive at ICPSR.
Classroom Assessment Scoring System (CLASS)
The Classroom Assessment Scoring System (CLASS) observation instrument was developed by Robert Pianta and Bridget Hamre at the University of Virginia and is used in the Developing Measures of Effective Mathematics Teaching study to measure the general quality of instruction.
Developed jointly by Harvard and Educational Testing Services (ETS), the NCTE Student Assessment is an open resource for use by researchers and practitioners (not commercial ventures). The assessment was designed to be sensitive to teachers' mathematical knowledge for teaching and instruction, and to measure gains resulting from teacher professional development. Additionally, the NCTE Student Assessments are aligned to the 4th and 5th grade Common Core Standards in Mathematics.
The items on the NCTE assessment have a unique "nested set" design which assesses the understanding of a concept at different developmental levels. Additionally, the items on this assessment are designed to:
- Represent central ideas in the subject matter;
- Focus on the meaning of facts and procedures; and
- Require more complex responses than traditional multiple-choice problems.
The NCTE student assessment materials may be accessed below. They include the following:
- Guidelines for administering the NCTE Student Assessments
- The NCTE Assessment Toolkit which includes everything needed to administer and score the Student Assessments
- The technical report, which provides an overview of the item development process and a description of the piloting of the assessments. It also provides item-level results from the psychometric analyses of the eight test forms.
Conference Resources
Supporting Rater Accuracy and Consistency in Classroom Observation
The purpose of this webinar series was to provide an opportunity for states to hear from and ask questions of experts who help to design and implement classroom observation systems that support rater accuracy and consistency. The National Center for Teacher Effectiveness invited six organizations that are currently supporting this type of work in states and districts to describe what they do and what they have learned to help implement these systems at scale.
The organizations shared a variety of approaches, some with similar elements, and some different. Participants were encouraged to think about how these approaches may or may not work in each state's policy climate and ask questions to best inform their policy decisions.
Webinar Syntheses by Topic
NCTE compiled information by topic via webinar syntheses. Below you will also find background information, PowerPoint slides, and the webinar recording for each of the presentations.
Cambridge Education
About the organization, speaker, and contact info
National Institute for Excellence in Teaching
About the organization, speaker, and contact info
Pearson
About the organization, speaker, and contact info
Teachscape
About the organization, speaker, and contact info
Teachstone
About the organization, speaker, and contact info
TNTP