Standards, accountability, assessment, and curriculum

Textbooks are a widely used educational intervention that can affect student achievement, and the marginal cost of choosing a more effective textbook is typically small. However, we know little about how textbooks get from the publisher to the classroom. We use a lens of institutional theory and interviews with district leaders in a stratified random sample of 34 California school districts to investigate the ways mathematics textbook adoption practices vary and predict adoption decisions. We find isomorphic, highly formalized adoption processes in most districts. However, we observe some differences along dimensions of district size, technological interest/infrastructure, and English learner concentration. We recommend states produce and update lists of high quality materials early and often, and that they use a highly rigorous evaluation process. We also recommend states experiment with encouraging similar districts to partner on textbook evaluation and adoption to respond to district demands for information and capacity building around curricula.

More →

The rise of accountability standards has pressed higher education organizations to oversee the production and publication of data on student outcomes more closely than in the past. However, the most common measure of student outcomes, average bachelor's degree completion rates, potentially provides little information about the direct impacts of colleges and universities on student success. Extending scholarship in the new institutionalist tradition, I hypothesize that higher education organizations today exist as, “superficially coupled systems,” where colleges closely oversee their technical outputs but where those technical outputs provide limited insight into the direct role of colleges and universities in producing them. I test this hypothesis using administrative data from the largest, public, urban university system in the United States together with fixed effects regression and entropy balancing techniques, allowing me to isolate organizational effects. My results provide evidence for superficial coupling, suggesting that inequality in college effectiveness exists both between colleges and within colleges, given students' racial background and family income. They also indicate that institutionalized norms surrounding accountability have backfired, enabling higher education organizations, and other bureaucratic organizations like them, to maintain legitimacy without identifying and addressing inequality.

More →

We present results from a meta-analysis of 95 experimental and quasi-experimental preK-12 science, technology, engineering, and mathematics (STEM) professional development and curriculum programs, seeking to understand what content, activities and formats relate to stronger student outcomes. Across rigorously conducted studies, we found an average weighted impact estimate of +0.21 standard deviations. Programs saw stronger outcomes when they helped teachers learn to use curriculum materials; focused on improving teachers' content knowledge, pedagogical content knowledge and/or understanding of how students learn; incorporated summer workshops; and included teacher meetings to troubleshoot and discuss classroom implementation. We discuss implications for policy and practice.

More →