Search for EdWorkingPapers here by author, title, or keywords.
Survey respondents use different response styles when they use the categories of the Likert scale differently despite having the same true score on the construct of interest. For example, respondents may be more likely to use the extremes of the response scale independent of their true score. Research already shows that differing response styles can create a construct-irrelevant source of bias that distorts fundamental inferences made based on survey data. While some initial studies examine the effect of response styles on survey scores in longitudinal analyses, the issue of how response styles affect estimates of growth is underexamined. In this study, we conducted empirical and simulation analyses in which we scored surveys using item response theory (IRT) models that do and do not account for response styles, and then used those different scores in growth models and compared results. Generally, we found that response styles can affect estimates of growth parameters including the slope, but that the effects vary by psychological construct, response style, and model used.
A huge portion of what we know about how humans develop, learn, behave, and interact is based on survey data. Researchers use longitudinal growth modeling to understand the development of students on psychological and social-emotional learning constructs across elementary and middle school. In these designs, students are typically administered a consistent set of self-report survey items across multiple school years, and growth is measured either based on sum scores or scale scores produced based on item response theory (IRT) methods. While there is great deal of guidance on scaling and linking IRT-based large-scale educational assessment to facilitate the estimation of examinee growth, little of this expertise is brought to bear in the scaling of psychological and social-emotional constructs. Through a series of simulation and empirical studies, we produce scores in a single-cohort repeated measure design using sum scores as well as multiple IRT approaches and compare the recovery of growth estimates from longitudinal growth models using each set of scores. Results indicate that using scores from multidimensional IRT approaches that account for latent variable covariances over time in growth models leads to better recovery of growth parameters relative to models using sum scores and other IRT approaches.
School Improvement Grants (SIG) represent one type of governments’ capacity-building investment to spur sustainable changes in America’s persistently under-performing public schools. This study examines both short- and long-run effects of the first two cohorts of SIG schools from two states and two urban districts across the country. Using dynamic event analyses, we observe that SIG showed larger effects in the second and third years of the intervention than the first year on 3-8th grade student test scores—a pattern of gradually increase over the course the intervention. These positive effects are largely sustained three or four years after the funding ended. In high schools, the SIG effects on 4-year graduation rates were steadily increasing throughout the period of six or seven years after the initial start of the intervention. These patterns of SIG effects mostly apply to each of the four locations, but the magnitude of effects varies across locations, suggesting differential implementations. Moreover, SIG effects on students of color or low-socioeconomic students are similar to, and sometimes a bit larger than, the overall SIG effects. We also conduct a variety of sensitivity and robustness checks. Lastly, we discuss the policy implications of our findings on states’ continuing efforts of transforming public organizations and building their long-term capacity for better performance.
This study examines whether county-level estimates of implicit bias predict black-white test score gaps in county schools. Data from over 1 million respondents from across the United States who completed an online version of the Race Implicit Association Test (IAT) were combined with data from the Stanford Education Data Archive covering over 300 million test scores from U.S. schoolchildren in grades 3 through 8. In both bivariate and multivariate models, counties with higher levels of racial bias had larger black-white test score disparities. This relationship was primarily explained by sorting mechanisms: The black-white test score gap was larger in counties with higher levels of implicit bias because these counties’ schools were more racially segregated and were characterized by larger racial gaps in gifted and talented assignment as well as special education placement.
The Every Student Succeeds Act of 2015 (ESSA) grants states unprecedented discretion in implementing many of the federal law’s requirements concerning the needs of the nation’s educationally disadvantaged students. This theoretical paper addresses a void in the policy implementation literature on why ESEA reform efforts have not been more effectively sustained. It synthesizes previous research on ESEA by proposing the use of multiple political science frames to guide new empirical research on ESSA’s impacts. These alternative models—ESSA’s Legal Framework, Institutional Actors, and Stakeholder Bargaining—can inform the law’s national impacts on equity for disadvantaged students and the key conditions affecting differences in state responses to the equity challenge ESSA presents.
Principals shape the academic setting of schools. Yet, there is limited evidence on whether principal professional development improves schooling outcomes. In 2008-09, Pennsylvania’s Inspired Leadership (PIL) induction program required that newly hired principals complete targeted in-service professional development within five years of employment. Using panel data on all Pennsylvania students, teachers and principals, we leverage within-principal variation in the timing of PIL completion within the same school setting to estimate the impact of PIL induction on principal persistence, teacher effectiveness and student achievement. PIL induction increased principal tenure by 18 percent, corresponding to approximately half an additional year as principal of record; however, PIL induction had no impact on teacher effectiveness or student achievement. We discuss the implications of our findings for principal induction efforts.
Political parties in the U.S. are composed of networks of interest groups, according to the extended party network theory. Scholars have focused on national extended party networks. We use the case of education interest groups to explore how policy environments shape party networks on the state level. Using 145,000 campaign contributions from 2000 to 2017, we show that the alignment of education interest groups has changed over time. In 2000, teachers unions were the dominant group and aligned with Democrats. Meanwhile, Republicans lacked support from any education group. This pattern was relatively consistent across states. Over time, coalitions diverged, with some state networks polarizing, meaning unions increasingly aligned with Democrats and reform groups with Republicans, while others did not experience such polarization. We find that labor law restrictions and private school choice programs were related to these trends, suggesting that state-level policies shape the contours of state party networks.
Revealed preferences for equal college access may be due to beliefs that equal access increases societal income or income equality. To isolate preferences for those goods, we implement an online discrete choice experiment using social statistics generated from true variation among commuting zones. We find that, ceteris paribus, the average income that individuals are willing to sacrifice is (i) $4,984 dollars to increase higher education (HE) enrollment by 1 standard deviation (14%); (ii) $1,168 dollars to decrease rich/poor gaps in HE enrollment by 1 standard deviation (8%); (iii) $2,900 to decrease the 90/10 income inequality ratio by 1 standard deviation (1.66). In addition, we find that political affiliation is an important moderator of preferences for equality. While both Democrats and Republicans are willing to trade over $4,000 dollars to increase HE enrollment by 1 standard deviation, Democrats are willing to sacrifice nearly three times more income to decrease either rich/poor gaps in HE enrollment or the 90/10 income inequality ratio by 1 standard deviation.
Newly emerging teacher residency programs offer an innovative approach to recruiting and retaining high-quality teachers for hard-to-staff schools. This report summarizes the features of these programs and research about their practices and outcomes. These programs create a vehicle to recruit teachers for high-needs fields and locations; offer recruits strong content and clinical preparation specifically for the kinds of schools in which they will teach; connect new teachers to early career mentoring that will keep them in the profession; and provide financial incentives that will keep teachers in the districts that have invested in them.
Recent research demonstrates that, when more money is spent on education for students from low-income families, achievement and graduation rates improve. So, too, do life outcomes such as employment, wages, and reduced poverty rates. Investments in instruction, especially high-quality teachers, appear to leverage the largest marginal gains in performance. School funding reforms in several states have created the conditions for stronger educational outcomes. These reforms funded schools more equitably and provided access to well-prepared and well-supported teachers; standards, curriculum, and assessments focused on 21st-century learning goals; schools organized productively for student and teacher learning; and supportive early learning environments. This report examines these efforts in four states: Connecticut, Massachusetts, New Jersey, and North Carolina. Their experiences demonstrate that, in the U.S., equity-focused changes can yield results for students but also require steady work.