Benjamin L. Castleman
Noncredit Workforce Training, Industry Credentials, and Labor Market Outcomes
Many public workforce training programs lead to industry-recognized, third-party awarded credentials, but little research has been conducted on the economic benefits of these credentials in the labor market. This paper provides quasi-experimental evidence on the labor market returns to industry-… more →
Do Financial Incentives Increase the Impact of National-Scale Educational Programs? Experimental Evidence from a National College Advising Initiative
Recent work highlights the challenge of scaling evidence-based educational programs. We report on a randomized controlled trial of a financial incentive program designed to increase the efficacy of a national remote college advising initiative for high-achieving students. We find substantial… more →
Are Algorithms Biased in Education? Exploring Racial Bias in Predicting Community College Student Success
Predictive analytics are increasingly pervasive in higher education. However, algorithmic bias has the potential to reinforce racial inequities in postsecondary success. We provide a comprehensive and translational investigation of algorithmic bias in two separate prediction models -- one… more →
Human versus Machine: Do college advisors outperform a machine-learning algorithm in predicting student enrollment?
Tags: Higher education, EquityPrediction algorithms are used across public policy domains to aid in the identification of at-risk individuals and guide service provision or resource allocation. While growing research has investigated concerns of algorithmic bias, much less research has compared algorithmically-driven… more →
Is Big Data Better? LMS Data and Predictive Analytic Performance in Postsecondary Education
Tags: Instructional technologyColleges have increasingly turned to data science applications to improve student outcomes. One prominent application is to predict students’ risk of failing a course. In this paper, we investigate whether incorporating data from learning management systems (LMS)--which captures detailed… more →
Crossing the Finish Line but Losing the Race? Socioeconomic Inequalities in the Labor Market Trajectories of Community College Graduates
Despite decades and hundreds of billions of dollars of federal and state investment in policies to promote postsecondary educational attainment as a key lever for increasing the economic mobility of lower-income populations, research continues to show large and meaningful differences in the mid-… more →
Can Information and Advising Affect Postsecondary Participation and Attainment for Non-Traditional Students? Evidence from a Large-Scale Experiment with the U.S. Army
Tags: Higher education, Student supportsNon-traditional students disproportionately enroll in institutions with weaker graduation and earnings outcomes. One hypothesis is that these students would have made different choices had they been provided with better information or supports during the decision-making process. We conducted a… more →
Finishing the Last Lap: Experimental Evidence on Strategies to Increase College Completion for Students At Risk of Late Withdrawal
Nearly half of students who enter college do not graduate. The majority of efforts to increase college completion have focused on supporting students before or soon after they enter college, yet many students drop out after making significant progress towards their degree. In this paper, we… more →
The Bottom Line on College Advising: Large Increases in Degree Attainment
We combine a large multi-site randomized control trial with administrative and survey data to demonstrate that intensive advising during high school and college leads to large increases in bachelor's degree attainment. Novel causal forest methods suggest that these increases are driven primarily… more →
Bringing Transparency to Predictive Analytics: A Systematic Comparison of Predictive Modeling Methods in Higher Education
Topics: MethodsColleges have increasingly turned to predictive analytics to target at-risk students for additional support. Most of the predictive analytic applications in higher education are proprietary, with private companies offering little transparency about their underlying models.
Pushing College Advising Forward: Experimental Evidence on Intensive Advising and College Success
While Hispanic students represent the fasting-growing segment of the American school-age population, substantial gaps exist in college enrollment and Bachelor’s attainment between Hispanic and White and Asian students. Numerous factors contribute to these disparities and disproportionally affect… more →
Stacking the Deck for Employment Success: Labor Market Returns to Stackable Credentials
With rapid technological transformations to the labor market, many working adults return to college after graduation to obtain additional training or credentials. Using a comparative individual fixed effects strategy and an administrative panel dataset of enrollment and employment in Virginia, we… more →
Negative Impacts From the Shift to Online Learning During the COVID-19 Crisis: Evidence from a Statewide Community College System
Topics: Student LearningThe COVID-19 pandemic led to an abrupt shift from in-person to virtual instruction in Spring 2020. We use two complementary difference-in differences frameworks, one that leverages within-instructor-by-course variation on whether students started their Spring 2020 courses in person or online and… more →
Unfinished Business? Academic and Labor Market Profile of Adults with Substantial College Credits But No Degree
Recent state policy efforts have focused on increasing attainment among adults with some college but no degree (SCND). Yet little is actually known about the SCND population. Using data from the Virginia Community College System (VCCS), we provide the first detailed profile on the academic,… more →
College Advising at a National Scale: Experimental Evidence from the CollegePoint initiative
In-person college advising programs generate large improvements in college persistence and success for low-income students but face numerous barriers to scale. Remote advising models offer a promising strategy to address informational and assistance barriers facing the substantial majority of… more →
Nudging at Scale: Experimental Evidence from FAFSA Completion Campaigns
Kelli A. Bird, Benjamin L. Castleman, Jeffrey T. Denning, Joshua Goodman, Cait Lamberton, Kelly Ochs Rosinger.Tags: Higher education, Student supportsDo nudge interventions that have generated positive impacts at a local level maintain efficacy when scaled state or nationwide? What specific mechanisms explain the positive impacts of promising smaller-scale nudges? We investigate, through two randomized controlled trials, the impact of a… more →
Nudges Don’t Work When the Benefits Are Ambiguous: Evidence from a High-Stakes Education Program
Tags: Higher educationThe Post-9/11 GI Bill allows service members to transfer generous education benefits to a dependent. We run a large scale experiment that encourages service members to consider the transfer option among a population that includes individuals for whom the transfer benefits are clear and… more →
The Effect of Reduced Student Loan Borrowing on Academic Performance and Default: Evidence from a Loan Counseling Experiment
Topics: Policy, Politics, and GovernanceTags: Higher education, EquityStudent loan borrowing for higher education has emerged as a top policy concern. Policy makers at the institutional, state, and federal levels have pursued a variety of strategies to inform students about loan origination processes and how much a student has cumulatively borrowed, and to provide… more →
A comparison of postsecondary outcomes for Army service members, Veterans, and civilians
Despite broad public interest in Veterans' education, there is relatively little evidence documenting the postsecondary trajectories of military service members after they return to civilian life. In the current report we investigate how U.S. Army service member college… more →