Technical Flaws of Pretrial Risk Assessments Raise Grave Concerns


No known copyright restriction

Smithsonian American Art Museum, Bequest of Florence Couldon Davis

By Chelsea Barabas, Karthik Dinakar, and Colin Doyle

Twenty-seven prominent  researchers from MIT,  Harvard, Princeton, NYU,  UC Berkeley and Columbia have signed an open statement of concern regarding the use of actuarial risk assessment as a means of lowering pretrial jail populations.  

Actuarial pretrial risk assessments suffer from serious technical flaws that undermine their accuracy, validity, and effectiveness. They do not accurately measure the risks that judges are required by law to consider. When predicting flight and danger, many tools use inexact and overly broad definitions of those risks. When predicting violence, no tool available today can adequately distinguish one person’s risk of violence from another. Misleading risk labels hide the uncertainty of these high-stakes predictions and can lead judges to overestimate the risk and prevalence of pretrial violence. To generate predictions, risk assessments rely on deeply flawed data, such as historical records of arrests, charges, convictions, and sentences. This data is neither a reliable nor a neutral measure of underlying criminal activity. Decades of research have shown that, for the same conduct, African-American and Latinx people are more likely to be arrested, prosecuted, convicted and sentenced to harsher punishments than their white counterparts. Risk assessments that incorporate this distorted data will produce distorted results. These problems cannot be resolved with technical fixes. We strongly recommend turning to other reforms.

This statement of concern has been submitted to the following jurisdictions for consideration:

Related Content