press release
Published: 07 August 2019

Evidence reveals risk assessment algorithms show bias against Hispanic population

By Laura Butler

Automated risk assessment has become increasingly popular in the criminal justice system, but a new study – published in the American Criminal Law Review – assessed the accuracy, validity and predictive ability of a risk assessment algorithm tool to reveal algorithmic unfairness against Hispanics.

Risk assessment can be an objective way to reduce rates of imprisonment without jeopardising public safety, and criminal justice officials are increasingly reliant on algorithmic processing to inform decisions on managing offenders according to their risk profiles. However, there is alarming evidence to suggest that risk algorithms are potentially biased against minority groups.

Reader in Law and Criminal Justice at the University of Surrey Dr Melissa Hamilton used a large dataset of pre-trial defendants who were scored on COMPAS – a widely-used algorithmic risk assessment tool – soon after their arrests to evaluate the impact of this algorithmic tool specifically on the Hispanic minority group.

Dr Hamilton said: “There is a misconception that algorithmic risk assessment tools developed using big data automatically represent a transparent, consistent and logical method for classifying offenders. My research suggests that risk tools can deliver unequal results for minority groups if they fail to consider their cultural differences. Bias occurs when risk tools are normed largely on one group, for example White samples, as they provide inaccurate predictions for minority groups as a result.

“Cumulative evidence showed that COMPAS consistently exhibited unfair and biased algorithmic results for those of Hispanic ethnicity, with statistics presenting differential validity and differential predictive ability. The tool fails to accurately predict actual outcomes, subsequently overpredicting the level of risk of reoffending for Hispanic pre-trial defendants.”

Whilst there have been impressive advances in behavioural sciences, the availability of big data and statistical modelling, justice officials should be aware that greater care is needed to ensure that proper validation studies are conducted prior to the use of an algorithmic risk tool, to confirm that it is fair for its intended population and subpopulations.

Share what you've read?

Media Contacts

Laura Butler
Phone: +44 (0)1483 683075

External Communications and PR team
Phone: +44 (0)1483 684380 / 688914 / 684378
Out of hours: +44 (0)7773 479911