🔗 Share this article

Law enforcement agencies across the UK effectively campaigned to deploy a facial recognition system acknowledged as biased against females, youths, and individuals from ethnic minority groups, following complaints that a less biased version generated fewer potential suspects.

The Technology in Practice

British police use the national police database to conduct searches using historical face recognition. This process involves matching a “probe image” of a person of interest against a database of more than 19 million mugshots to find possible hits.

Admitted Bias

The Home Office admitted last week that the system was flawed. This acknowledgment followed a review by the National Physical Laboratory (NPL) determined it incorrectly matched people of Black and Asian heritage and women at much greater frequency than Caucasian males. The ministry said it “took steps on the findings”.

“It prompts the issue of whether facial recognition only becomes effective if users accept biases in race and sex. Operational ease is a poor argument for overriding basic freedoms.”

Long-Standing Problem

Internal documents reveal that this bias has been recognized for over twelve months. Furthermore, law enforcement lobbied to reverse an earlier ruling that was intended to address the problem.

Senior officers were informed of the algorithmic discrimination in late 2024. The Home Office-commissioned laboratory study concluded the system was more likely to suggest incorrect matches for photos of women, Black people, and those aged 40 and under.

A Reversed Decision

In reaction, the national police leadership body mandated that the confidence threshold required for possible hits be increased to a point where the bias was significantly reduced.

However, this decision was overturned the following month following complaints from police that the modified technology was generating fewer “useful lines of inquiry”. Internal records indicate the higher threshold cut the number of searches resulting in potential matches from 56% to a just under 15%.

Severe Disparities

Although the authorities refused to say what threshold is now in operation, the latest independent review discovered the system could generate false positives for Black women nearly a hundred times more often than for white women at specific configurations.

The ministry commented on these findings: “The testing found that in a limited set of circumstances the algorithm is has a greater tendency to incorrectly include some population segments in its match reports.”

Balancing Utility and Fairness

Outlining the impact of the temporary raise to the system's accuracy setting, the NPCC documents state: “This adjustment significantly reduces the effect of bias across protected characteristics of race, generation and gender but had a significant negative impact on operational effectiveness”. The papers further note that police units complained that “a once effective tactic returned outcomes of limited benefit”.

Wider Implementation Proposals

Meanwhile, the UK administration has launched a two-and-a-half-month consultation on its plans to expand the use of biometric scanning systems. Policing minister the relevant minister has labeled the tool as the “most significant advance since genetic fingerprinting”.

Expert and Oversight Concerns

The chair of a police oversight board, chair of the advisory panel for the police race action plan, said: “We observed scant discussion through race action plan meetings of the technology deployment even with clear relevance with the strategy's goals.

“These revelations demonstrate yet again that the pledges to combat discrimination the police has made through the race action plan are failing to be integrated into wider practice. Independent assessments have warned that innovative tools are being implemented in a landscape where racial disparities, inadequate oversight and faulty information gathering continue to exist.

“All deployment of this technology must meet rigorous official guidelines, be subject to external review, and prove it reduces rather than exacerbates racial disparity.”

Home Office Response

A government representative said: “We takes the findings of the study seriously and we have implemented changes. A new algorithm has been independently tested and acquired, which has no statistically significant bias. It will be trialled early next year and will be undergo further assessment.

“Our priority is protecting the public. This gamechanging technology will support officers to apprehend and prosecute offenders. There is officer review in each stage of the process and no arrest or charge would be taken without trained officers carefully reviewing the output.”