hiw3c 日报精选
Hacker News Top 网页快照

法院:第四修正案禁止使用人工智能生成的“合理依据”

原文标题 · Court: 4th Amendment Disallows Use Of AI-Generated 'Probable Cause'

HN ⭐ 49 · 14 评论

来源:Hacker News Top · www.techdirt.com

正文为英文,可一键机器翻译(仅首次需要等待)

Court Tells Cops That The 4th Amendment Doesn’t Cover AI-Generated ‘Probable Cause’

from the remember-that-time-robocop-shot-the-Constitution-in-the-dick dept

I don’t know where this decision will take us, but its implications reach much further than the single case it covers. AI is pretty much everywhere, and if a court says an algorithm can’t make probable cause determinations, it affects/infects everything from facial recognition tech to predictive policing software to Axon adding AI shovelware to its omnipresent body cameras under the (correct) assumption cops don’t like writing reports.

In this case, Alain Osorio was arrested for allegedly passing a bad check at local bank. The only pictures of the suspect came from the bank’s CCTV footage. This was handed over to Detective Ryan Kilmer of the Florence (KY) Police Department.

The detective decided to run a screenshot of the suspect’s face (derived from the CCTV footage) through the PD’s facial recognition program. The decision [PDF] doesn’t specify which facial recognition program was used, but given that the match was made using photos found on Facebook, it suggests Clearview AI might have been involved, given its scraping of hundreds of billions of images from the open web since its inception.

Not that it did anything useful in terms of actual detective work. Nor did it do anything remotely constitutional, not when the operative word in “probable cause” is “probable.”

Relying solely on the AI identification, Detective Kilmer concluded that the match was accurate. [Id. at 4–5]. The Facebook profile belonged to an individual known as “Yony Smith Npoles Charon,” and for an unknown reason, Detective Kilmer concluded that “Yony” was actually Alain Vizcay Osorio—the man in the booking photo.

The court says “for an unknown reason.” I can make an educated guess, however. Passing a bad check is the sort of crime most cops won’t really dig into. Detective Kilmer was handed the case and did the bare minimum: he ran an AI-assisted search. He didn’t actually do anything that resembled actual detective work. But he still felt his 30 seconds of non-existent effort were enough to support a criminal complaint and the issuance of an arrest warrant.

Osorio — who lived in Nebraska — was arrested and extradited to Kentucky to face criminal charges. He was released on bond the day after his arrest (January 24, 2025). He was then indicted by a grand jury in March 2025 and arraigned roughly two months later. Again, Osorio pleaded not guilty. At that point, the state’s attorney’s office dismissed the charges after Osorio provided proof he had been working in Nebraska at the time the bad check was being passed by (the presumably still at-large) suspect captured by the bank’s security camera.

The only thing the AI used by the detective seemed to be capable of doing was reinforcing the investigator’s “all Black people look the same” prejudices. (To be clear, I don’t specifically know if this detective has these prejudices, but the chain of events in this case certainly support an assumption of this person’s assumptions, if you catch my drift.)

The individuals in the security footage and the Facebook profile image do not resemble the booking photo of Osorio. [Id. at 6–7]. Based on the booking photo, the only thing Osorio has in common with the suspect is that he is a black male with facial hair. [Dkt. 3-1 at 2–3]. Based on the photographs, it appears that Osorio has a different head shape, different haircut, different facial features, and different complexion .

Detective Kilmer told the court (via his affidavit) that he had used “investigative tools” to “match” Osario to the suspect. In reality, the court says, Kilmer only used a single tool and rolled with its obviously faulty conclusions despite Florence PD policy specifically stating facial recognition AI alone is not enough to “establish probable cause.”

Kilmer runs directly into this policy and the Fourth Amendment itself, which poses multiple problems for his desire to walk away fiscally intact from this lawsuit. The policy is undeniable, which means Kilmer deliberately ignored his “training” and any “expertise” it was supposed to impart.

But beyond that, there’s the Fourth Amendment itself, which can’t as easily be ignored as cop shop software clickwrap. That much is made perfectly clear in the court’s introductory paragraph:

The Fourth Amendment to the United States Constitution does not allow a detective to delegate to AI the task of assessing probable cause. In other words, the Fourth Amendment does not permit an individual to be arrested based on nothing more than an uncorroborated conclusion by AI that the individual in question has committed a crime. And no reasonable detective in the Defendant’s position could conclude otherwise.

The first part of that suggests implications far beyond this case, given how often “detectives” are letting their fingers do the walking (so to speak) and pretending whatever the computer coughs up is arrest-worthy. That’s not just the facial recognition tech used in this case. This is also the AI that steers patrols and public interactions via so-called “predictive policing.” That’s also the AI that writes reports for police officers, allowing the computer to create the permanent, official record of stops, arrests, and uses of force.

But what’s also important is the last sentence of that paragraph. That’s the thing that’s going to make this stick. The detective isn’t shielded by qualified immunity, which means this is sure to be appealed. But if this officer does this (rather than “allow” the people who he’s supposed to be serving to buy him out of a lawsuit via a settlement), he’s going to make this an appellate case. And there’s definitely no reason to assume the higher court is just going to blow off the obvious concerns raised by this lawsuit and allow QI to cover up this compendium of wrongs.

For now, the decision stands as it is: AI isn’t probable cause. Never has been. Never should be. And if this court has anything to say about it, it never will be. Detectives who prefer to let computers do their thinking for them might want to dial back their reliance on algorithms. Justice should never be subject to available processing power. And if you lack the desire (or intelligence!) to do detective work properly, well…

Filed Under: 4th amendment , ai , facial recognition , facial recognition tech , false positives , florence pd , kentucky , mass surveillance , probable cause

Oh Sure, NOW Nick Clegg Tells Tech Bros They Were Wrong To Back Trump

Nvidia And The Trump Administration Begin 'Investigating' Themselves In Wake Of Blossoming Scandal

Automakers Ramp Up Scare-Mongering Push To Ban Chinese EVs. You Know, 'For Privacy'

NYC Mayor Mamdani Disbands NYPD Unit That Treated Protesters Like Terrorists

Our Dipshit DHS Secretary's Outage Expert: "One Guy That's Very Smart With Tech"

Comments on “Court Tells Cops That The 4th Amendment Doesn’t Cover AI-Generated ‘Probable Cause’”

Wow. So many failures in our “justice” system.

It’s funny how some people have to prove they are innocent of charges made without evidence, while others get to be free while cops build an airtight case.

Relying solely on the AI identification, Detective Kilmer concluded that the match was accurate. [Id. at 4–5]. The Facebook profile belonged to an individual known as “Yony Smith Npoles Charon,” and for an unknown reason, Detective Kilmer concluded that “Yony” was actually Alain Vizcay Osorio—the man in the booking photo

Even if AI were sufficient, surely the fact that the AI identified someone with a different name should meant that there was no probable cause.

Wife got called in several times prior to our meeting. She pointed out the 4th when the officer said he had a “hunch” the person was the perp

“How does a hunch pass the 4th Amendment?”

They did not ask her back after that. So much for impartial grand juries if they selectively not call jurors because they know the Constitution

Funny how knowing the law makes impartiality an impossibility, huh?

You cannot be “blacklisted” from jury duty. Your wife simply hasn’t been picked since then. It’s actually completely random who gets called. Sometimes you get called twice in a year. Sometimes you go decades without a summons.

Why do we have so many idiots posing as police officers?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread.

Signing in brings you back to this comment.

Add Your Comment Cancel reply

Techdirt Daily Newsletter

A weekly news podcast from Mike Masnick & Ben Whitelaw

The Techdirt Greenhouse

Winding Down Our Latest Greenhouse Panel: The Lessons Learned From SOPA/PIPA

From The Revolt Against SOPA To The EU's Upload Filters

Did We Miss Our Best Chance At Regulating The Internet?

Thursday

Wednesday

Email This Story

This feature is only available to registered users. You can register here or sign in to use it.

Tools & Services

Company

Contact

More