7
A-C-E
6y

Does the ease of “hacking”/breaking AI scare anyone else?

I remember a slide from a security presentation I saw once where there were three sections, the first was an AI classification of some animal with about 60% confidence, the second was a small grey static (think old tv static type thing) with a label next to it saying 10% and the third was an AI classification of the first picture overplayed with 10% of that noise and it had 95% confidence that the animal was COMPLETELY DIFFERENT.

Adding just 10% noise and AI goes batshit crazy. (No it was not a bat afaik)

THINK ABOUT THIS IN TERMS OF STOP SIGNS. WELP.

Comments
  • 2
    We're talking self-driving cars yet .NET error messages still don't accurately pinpoint the errors.

    AI my arse.
  • 1
    I have read an article about how road signs can be manipulated with just a few stickers. Not even noticeable for humans but for car's computer vision the stop sign turned into a speed limit sign
  • 1
    @lucaIO don’t even get me started on graffiti. Some cities have tons of it and I’m sure it’s on stop signs too.

    Wouldn’t it be better to embed microchips or like RFID or something in the road to communicate that information instead? Then that can’t as easily be tampered with and it’s LOADS more concrete (😏) than trying to visually recognize a sign.
Add Comment