cross-posted from: https://programming.dev/post/37726760
- Guardrails can be bypassed: With prompt injection, ChatGPT agents can be manipulated into breaking built-in policies and solving CAPTCHAs.
- CAPTCHA defenses are weakening: The agent solved not only simple CAPTCHAs but also image-based ones - even adjusting its cursor to mimic human behavior.
- Enterprise risk is real: Attackers could reframe real controls as “fake” to bypass them, underscoring the need for context integrity, memory hygiene, and continuous red teaming.
It’s been obsolete for years. AI just makes it easy.
I mean the data from those has been used for AI training for ages so it’s hardly surprising it got good at it.
I’ve had a captcha solver browser extension for as long as captchas existed. Anyone believing reCaptcha’s claim that it was ever about bot prevention is a goddamn moron
Which one do you use? I’ve used a handful over the years and they all stop working for me.
Currently it’s Buster: Captcha Solver for Humans (chromium)
Awesome, thanks! I’ll give that a shot. Although I use Firefox so I’ll have to see if they make it for non chromium.
It’s about making headless bots unreasonably expensive to make massive requests with.
ChatGPT joins The Human League?
appropriate given they’ve been screaming “DON’T YOU WANT ME” at disinterested parties all this time
