Cornell University researchers have revealed that ChatGPT agents can be manipulated to bypass CAPTCHA protections and internal safety rules, raising serious concerns about the security of large language models (LLMs) in enterprise environments.

By using a technique known as prompt injection, the team demonstrated that even advanced anti-bot systems and AI guardrails can be circumvented when contextual manipulation is involved.

Read More