LIVE · cybersecurity feed
Live wire
vulnerability

Prompt injection isn't the bug, AI agent frameworks are

Check Point researchers tried to break the frameworks enterprises use to build AI apps. Now they're telling Black Hat attendees what they found

zeroday.news · 1h ago

Researchers have identified nearly a dozen critical vulnerabilities in several prominent AI agent frameworks, including LangChain, LangGraph, CrewAI, AutoGen, Microsoft Agent Framework, and Google ADK. These flaws, discovered by Check Point researchers Yarden Porat and Shahar Tal, highlight a systemic security issue in the underlying architecture of AI applications, extending beyond mere prompt injection attacks. The findings were presented at a recent Black Hat conference.

The researchers spent a year investigating these frameworks and found 11 vulnerabilities, many of which are familiar bug classes such as insecure deserialization, server-side request forgeries, path traversals, and use-after-free errors. According to the researchers, these are vulnerabilities that security professionals learned to address decades ago, yet they are now appearing in the foundational layers of AI agents that handle sensitive data and operations. The core problem, they argue, is not the AI model itself, but the "plumbing around the model" that has been overlooked in the rapid development of these frameworks.

A critical insecure deserialization vulnerability was discovered in the Microsoft Agent Framework. This flaw allowed attacker-controlled content, introduced via prompt injection, to cross the security boundary into trusted framework logic. Specifically, the agent's checkpoint mechanism, which saves and reloads an agent's state, could be exploited. An attacker could plant a malicious payload in a message, and when another user's session was rewound to an earlier state, the payload would be triggered, leading to remote code execution on the server. Microsoft confirmed the findings, paid a $10,000 bug bounty, and released protections to harden the framework. However, because the framework was not generally available at the time of discovery, a CVE was not issued. Microsoft stated that it updated the specific checkpoint file with additional language to define the security boundary.

Similar issues were found in Google ADK (Agent Development Kit). The researchers identified a vulnerability where ADK's built-in development assistant, capable of writing files, remained accessible via an HTTP API even when hidden from the application listing. An attacker could exploit this by creating a session, instructing ADK to write an agent with Python code that executes at import time, and then requesting the server to run this agent. Since there is no authentication on this API by default, and `adk deploy cloud_run` publishes the same API, a default Cloud Run deployment could be compromised without credentials, potentially granting access to environment API keys and the container's Google Cloud service account. Google initially disputed the severity of the issue, but after further argumentation from the researchers regarding the potential for secret theft, paid a $3,133.70 bounty and implemented a partial fix.

In total, the researchers received $17,133.70 in bug bounties for their disclosures. The prevalence of these "old" bug classes across multiple frameworks suggests a widespread oversight in the security practices applied to AI agent development. The researchers emphasize that the problem is not isolated to a single vendor but represents a common failure in how these critical AI application layers are being constructed.

vulnerabilityai
ShareXLinkedInWhatsAppFacebook

More News

view all →
breach

Hackers run khunt post-exploitation toolkit from Oracle database

Hackers exploited a SQL injection vulnerability to install a post-exploitation toolkit directly inside an Oracle database that was used to breach a corporate network. [...]

vulnerability

Pre-auth RCE in enterprise Java hits Bonita and OFBiz servers

An attacker sends a single web request to a Bonita server and lands inside an internal API that assumed nobody could reach it. The request arrives unauthenticated. From there the attacker runs code on the host. Bonita BPM handles loan approvals, insurance claims, and employee onboarding for banks, insurers, and government agencies, and its internal surface answers to strangers. Vulnerability resea

vulnerability

Flaws in Google APK for Python Unlock Agent-to-Agent Attack

Google has fixed the issues, which exploited a trust boundary between two AI agents with different privilege levels to trigger automation that could compromise the supply chain.

ai

Shai-Hulud strikes again: CHAINDROP worm hits 400+ npm packages

Elastic Security Labs identified the return of Shai-Hulud. Attackers compromised the keyv maintainer and deployed CHAINDROP, a worm that uses stolen npm credentials to backdoor co-owned packages totaling over 1.3 billion monthly downloads.

cloud

Canadian pleads guilty to Snowflake cloud data-theft attacks

A Canadian man pleaded guilty today to his role in accessing company accounts at cloud storage provider Snowflake and stealing data from at least 165 organizations in a scheme to extort millions of dollars from victims. [...]

security

Snowflake hacker pleads guilty, faces up to 32 years in prison

Connor Moucka obtained almost $500,000 for playing a key role in one of the most widespread and damaging cyberattack sprees on record. The post Snowflake hacker pleads guilty, faces up to 32 years in prison appeared first on CyberScoop.