LIVE · cybersecurity feed
Live wire
ai

Encrypted Prompts Bypass AI Safety Guardrails in Grok and Gemini

Researchers say the new ‘Cryptographic Context Injection’ technique conceals malicious instructions until they are decrypted inside a trusted execution environment. The post Encrypted Prompts Bypass AI Safety Guardrails in Grok and Gemini appeared first on SecurityWeek.

zeroday.news ·

A new technique, dubbed ‘Cryptographic Context Injection,’ has reportedly demonstrated the ability to bypass AI safety guardrails in models such as Grok and Gemini. This method involves concealing malicious instructions within encrypted prompts, which are then decrypted only within a trusted execution environment, effectively circumventing the AI’s pre-processing safety mechanisms.

The core mechanism of Cryptographic Context Injection relies on the principle of late decryption. Instead of the AI model directly receiving and processing a plaintext prompt, it receives an encrypted payload. This payload contains the malicious instructions, but they remain unreadable and therefore undetectable by the AI’s initial safety filters and content moderation systems. The critical step occurs when this encrypted prompt is passed to a trusted execution environment (TEE), a secure area within a computer system.

Within the TEE, the encrypted prompt is decrypted. This decryption process reveals the hidden malicious instructions, which are then presented to the AI model as if they were part of a legitimate, unflagged input. Because the decryption happens within a secure, isolated environment, the AI’s external safety guardrails, designed to detect and block harmful content at the input stage, are bypassed entirely. The AI model then processes these newly revealed instructions without the benefit of its intended protective measures.

This class of attack highlights a significant challenge in securing advanced AI systems. Many AI safety guardrails operate by analyzing incoming prompts for keywords, patterns, or semantic indicators of harmful content. By encrypting the prompt, attackers can render these surface-level analyses ineffective. Products in the large language model (LLM) category, particularly those with sophisticated content filtering, could be vulnerable if they do not adequately account for scenarios where input processing is decoupled from initial safety checks.

The reported bypass affects Grok and Gemini, indicating that advanced AI models from different developers may share common architectural vulnerabilities or design patterns that this technique exploits. While specific details on the implementation of the trusted execution environment or the encryption scheme were not provided, the general concept suggests that any system relying on pre-processing safety filters could be susceptible if it can be induced to decrypt and execute instructions from an untrusted, encrypted source within a privileged context.

Mitigation for this type of vulnerability typically involves a multi-layered approach. Enhancing the security of trusted execution environments to prevent them from decrypting and passing potentially malicious content to the AI is crucial. Furthermore, AI safety mechanisms might need to evolve to incorporate post-decryption analysis within the TEE, or to verify the integrity and origin of decrypted prompts before allowing them to influence the AI’s behavior. Input validation and sanitization, even after decryption, remain critical.

This development underscores the ongoing arms race between AI developers and those seeking to exploit these powerful systems. As AI models become more integrated into critical applications, the methods for ensuring their safe and ethical operation must constantly adapt to novel attack vectors that circumvent traditional security paradigms. The focus shifts from merely filtering visible inputs to securing the entire processing pipeline, especially when sensitive operations like decryption occur.

ai
ShareXLinkedInWhatsAppFacebook

More News

view all →
vulnerability

In Other News: Zombie Card Attack, T-Mobile Cut Cable to Stop Hackers, GitHub Denies AI Caused Bug

Other noteworthy stories that might have slipped under the radar: Threema DDoS attack, Evooo1Bot Linux botnet, Crypto4A secures top-tier NIST certification. The post In Other News: Zombie Card Attack, T-Mobile Cut Cable to Stop Hackers, GitHub Denies AI Caused Bug appeared first on SecurityWeek.

security

Lawmakers seek watchdog review of federal hacking of Americans

Sen. Ron Wyden and Rep. Greg Casar want a GAO probe on the government’s use of spyware and other sophisticated hacking tools and authorities. The post Lawmakers seek watchdog review of federal hacking of Americans appeared first on CyberScoop.

ransomware

Canada’s Hospital for Sick Children attacked by cybercriminals again as employee data stolen

The Hospital for Sick Children — which was hit in a ransomware incident in 2022 that disabled some of its systems — released a statement on Thursday warning of a data theft incident they believe is tied to a third-party software application.

phishing

New Phishing Toolkit Uses Passkeys to Maintain Access After Password Resets

Researchers say iAuthFlow V2 can register an attacker-controlled passkey, enabling persistent access even after passwords are changed and active sessions revoked. The post New Phishing Toolkit Uses Passkeys to Maintain Access After Password Resets appeared first on SecurityWeek.

security

Zombie Card: An expired Visa credit card can be used for purchases

Scientific research showed that the expiration date on some Visa credit cards can be manipulated in so-called Zombie Card attacks.

security

Calling on Cyber Pros to Help Defend City Hall

Government agencies with smaller budgets need support — and here's how you can help.