LIVE · cybersecurity feed
Live wire
ai

NCSC Urges Stronger Controls for Agentic AI Systems

NCSC urged sandboxing, oversight and tight access controls for autonomous AI agents

zeroday.news ·

The UK National Cyber Security Centre (NCSC) has issued interim guidance urging organizations to implement stronger controls for autonomous AI agents. The advice, published on August 20, recommends sandboxing, human oversight, and tightly controlled access to mitigate risks from unintended or malicious agent activity. This follows previous NCSC guidance on securing agentic AI use and comes amidst ongoing development of governance frameworks for increasingly autonomous systems. The NCSC noted that formal guidance is still under development and will eventually supersede the current blog post.

Organizations are advised to first assess the necessary level of autonomy for a system and identify potential failure points before deployment. The NCSC recommends threat-modeling the agent's prompts, tools, networks, and accessible services to determine required controls. It explicitly warns against relying solely on safeguards built into underlying models or agent frameworks, as these can be bypassed or prove insufficient in high-risk scenarios.

For higher-risk deployments, the NCSC suggests running agents in robust sandboxes and restricting their access to only the resources essential for a given task. Network controls should deny connectivity by default, utilizing allowlists or service-aware proxies for necessary connections. The agency also recommends separating agent execution, supporting infrastructure, and inference services where feasible. A key concern highlighted is the potential for agents to discover configuration weaknesses or vulnerabilities in their technical controls, which could lead to sandbox escapes.

Each agent should be assigned a distinct identity with credentials limited to those required for its task, ideally using short-lived credentials. Organizations should consider API keys, OAuth grants, SSH keys, and authenticated sessions as part of an agent's potential "blast radius."

Human oversight is crucial for higher-risk activities, with clear responsibility for agent operations, real-time monitoring, and the ability to intervene in unexpected behavior. Agent activity should be logged and monitored as part of security operations and incident response. The NCSC also emphasizes the importance of being able to immediately halt autonomous activity, including restricting network access and communications with model infrastructure when necessary.

The agency stressed that this advice should evolve with the technology, and organizations should regularly reassess whether the autonomy granted to agents remains proportionate to their risk tolerance. The guidance comes as the cybersecurity community continues to grapple with the implications of advanced AI systems, with other initiatives like the OWASP Agentic AI Security Maturity Framework also emerging to address these challenges.

ai
ShareXLinkedInWhatsAppFacebook

More News

view all →
cloud security

Cloudflare Launches Bot Preference Sync for AI Traffic Management

Cloudflare has introduced Bot Preference Sync, a new feature designed to simplify the management of AI bot traffic. This tool automatically updates a website's robots.txt file to align with the user's AI bot configuration settings. The goal is to prevent discrepancies between stated preferences and enforced rules, ensuring better control over how AI crawlers access and use website content.

ai

Say it once: introducing Bot Preference Sync

Cloudflare's new Bot Preference Sync automatically aligns your robots.txt file with your AI bot policies for Search, Agent, and Training. Easily manage which bots access your content without maintaining static files.

security

Your Expired Visa Card Could Be ‘Zombified’ to Make Contactless Payments

Plus: Apple sends out an “unprecedented” number of spyware warnings, Ukraine hits a Russian ecommerce giant with cyber and drone attacks, and more.

malwarehigh

Malware Hijacks Android Car Head Units

Researchers have identified new Android malware that hijacks car head units by exploiting their official update mechanisms. The malware installs proxy software, turning vehicles into nodes for the BADBOX botnet, primarily for ad fraud and to provide anonymized internet connections. This marks the first documented instance of malware specifically targeting car head units through their native update channels.

malware

Banking Trojans Manic, Grandoreiro, ToxicPanda 2.0 in the Spotlight

The spyware-equipped Manic, a persistent Grandoreiro campaign in Latin America and Europe, and an expanded ToxicPanda 2.0 malware. The post Banking Trojans Manic, Grandoreiro, ToxicPanda 2.0 in the Spotlight appeared first on SecurityWeek.

nasacritical

Critical Flaw in NASA/JPL Open-Source Spacecraft Command Software Allowed Unauthenticated Command Execution

A critical vulnerability has been discovered in NASA/JPL's open-source AIT-GUI software, which is used to control spacecraft instruments. The flaw allows unauthenticated attackers to execute arbitrary commands, run server-side scripts, and manipulate command sequences by exploiting a lack of authentication, session checks, and CSRF protection. Researchers confirmed the issue, which has a CVSS score of 9.4, and a fix is available in version 2.5.2.