LIVE · cybersecurity feed
Live wire
aimedium

OpenAI previews privacy-focused system for detecting AI misuse

OpenAI has announced a new system, Private Safety Processing, designed to enhance the detection of AI misuse while maintaining user privacy. The company is currently previewing this system with select early customers and plans a broader rollout, along with the publication of a technical white paper, in September.

ZeroDay News ·

Source: Help Net Security

OpenAI has announced a new system, Private Safety Processing, designed to enhance the detection of AI misuse while maintaining user privacy. The company is currently previewing this system with select early customers and plans a broader rollout, along with the publication of a technical white paper, in September.

Private Safety Processing aims to identify patterns of potential misuse across related user interactions without allowing OpenAI personnel to access the underlying content of those interactions. This builds upon existing automated safety measures that typically evaluate requests individually.

For eligible API customers utilizing Zero Data Retention (ZDR), prompts and model responses are not retained after processing. An exception is made for images flagged as potential Child Sexual Abuse Material (CSAM), which may be retained for manual review and reporting to authorities. OpenAI has also stated that enterprise customer data is not used for model training unless customers explicitly opt in.

The ZDR deployment model involves customers retaining content on their own infrastructure. OpenAI is also developing an alternative where content would be stored on the company's infrastructure, secured with customer-controlled encryption keys. In both configurations, automated systems are designed to identify potential misuse and transmit limited safety signals without revealing the actual prompts or responses.

When the system detects a potential risk, OpenAI receives a defined signal indicating the nature of the activity. This information can then inform enforcement decisions. Customers have the ability to investigate alerts using data within their own systems and can share relevant details with OpenAI to appeal a decision, clarify legitimate activities, or support investigations into verified abuse.

OpenAI emphasized that addressing emerging risks in AI requires collaborative efforts, and Private Safety Processing has been shaped by input from customers across various industries, regions, and company sizes. The company highlighted the importance of protecting sensitive data and ensuring accuracy and integrity, particularly in sectors like healthcare, to build trust with users.

aiprivacysecuritydata protectionopenai
ShareXLinkedInWhatsAppFacebook

More News

view all →
breach

Criminal IP Introduces AITEM as the Next Evolution of Attack Surface Management

AI SPERA, the company behind the cyber threat intelligence platform Criminal IP, has announced AITEM (AI-Powered Threat Exposure Management), an expansion of its Attack Surface Management (ASM) offerings. AITEM aims to move beyond traditional asset discovery to provide a more comprehensive approach to understanding, prioritizing, and responding to security exposures. The platform is scheduled…

ai

AI Is Getting Really Good at Messing With Cybercriminals

Anti-cybercrime initiatives are increasingly deploying artificial intelligence to disrupt scammers by engaging them with lifelike bots, which the criminals mistake for genuine victims. This strategy aims to waste scammers' time and resources while gathering intelligence on their operations.

ai

The Third-Party Agent Problem: Why Security Built for AI You Chose Misses the Agents You Didn't

A new report highlights a significant blind spot in enterprise security architectures concerning the proliferation of third-party AI agents. The forthcoming 2026 State of Agent Security Report indicates that current security models, often designed to protect AI systems directly chosen and deployed by an organization, frequently fail to account for AI capabilities embedded within third-party…

security

Canadian cybersecurity executive arrested in federal extortion case

A Canadian cybersecurity executive was arrested in Pennsylvania on Thursday, facing federal charges of conspiracy to commit extortion. Edward Dubrovsky, 54, a co-founder and former Chief Operating Officer of CYPFER, a firm specializing in ransomware negotiation, is charged with conspiring to threaten the confidentiality of information for extortion and conspiring to commit Hobbs Act extortion,…

ransomware

FBI Arrests Ransomware Negotiation Firm Co-Founder in ShinyHunters Probe

The Federal Bureau of Investigation (FBI) has reportedly arrested Edward Dubrovsky, a co-founder of the ransomware negotiation firm Cypfer and currently associated with CyberSteward. The arrest is said to be part of the ongoing ShinyHunters investigation, specifically in connection with an incident involving FBI job applicant data.

security

Insider Cyber Extortion Plot Against Industrial Firm Lands Engineer in Prison

A former core infrastructure engineer has been sentenced to prison for an attempted cyber extortion plot against an industrial firm. The engineer reportedly deleted administrative accounts and reset hundreds of user passwords, subsequently demanding a ransom of 20 Bitcoin to prevent further disruption to the company's servers.