GTIG AI Threat Tracker: Agentic Threat Activity Crosses a Significant Threshold

How Google Protects Against AI Abuse

Google uses a multifaceted defense strategy to protect our users and infrastructure against LLM abuse, integrating proactive model-level safeguards, specialized threat intelligence, targeted containment protocols, and proactive red teaming to simulate and protect against threats. Additionally, as innovation moves forward, the industry needs security standards for building and deploying AI responsibly, which is why we introduced the Secure AI Framework (SAIF), a conceptual framework to secure AI systems. 

Proactive Model and Platform Defenses

We continuously harden our models against misuse by feeding insights from active threat monitoring directly into our safety classifiers and guardrails. For instance, in response to model extraction—or “distillation”—attacks, we have deployed real-time defenses designed to degrade the performance of unauthorized “student” models and detect attempts to clone proprietary logic. When we identify bad actors, we take direct action to disrupt their operations by disabling associated projects and accounts.

To extend these protections to enterprise customers, we developed Google AI Threat Defense (AITD). This autonomous architecture operationalizes security by bringing together the reasoning power of Gemini and other frontier models, the risk prioritization of Wiz, the automated remediation capabilities of Gemini and CodeMender, and frontline intelligence from Mandiant. AITD employs a multi-model strategy that balances cost and coverage, using light models for continuous scanning and specialized frontier models for high-risk vulnerabilities.

In addition to our proactive platform defenses, we’ve recently introduced Gemini 4 Carbon, our strongest model with state-of-the-art cybersecurity and long horizon capabilities. Google has built Gemini 4 Carbon with layered defenses against cyber misuse—combining safety training, input/output classifiers, activation-based introspection probes and chain-of-thought and agentic trajectory monitors—designed to block requests to develop functional, weaponized exploits or malware tooling. The robustness of these safeguards has been stress-tested by both internal red teams and specialized external partners including Gray Swan and Trajectory labs. Beyond the model itself, Google continuously monitors for intentional misuse in production, limits or disables access for offending accounts, and provides vetted defenders, security researchers, and government partners access to advanced dual-use cyber capabilities through the Fairwind Program. More information on the safety, security, and alignment testing conducted on Gemini 4 Carbon can be found in the Gemini 4 Carbon Safety & Security Report.

Building AI Safely and Responsibly

Google’s approach to AI is guided by a commitment to bold innovation and responsible development. Guided by our AI Principles, Google designs AI systems with robust security and safety guardrails, which are continuously tested to ensure resilience. 

Our policy guidelines and prohibited use policies are foundational to ensuring safety. Our policy development process is built to anticipate emerging trends and design for security from the ground up, allowing us to enhance protections for users globally. 

At Google, threat intelligence is a core component of our security posture. We actively investigate abuse of our platforms—including malicious cyber activities by government-backed threat actors—and collaborate with law enforcement when appropriate. Crucially, our learnings from every countermeasure we implement are fed back into our product development to improve the security for our AI models. These iterative improvements to our classifiers and model-level safeguards are vital to maintaining agility against evolving threats.

Our LLM development and Trust & Safety teams also work in constant concert with our threat intelligence, security, and modeling experts to effectively address misuse.

Scroll to Top