• Towards AGI
  • Posts
  • 2025 Saw a Sharp Rise: GenAI Data Policy Breaches More Than Doubled

2025 Saw a Sharp Rise: GenAI Data Policy Breaches More Than Doubled

Doubling Down on Risk.

Here is what’s new in the AI world.

AI news: The Hidden Cost of AI Adoption

Hot Tea: Could GenAI Erode Trust in Pharma Brands?

Open AI: Nvidia Adds a 'Reasoning Layer' to Autonomous Vehicles

OpenAI: The Biggest Bet in Tech?

Stop Relying on "Black Box" AI: The Case for Multi-Agent Orchestration

A Red Alert for AI Governance: Policy Breaches More Than Doubled Last Year

Data policy violations involving generative AI applications have more than doubled over the past year. Organizations now experience an average of 223 such incidents monthly, with the top 25% of companies facing as many as 2,100 violations per month.

A recent report from Netskope Threat Labs underscores the persistent issue of "shadow AI", the unauthorized use of AI tools, even as companies invest more in approved platforms.

Although reliance on personal AI accounts has slightly decreased, 47% of generative AI users still access tools through unmanaged personal accounts, either alone or in combination with corporate-sanctioned applications.

In response to growing risks, 90% of organizations now actively block at least one generative AI application, with the average company restricting access to ten different tools. This reflects a stricter enforcement approach as AI adoption accelerates.

Overall usage has surged dramatically. The number of employees using generative AI apps grew by 200% in the last year, while the volume of prompts sent to these tools increased by 500%.

On average, organizations now process about 18,000 prompts per month, up from 3,000.

The most common type of policy violation, accounting for 54% of incidents, involves employees uploading regulated data, such as personal, financial, or healthcare information, into AI systems.

Traditional cloud and identity threats remain significant. Personal cloud apps are now implicated in 60% of insider threat incidents, often exposing sensitive data like source code, intellectual property, and credentials.

Phishing also continues to be widespread. Although user susceptibility dropped by 27% year-over-year, an average of 87 out of every 10,000 employees still click on a phishing link each month.

Ray Canzanese, Director of Netskope Threat Labs, notes that while security teams are accustomed to evolving threats, the rapid adoption of generative AI has introduced an unexpectedly broad and complex new risk profile.

Many teams are struggling to keep pace, sometimes overlooking fundamental security practices.

Canzanese emphasizes that organizations must develop an "AI-Aware" security posture by updating policies and extending the reach of existing data loss prevention (DLP) tools.

The goal is to strike a balance that enables innovation while maintaining robust security across all levels of the organization.

When AI Writes the Script: The Risky Future of Pharma Marketing

While many consumer brands have boldly used generative AI in public advertisements, pharmaceutical marketers have adopted a more cautious approach, largely continuing to use actors to portray patients in their campaigns.

However, these marketers are actively implementing GenAI behind the scenes.

They are using it to develop synthetic personas and target audiences, supplement workflows for patients and healthcare professionals, accelerate medical, legal, and regulatory (MLR) reviews, and strategize how their messaging appears in large language models (LLMs).

Industry experts view 2025 as a year of experimentation and 2026 as the time for more holistic and scaled AI integration.

Julie O’Donnell of Inizio Evoke Comms notes that while there is a top-down push to speed up market entry, innovation often remains in isolated pockets rather than being fully integrated across workflows.

This is supported by data showing that less than 40% of companies have embedded AI organization-wide.

Christian Bauman of Imre emphasizes that winning brands will treat AI as an entire ecosystem, not just a tactical tool. Moving beyond using AI for simple tasks like drafting text will be critical to unlocking its full potential in 2026.

GenAI-Driven Synthetic Personas for Targeted Audiences

A significant growing trend is the use of GenAI to create synthetic personas and digital audience "twins." This allows marketers to test messaging and personalize content for niche communities at scale, moving beyond traditional, slower market research methods.

This capability is increasingly important as audiences fragment across diverse digital channels.

Looking ahead, experts like Courtney Sherman of Deloitte see potential for synthetic data to transform the entire patient journey, moving from reactive "sick care" to proactive wellness by using AI to understand behaviours and deliver personalized health nudges.

Enhancing Health Information Discovery with Generative AI

A major shift in 2025 has been consumers turning to LLMs like ChatGPT and Gemini for health information instead of traditional search engines or WebMD.

This has "permanently reshaped" health information discovery, with AI answers often sourced from social platforms like TikTok and Reddit.

This change necessitates a new marketing playbook focused on Generative Engine Optimization (GEO), crafting content to be surfaced by AI platforms.

Marketers must now consider AI as a primary audience, shifting focus from paid media to organic content strategies tailored to ever-evolving LLM algorithms.

A brand's narrative may now be shaped more within an AI chatbot than on its own website, requiring marketers to cede some control over their story.

The central challenge for 2026 will be holistically integrating AI throughout pharmaceutical organizations. This requires defining a clear strategic vision while managing the significant change required to bring teams on board.

As AI becomes ubiquitous and indistinguishable from human-created content, the experts conclude that emotional connection and trust will become the ultimate differentiators.

In a world of synthetic media, a brand's integrity, its community, and its authentic human connections will be everything.

Nvidia's Alpamayo Brings 'Reasoning AI' to the Road

At CES 2026, Nvidia unveiled Alpamayo, a comprehensive new open-source suite of AI models, simulation tools, and datasets designed to advance the development of autonomous robots and vehicles.

The suite is focused on enhancing how self-driving systems navigate and make decisions in complex driving environments.

Nvidia describes Alpamayo 1 as the first vision-language-action (VLA) model built with a "chain-of-thought" reasoning capability specifically for autonomous vehicle research.

The model, now available on Hugging Face, contains 10 billion parameters and processes video input to generate driving paths while also providing a step-by-step explanation for each decision.

This transparency is intended to build trust and safety. Developers can scale the model down for deployment in real vehicles or use it as a foundation to build additional tools, such as evaluators and auto-labelling systems.

The initial release includes open weights and scripts, with plans for more powerful, flexible, and commercially-licensed versions in the future.

As part of the launch, Nvidia is also releasing an open dataset featuring over 1,700 hours of diverse driving footage from various regions and conditions, including rare edge-case scenarios.

Complementing this is AlpaSim, an open-source simulation tool hosted on GitHub that allows developers to recreate realistic driving environments, including sensor data and traffic behaviour, to safely test autonomous systems at scale.

CEO Jensen Huang framed Alpamayo as "the ChatGPT moment for physical AI," emphasizing its potential to help autonomous vehicles handle uncommon situations and clearly explain their reasoning.

The system is supported by the NVIDIA Halos safety framework and is positioned as a foundational platform for safe, scalable autonomy.

However, the immense scale of the release, including massive open datasets, simulation frameworks, and advanced reasoning models, also highlights the growing complexity and unpredictability within the AI field.

By providing these powerful tools openly, Nvidia is simultaneously accelerating global innovation and introducing potential disruptions to safety norms and regulatory frameworks.

This "ChatGPT moment" encapsulates both the transformative excitement and the inherent turbulence of a technology advancing faster than the establishment of corresponding guardrails and trust mechanisms.

OpenAI Just Landed a $41 Billion Check. The AI Arms Race Just Got Real

SoftBank Group has finalized a massive $41 billion investment in OpenAI, marking one of the largest private funding rounds ever. This investment grants the Japanese conglomerate an approximately 11% stake in the creator of ChatGPT.

The move is a centerpiece of SoftBank CEO Masayoshi Son's aggressive "all in" strategy to dominate the artificial intelligence sector.

Son is channeling substantial capital into AI and the critical computing infrastructure that powers it, aiming to capture a leading position amid exploding global demand for AI processing capacity.

This landmark funding round for OpenAI follows closely on the heels of another major SoftBank deal: the $4 billion acquisition of digital infrastructure investor DigitalBridge Group.

The structure of the OpenAI investment involved two tranches. SoftBank invested an initial $7.5 billion in April, followed by an additional $22.5 billion completed this week.

The remaining $11 billion of the total came from an upsized syndicated co-investment by other backers. This fulfills a March agreement where SoftBank committed to invest up to $40 billion into a for-profit arm of OpenAI.

The investment valued OpenAI at approximately $300 billion post-money earlier this year. However, a secondary stock sale completed in October valued the company at roughly $500 billion, according to PitchBook data.

OpenAI has become a foundational player in the global AI investment surge that is reshaping technology markets.

Alongside partners like Oracle, the company is reportedly planning a major, multi-year data center project codenamed "Stargate," designed to support next-generation AI models, with backing from major investors including SoftBank.

Journey Towards AGI

Research and advisory firm guiding industry and their partners to meaningful, high-ROI change on the journey to Artificial General Intelligence.

Know Your Inference

Maximising GenAI impact on performance and Efficiency.

Model Context Protocol

Connect AI assistants to all enterprise data sources through a single interface.

Your opinion matters!

Hope you loved reading our piece of newsletter as much as we had fun writing it. 

Share your experience and feedback with us below ‘cause we take your critique very critically. 

How's your experience?

Login or Subscribe to participate in polls.

Thank you for reading

-Shen & Towards AGI team