← Back to list

I used to think Data Poisoning was a “lab-only” threat. Then I saw how Witches’ Brew works

Following my recent post on The New Mandate for Security Leaders, I’ve been getting my hands dirty — specifically diving deep into…

Pete Campbell in Security Sonar · 2026-01-11 20:24 · 0 claps · 2.2 min read
#ai-red-teaming #generative-ai-security #ai-security-risks #nvidia
Open on Medium ↗
Wiki topics: SAF · Safety & Alignment AI · AI · General

I used to think Data Poisoning was a “lab-only” threat. Then I saw how Witches’ Brew works

Following my recent post on The New Mandate for Security Leaders, I’ve been getting my hands dirty — specifically diving deep into NVIDIA’s Adversarial ML curriculum. As a Platform Security Engineer, I’m looking at this through a different lens: How do we build an architecture that survives an intelligent adversary?

One concept stopped me in my tracks: Witches’ Brew.

Most of us assume that if we audit our training data and it “looks” correct, we’re safe. Witches’ Brew proves us wrong. It’s a “clean-label” poisoning attack that is effectively invisible to the human eye.

How it works

Imagine you’re training an AI agent to recognize invoices. An attacker “brews” a few innocuous-looking images and slips them into your massive training set.

  • To a human: The image appears to be a standard, legitimate invoice.
  • To the AI’s optimizer: That image contains a “gradient” that has been mathematically aligned to a target. It secretly links a specific company logo to a “Zero Balance” command.

When the model is finished training, it performs perfectly on 99.9% of data — except when it sees that specific logo. Then, the “poison” activates, and the agent executes the attacker’s hidden logic.

Why Witches’ Brew is “Industrial Scale”

Earlier attacks required the attacker to know the model’s exact starting weights. Gradient Alignment is robust because it doesn’t need to know the starting point; it just ensures that wherever the model is, the poisoned data “pushes” it toward the same failure point.

Why are they so hard to catch?

In a traditional platform security stack, we check for file integrity (Has the data changed?). In an AI world, the data has changed, but in ways that are mathematically significant yet visually imperceptible.

Are You Auditing your Data, or Just your Code?

As we move toward Agentic AI — where models have the power to move money, access code, and change permissions — the “integrity” of our training and fine-tuning pipelines is our weakest link.

A single Prompt Injection is a prank. Witches’ Brew is a structural subversion of the model’s logic. If you aren’t checking for Gradient Alignment and Feature Collision (perturbations), you aren’t actually securing your AI.

We’re moving from a world of “Vulnerability Management” to “AI Data Security and Model Provenance.

What’s Next?

In my next article, I will dive deeper into the security aspects of NVIDIA’s BlueField 3, DOCA, and RDMA, which are the hardware and software layers that defend the platform infrastructure of an AI factory. If you are interested in more of this type of content, please let me know in the comments.

PlatformSecurity #AISecurity #AdversarialML #WitchesBrew #NVIDIA #AgenticAI #DataIntegrity #ONUG

I recommend this course for all AI defenders, especially if you are like me and enjoy getting your hands dirty!

I recommend this course for all AI defenders, especially if you are like me and enjoy getting your hands dirty!


메타데이터
post_id
c099add3322c
slug
i-used-to-think-data-poisoning-was-a-lab-only-threat-then-i-saw-how-witches-brew-works-c099add3322c
url
https://medium.com/security-sonar/i-used-to-think-data-poisoning-was-a-lab-only-threat-then-i-saw-how-witches-brew-works-c099add3322c
canonical_url
https://medium.com/security-sonar/i-used-to-think-data-poisoning-was-a-lab-only-threat-then-i-saw-how-witches-brew-works-c099add3322c
author_url
https://medium.com/@pcampbe
status
ok
fetched_at
2026-06-12 18:14:10