University of Chicago Researchers Develop Technique to Poison Generative AI Image Scraping

Tool seen as a way to protect artists' copyright

Researchers at the University of Chicago have developed a technique that can "poison" generative text-to-image machine learning models such as Stable Diffusion XDSL and OpenAI's Dall-E when they scrape the internet for training images. And it can do it with as few as 100 poisoned images, they said.

The tool, dubbed Nightshade, has implications for publishers, filmmakers, museums, art departments, educators, and artists wanting to protect their works against generative AI companies violating their copyrights.

University of Chicago computer science department researchers Shawn Shan, Wenxin Ding, Josephine Passananti, Haitao Zheng, and Ben Y. Zhao have published their paper, "Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models" for peer review.

Earlier this year, the same team released the free open source software, Glaze, which allows image makers to "cloak" their works in a style different from their own, preventing an AI from stealing the original image, researchers said in an FAQ.

The poisoning attacks on generative AI are prompt-specific, researchers said, and target a model's ability to respond to individual prompts. Further, because a doctored image contains specific but random poisoned pixels, it becomes nearly impossible to be detected as any different from the original and thus corrected.

"Surprisingly, we show that a moderate number of Nightshade attacks can destabilize general features in a text-to-image generative model, effectively disabling its ability to generate meaningful images," they said.

In addition, Nightshade prompt samples can "bleed through" to similar prompts. For example, the prompt "fantasy art" can also poison the prompts "dragon" and fantasy artist "Michael Whelan." Multiple Nightshade poison prompts can be stacked into a single prompt, with cumulative effect — when enough of these attacks are deployed, it can collapse the image generation model's function altogether.

"Moving forward, it is possible poison attacks may have potential value as tools to encourage model trainers and content owners to negotiate a path towards licensed procurement of training data for future models," the researchers conclude.

To read and/or download the full abstract, visit this page.

Featured

  • networked node grid featuring illuminated connectors

    Infrastructure Accounts for More than Half of Worldwide AI Spending

    Gartner forecasts worldwide AI spending will reach $2.67 trillion in 2026, up 49.5% from 2025, with AI infrastructure accounting for nearly $1.5 trillion, or about 56% of the total. For every dollar Gartner expects to be spent on generative AI models, more than $52 will be spent on infrastructure.

  • CIS Sandbox Tutor Eli Blouin at Bentley University imagines a future technology learning partner that supports curiosity, critical thinking, feedback, and personalized learning.

    Student Voices: Technology as a Future Learning Partner

    A data analytics and marketing major at Bentley University and a distinguished lecturer at the university explore the future of "technology learning partners" — technologies that participate in the learning process by asking questions and giving feedback, not just information search results.

  • young man hand working on a laptop, bokeh blurred at night

    Redesigned Copilot Will Build Apps and Work on Its Own

    Microsoft recently announced that it's redesigning Copilot, the company's all-encompassing AI assistant, so users can hand off complex tasks, build tools by describing what they need and assign work to an agent that keeps going after they log off.

  • Abstract glowing network nodes forming conversation bubbles

    OpenAI Introduces Dots, AI Agents that Continue Working Between User Conversations

    OpenAI has announced Dots, GPT-6 Astra-powered agents that run on their own cloud computers, using connected applications to carry on with assignments between conversations and incorporating users' feedback as they go.