This story on HackerNoon has a decentralized backup on Sia.
Transaction ID: 8-PZ5ZWhmuQHRSwXcPaftnidQrJHr04yFfSpqt2Jetg
Cover

What Happens When AI Tries to Mimic Protected Art?

Written by @torts | Published on 2024/12/12
TL;DR —
This section illustrates the impact of robust mimicry methods on protected artwork, showing visual comparisons for each method from Gaussian Noising to Noisy Upscaling.

Abstract and 1. Introduction

  1. Background and Related Work

  2. Threat Model

  3. Robust Style Mimicry

  4. Experimental Setup

  5. Results

    6.1 Main Findings: All Protections are Easily Circumvented

    6.2 Analysis

  6. Discussion and Broader Impact, Acknowledgements, and References

A. Detailed Art Examples

B. Robust Mimicry Generations

C. Detailed Results

D. Differences with Glaze Finetuning

E. Findings on Glaze 2.0

F. Findings on Mist v2

G. Methods for Style Mimicry

H. Existing Style Mimicry Protections

I. Robust Mimicry Methods

J. Experimental Setup

K. User Study

L. Compute Resources

B Robust Mimicry Generations

Figure 11: Style mimicry for all protections using naive mimicry—no robust method is used and we finetune directly on protected images. We randomly chose artists and prompts. Each image pair shows the protected generation and generation from unprotected art.

Figure 12: Style mimicry for all protections using Gaussian Noising. We randomly chose artists and prompts. Each image pair shows the protected robust generation and generation from unprotected art.

Figure 13: Style mimicry for all protections using DiffPure. We randomly chose artists and prompts. Each image pair shows the protected robust generation and generation from unprotected art.

Figure 14: Style mimicry for all protections using IMPRESS++. We randomly chose artists and prompts. Each image pair shows the protected robust generation and generation from unprotected art.

Figure 15: Style mimicry for all protections using Noisy Upscaling. We randomly chose artists and prompts. Each image pair shows the protected robust generation and generation from unprotected art.

Authors:

(1) Robert Honig, ETH Zurich (robert.hoenig@inf.ethz.ch);

(2) Javier Rando, ETH Zurich (javier.rando@inf.ethz.ch);

(3) Nicholas Carlini, Google DeepMind;

(4) Florian Tramer, ETH Zurich (florian.tramer@inf.ethz.ch).

This paper is available on arxiv under CC BY 4.0 license.

[story continues]

Written by
@torts
Exploring the legal landscape of the digital age. Read my articles to understand the why behind the what.
Topics and
tags
ai-forgery|generative-ai|ai-style-mimicry|image-theft-by-ai|protecting-art-from-ai|glaze-protection-tool|black-box-ai-access|robust-mimicry-methods
This story on HackerNoon has a decentralized backup on Sia.
Transaction ID: 8-PZ5ZWhmuQHRSwXcPaftnidQrJHr04yFfSpqt2Jetg