Yale Law clinic sues to shut down deepfake app ClothOff

A Yale Law School clinic filed a lawsuit in October to shut down ClothOff, an app that has been active for more than two years. The platform is designed and marketed specifically as a deepfake pornography image and video generator, and has been characterized as terrorizing young women online. While ClothOff is currently unavailable on two major app stores and social platforms, it remains accessible via the web and Telegram. Serving notice to the operators has proven difficult due to its opaque structure. John Langford, co-lead counsel in the lawsuit, explained: “It’s incorporated in the British Virgin Islands, but we believe it’s run by a brother and sister in Belarus. It may even be part of a larger network around the world.”

The lawsuit highlights the severe impact on victims and the limits of local law enforcement. The plaintiff, Jane Doe, is an anonymous high school student in New Jersey whose Instagram photos were altered using the app. She was 14 years old when the original photos were taken, meaning the AI-modified versions are legally classified as child abuse imagery. However, local authorities declined to prosecute, and according to the legal complaint, neither the school nor law enforcement ever established how widely the Child Sexual Abuse Material (CSAM) of Jane Doe and other girls was distributed.

While ClothOff is a dedicated deepfake tool, general-purpose AI systems present a more complex legal challenge. This issue recently surfaced with non-consensual pornography generated by Elon Musk’s xAI tool, Grok. Holding general-purpose platforms accountable is difficult because existing laws require clear evidence of intent to harm to hold platforms liable for user-generated content. Langford noted that while observers might argue platforms should have implemented more stringent controls years ago, proving recklessness or knowledge in court remains a highly complicated task.

The legal landscape is further complicated by varying international standards. In the U.S., legislation like the Take It Down Act—which addresses deepfake pornography—exists, but U.S. regulatory agencies have not issued an official response to the recent generation of non-consensual imagery. In contrast, other nations are taking active steps. Indonesia and Malaysia have moved to block access to the Grok chatbot, while regulators in the United Kingdom, the European Commission, France, Ireland, India, and Brazil have initiated investigations or preliminary steps. Langford pointed out that while distributing child abuse material clearly violates criminal laws, the more difficult legal questions center on what the platform knew, what actions it took, and how it is currently responding.

Why it matters

The lawsuit against ClothOff highlights the significant legal and jurisdictional challenges in combating non-consensual deepfake pornography, particularly when platforms operate across international borders or as general-purpose AI systems.