EU Proposes Ban on Non-Consensual Deepfakes in AI Act

The European Union is currently reviewing the AI Act to include a ban on AI systems that enable the creation of non-consensual sexualized deepfakes. This regulatory effort aims to address the rising use of generative AI technologies for perpetrating sexualized violence against women and girls. As digital platforms struggle to manage this content under existing laws, the proposal aims to streamline accountability for AI companies and improve protections for victims against digital harassment.

This initiative reflects a growing recognition of the need to adapt regulatory frameworks to counteract gender-based violence that has escalated within the digital landscape. By potentially integrating this ban into the AI Act, the EU seeks to close existing legal gaps and ensure that companies are held responsible for the misuse of AI tools. This move could enhance national autonomy in digital governance while simultaneously addressing international concerns regarding AI ethics and safety in the digital sphere.