This talk is part of a two-presentation session running from 1:30 PM - 2:20 PM. The session will feature two presentations back-to-back, with Q&A after each presentation.
The proliferation of generative AI technologies has transformed the threat landscape for Trust & Safety (T&S) teams, particularly through the rise of synthetic non-consensual intimate imagery (NCII) and the harms to adults and children that come with it. This presentation will discuss findings from recent investigations into the synthetic NCII landscape, highlighting its evolution from a niche online marketplace to a fully fledged digital industry driven by key actors with over 28 million unique visitors a month. In this presentation, we will present findings from a recent series of investigations, exploring specific abusive behaviors by synthetic NCII providers and detailing how they exploit online platforms across the stack to scale and monetize their activities. We will emphasize practical takeaways for T&S teams and propose policy and enforcement strategies that target the actors enabling this rise in image based abuse, in addition to the content alone.