Responding to AI-Facilitated Abuse: Tips for Schools

Written by: Sam Wilmoth , MSW, Senior Manager at RAINN Consulting Group

In my years of facilitating trainings on child abuse for parents and caregivers, I have never once heard a single person express confidence in their ability to keep their children 100% safe from threats on the internet. The reason for this is simple: keeping kids safe is too big a job for parents and caregivers to do alone. We need entire communities, starting with schools and districts, to improve the way they respond to AI-assisted abuse.??????

While many school districts were quick to identify that AI chatbots could be used for cheating on academic assignments, they are still struggling to respond to threats of child sexual abuse that involve the same technology.?

Children, and girls in particular, face risks of abuse that are driven by the increasing presence of artificial intelligence in their lives. One such threat is “Nudify” technology, in which AIs construct fake nude images using features from real pictures of fully-clothed people, most often women and girls. Through this technology, children are also vulnerable to “sextortion,” in which perpetrators threaten to publish nude photos or nude images of a child for the purpose of blackmail.?

AI tools are making child sexual abuse material both easier to create and more explicit, according to two separate reports conducted by the Internet Watch Foundation in 2023 and 2024.?

Perpetrators who create these abusive images cause immeasurable harm.?

Even before the widespread availability of AI, studies about the effects of image-based sexual abuse documented harms to victims like posttraumatic stress disorder and suicidal thoughts, with one survivor crushingly describing her experience as “torture for the soul.” Unfortunately, when school districts do not fully understand these issues, they can further harm victims. This often happens when schools fail to report this abuse or compromise victims’ privacy during their investigations.?

So, what can school districts do to improve how they respond to these issues??

Schools can provide education and training to help their students, staff, and faculties understand more about AI-enabled abuse.?

RAINN has worked with schools across the country to provide victim-centered and trauma-informed training on sexual misconduct, and we have found that direct discussions with students can provide a deeper understanding of the harm caused by AI-enabled abuse. Students need to have a vocabulary for describing why this kind of abuse is so harmful, and the best way to develop that vocabulary is through discussion, not lecture.?

One of the most common training requests we get from teachers and staff is for information on how to recognize these forms of abuse, so it’s important that training for teachers provide actionable steps they can take to prevent further harm when they become aware of the signs. In addition, detailed training about these issues is particularly important for Title IX investigators or other administrators who might have to respond to reports of AI-enabled abuse.?

Schools can update their policies and procedures to address new forms of AI-enabled abuse.?

For instance, faculty and staff need clear reporting procedures that encompass AI-enabled abuse. School administrators may also need to update their anti-retaliation policies to include behaviors like students sharing deepfakes of a victim. Without comprehensive policies against all forms of sexual misconduct, faculty and staff will not have clear guidance about how to respond to a report of AI-enabled abuse, and victims will not have the protection they deserve.

Educators and administrators are in the difficult position of having to respond to new kinds of abuse before legal or technological fixes emerge. But every improvement schools make to increase student safety has a critical impact. Every student deserves a learning environment that is free from violence and discrimination.?

I have spoken to parents and caregivers across the country who lie awake at night, worrying about protecting their children from someone on the other end of a computer screen or smartphone. But they are not alone. Young people have a community of adults around them who can step up to help. Schools are a critical starting point for a world free from AI-enabled abuse.?

Learn How RAINN Is Combatting Image-Based Abuse

Resources?

As advocates and policymakers become more aware of the risks posed to young people by deepfakes and nudification apps, they are developing more and more resources for victims.??

STATE LAWS: A growing number of U.S. states have laws to address deepfakes, and some legal practitioners are attempting to apply existing laws about privacy or child pornography to this issue as well.

FEDERAL LEGISLATION: Bipartisan efforts in Congress to make it possible for victims to sue the creators of these fake images seem to be gaining traction.?

AWARENESS: The U.S. Department of Homeland Security has published an awareness campaign about child sexual abuse that occurs online called Know2Protect.

VICTIM SERVICES: Free services like the National Center for Missing and Exploited Children’s “Take It Down” and the Cyber Civil Rights Initiative’s Safety Center are available to assist victims

Sexual misconduct is a sensitive, challenging issue, but every organization should be prepared to assist survivors.

Whether your organization is facing a current crisis or simply wants to strengthen its systems, RAINN Consulting Group is ready with solutions for every industry.

[ TALK TO RAINN CONSULTING GROUP ]??

If you or someone you know has experienced sexual violence, you are not alone. RAINN’s National Sexual Assault Hotline offers free, confidential, 24/7 support for survivors and their loved ones in English and Spanish at 800.656.HOPE (4673) and via chat at hotline.RAINN.org and in Spanish at RAINN.org/es. ? ? ? ?????