This post was written by Jessica Pater, MS, PhD, Health Services and Informatics manager and research scientist.
No matter where we turn these days, it seems we come face-to-face with artificial intelligence (AI). The technology is pervasive in many aspects of our everyday life, making tasks more convenient and efficient, and enhancing our overall experiences. AI shows up whenever we ask Siri or Alexa a question, enjoy a recommendation on our streaming service of choice, or see an ad on Instagram for something that we want or need to purchase.
The latest iteration, Generative AI is a technology that uses computers to “generate” content – everything from text to images, and music to videos. Generative AI models learn from the data they are trained on. For example, if everything that Shakespeare had ever written was uploaded into the model, it would learn and then start creating new things about and inspired by Shakespeare on its own. This is already a reality, with AI tools, or digital poets, offering to write plays on any topics with an “authentic Shakespearean flair.” In the right context, this can be exciting, fun and even helpful.
Unfortunately, these tools are increasingly being used for behaviors that are hurtful, unethical and potentially illegal.
AI and cyberbullying
Cyberbullying is an issue that affects both children and adults alike. The term refers to bullying that takes place over digital devices, like cell phones and computers, but also includes gaming consoles. The site stopbullying.gov reports that social media, text messages, email, online forums and gaming communities are the most common places where cyberbullying takes place. The Cyberbullying Research Center estimates that up to 30% of teens have experienced cyberbullying and a growing number of adults (15%) are reporting similar issues [3].
Over the last year, online harassment and cyberbullying using generative AI has been on the rise. This can include a variety of methods, such as creating false imagery or writing used to negatively impact someone else’s life. According to the Cyberbullying Research Center, AI-generated harassment can overwhelm victims more than traditional versions of this digital abuse and lead to substantial psychological and emotional abuse.
Just last year, the FBI released a public service announcement discussing the rise of using AI to create explicit content. These forms of manipulated media can be problematic, particularly since it can be very difficult for the victim to prove that they are indeed fake images, leading to additional stress, fear and anxiety.
The specific risks of cyberbullying and harassment in the age of AI
As this technology and its capabilities continues to grow, here’s some of what we know about the hazards of AI-generated harassment:
- It spreads faster and farther – Harassment via automated troll bots greatly increases how many people are sent content and how quickly content is shared.
- It’s specific – AI-generated content can make attacks even more personal by learning from personal-level data that the victim shares through online platforms.
- It’s smart – This technology can create content that successfully evades automated content moderation systems.
- It breeds bullying – The use of AI-generated content for harassment increases how vulnerable an individual is to hate speech and racist tropes depending on the data that is used to train the systems.
The rise of sexting, deepfakes and manufactured nude images
As if the above wasn’t concerning enough, we’re now seeing the presence of altered and manufactured images, often used to harass or embarrass individuals. Here is just some of what we know about this technology:
- Apps are now available to take pictures/images of people who are clothed and create “deepfake” versions of the content where they are undressed/nude. These platforms use suggestive language in their marketing, including text like “undress any girl you want!”
- Reports are showing this is on the rise with cyberbullying in teens, even leading to school expulsions this last school year.
- Researchers fear this could lead to increases in sexual assault/violence.
While we can’t stop the progression and advancement of technology, we can educate ourselves and our children about the negative effects of such tools. In today’s digital climate, nothing should be taken at face value, and weaponizing technology against another person to make them feel inferior or poorly is still bullying.
Talk to your kids about their use of technology and reach out for help if you notice they are struggling with their mental health.
To learn more about the research being done around cyberbullying at the Parkview Mirro Center for Research & Innovation, visit us here.
Sources
2. Patchin, J. W. & Hinduja, S. (2024). Cyberbullying Facts. Cyberbullying Research Center.
3. Wang, M. J., et. al. (2019). How common is cyberbullying among adults? Exploring gender, ethnic, and age differences in the prevalence of cyberbullying. Cyberpsychology, Behavior, and Social Networking, 22(11), 736-741.
4. FBI Internet Crime Center. (2023, June 5). Malicious Actors Manipulating Photos and Videos to Create Explicit Content and Sextortion Schemes.
5. thehill.com
6. nbcnew.com
