Analyzing hate speech with incel-hunters' critiques

Yisi Sang, Jeffrey Stanton

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The ubiquity of online media services helps to promote free speech but also provides opportunities for the spread of problematic content such as hate speech. A group of individuals known as "incels" (involuntary celibates) sometimes use online media services to publish hateful content. To expose and condemn incel hate speech, other individuals, sometimes called "incel hunters" create online communities where they critique screenshots of content posted by incels. In this paper, using 18,187 posts collected from a subreddit named r/IncelTears, we explore the potential for transforming screenshots of incel hate speech and oppositional statements into training data that could be used as the basis for automated or semi-automated content moderation tools.

Original languageEnglish (US)
Title of host publication11th International Conference on Social Media and Society
Subtitle of host publicationDiverse Voices - Promises and Perils of Social Media for Diversity, SMSociety 2020
EditorsAnatoliy Gruzd, Philip Mai, Raquel Recuero, Angel Hernandez-Garcia, Chei Sian Lee, James Cook, Jaigris Hodson, Bree McEwan, Jill Hopke
PublisherAssociation for Computing Machinery
Pages5-13
Number of pages9
ISBN (Electronic)9781450376884
DOIs
StatePublished - Jul 22 2020
Event11th International Conference on Social Media and Society: Diverse Voices - Promises and Perils of Social Media for Diversity, SMSociety 2020 - Virtual, Online, Canada
Duration: Jul 22 2020Jul 24 2020

Publication series

NameACM International Conference Proceeding Series

Conference

Conference11th International Conference on Social Media and Society: Diverse Voices - Promises and Perils of Social Media for Diversity, SMSociety 2020
CountryCanada
CityVirtual, Online
Period7/22/207/24/20

Keywords

  • Incel
  • Reddit
  • automated moderation
  • content moderation
  • hate speech
  • online communities
  • semi-automated moderation

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Cite this

Sang, Y., & Stanton, J. (2020). Analyzing hate speech with incel-hunters' critiques. In A. Gruzd, P. Mai, R. Recuero, A. Hernandez-Garcia, C. Sian Lee, J. Cook, J. Hodson, B. McEwan, & J. Hopke (Eds.), 11th International Conference on Social Media and Society: Diverse Voices - Promises and Perils of Social Media for Diversity, SMSociety 2020 (pp. 5-13). (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3400806.3400808