Skip to content

Commit

Permalink
chore: adding slurs-occur-every-language blog(#154)
Browse files Browse the repository at this point in the history
  • Loading branch information
kaustubhavarma committed May 10, 2024
1 parent 29b3f81 commit c246494
Showing 1 changed file with 17 additions and 0 deletions.
17 changes: 17 additions & 0 deletions src/blog/2024-05-09-slurs-occur-every-language.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
name: Online Gender-Based Slurs and Abuses Don't Just Happen in English
excerpt: "On Developing Open Source Slur Lists in Indian English, Hindi, Tamil and Malayalam"
author: "Tattle"
project: Uli
date: 2024-05-09
tags: responsible-ai
---

The majority of machine learning investment on online platforms still happens in English.
As Tarunima Prabhakar [commented to Rest of World](https://restofworld.org/2021/newsletter-south-asia-facebooks-language-problem/) back in 2021, there is hardly any prioritisation of other languages. For a country like India, abusive and hateful slurs also happen in vernacular languages. Yet, the lack of a list of these commonly used terms makes it harder to protect people from gendered abuse.

As part of the process of building Uli, Tattle developed one of the largest crowd-sourced slur lists in Indian languages. Indian English was deemed by the team as a distinct enough vocabulary to warrant investment. Tamil and Hindi were the other two languages chosen for the initial phase given team capacity and budgets at the time.
A second round of crowdsourced words during Tattle’s 16 days of activism campaign in November 2023 allowed us to add Malayalam to the list of languages that Uli supports.
Thanks to the work led by Aakash from Citizen Digital Foundation, 50 new slurs were added in Malayalam.
It has been an immense collective effort that now contains over 630 words across the four languages, over 300 of which have been annotated. One of the annotators involved in the process also pointed out that given the number of alphabets that exist in other languages (as opposed to English), creating the lexicon for slur lists is even harder. As people learn to trick the system, the number of spelling and tweaking possibilities means consistently trying to keep up.
The slur list is available on [Tattle’s GitHub](https://restofworld.org/2021/newsletter-south-asia-facebooks-language-problem/) under the Open Data License for use by interested researchers and activists, or Trust and Safety teams.

0 comments on commit c246494

Please sign in to comment.