Urdu, the world's tenth most spoken language with 246 million speakers, remains almost entirely absent from mainstream LLM safety evaluation and nine years of WOAH proceedings. To investigate whether this absence has measurable consequences for content moderation reliability, five large language models, GPT-4o, Claude...
F. Kara-Isitt, Sonal Khosla, S. Swift· 0 citations
A reproducibility study of the HateBench paper, investigating whether existing hate speech detectors, typically trained on human-authored data, generalize to LLM-generated hateful content, and evaluating whether their reported weaknesses are stable over time and robust to evolving components.
Ole Becker, Tobias Jongen, Philip Kolbe et al.· 0 citations
Results indicate that current LLMs provide uneven safety assurance across Urdu's script varieties, with smaller open-weight models showing substantially higher instability and missed-harm rates than frontier closed models.
F. Kara-Isitt, Sonal Khosla, S. Swift· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.