CulturalRiddles: A Multicultural Benchmark of Riddles
My Chiffon NguyenTianyi HuVinod AnbalaganHenry GagnierPouya SadeghiFarah AbdouTidor-Vlad PricopeDiego MMS OliveiraJocelyn K D'ArcyMadeline SmithOluwaseun A AjayiYusser Al GhussinZena Al-KhaliliMicol AltomareShayan AmirAhanaf AzizBryan ChenRuchira DharAbdellah El MekkiRawan Mohammed ElframawyAkhil EppaSilvia FernandezAlex GimeiArya HariharanChristian HoangRamMohanRao KadiyalaDiana KozachekPeerat LimkonchotiwatAnkita MaityDi MoAyush MunotAylin NaebzadehAnastasiia NikitinaDina PisarevskayaDivas PoudelJebish PurbeyMd Rabius Sany ApuAhmad Mufli RamadhanRalitza Nikolova RizovaDiogo M. Serrano-MirandaVivek Gopalkrishna SilimkhanLuis Fernando Solis NavarroKaiser SunArya SuneeshManaswitha SunkaraTejaswi SunkaraJonathan E SwindellHanna YukhymenkoJingyi ZhengWeihua ZhengEsther AdenugaIlia AfanasevAmit AgarwalWafa AissaLisa AlazrakiLauren C AltomarePriscilla Amondi AmuokEmile AnandVivek AnbalaganGabriel AssisJos\'{e} Mat\'{i}as AvalosSilvia Lorena AvilaZakaria BaannouNiyati BafnaYash BaglaSarah BahramiBontu F BalchaVanya Bannihatti KumarIrene BaucellsAbdumutalib BegmuratovCeren BerkNaman BhatiaSouvik BhattacharyyaIsabel Blanco FerreiroFelipe BochiniSayuru BopitiyaAngana BorahTulika BoseOlena BugaiovaJuliana CarvalhoNancy F ChenStephy ChenRochelle ChoenniJayanth Krishna ChundruLeandro A CossioNeboj\v{s}a Damnjanovi\'{c}Ona de GibertMarco De SantisPedro DelgadoKaustubh Dhol\'{e}Adnan El AssadiWesam El-SayedNadine M ElframawyOumayma EssarhiNaome A EtoriReuben Chagas FernandesSaanidhi Pravin GadeJavier Garc\'{i}a Gilabert\'{A}lvaro Gonz\'{a}lez-EscapaBin HuKaiyu HuangAbderrahmane IssamDanka Joki\'{c}Ulugbek KhalilovDominik Krzemi\'{n}skiRoy Ka-Wei LeeHaichang LiChen Cecilia LiuZhengyuan LiuCedric LothritzHouman MehrafarinAntonio Miranda-EscaladaFengran MoMehrnaz MofakhamiWafaa MohammedFelipe Moreno-VeraPrahitha MovvaJannatul NayemVan NgoJoy OlusanyaMarc P\`{a}miesAvinash Kuney PandeyYurii PanivFred PhilippyVladislav PoritskiDikshya PoudelJoanna Rado{\l}aSara RajaeeSwati RajwalPrerana RaneMuhammad Ravi Shulthan HabibiLucas ResckShubhashis Roy DiptaAnanya SahuEduardo S\'{a}nchezBorja S\'{a}nchez ClementeAleix SantNobin SarwarIstiak ShihabSanthoshini Pranathi SingarajuJane SmithDavid StapEmily Z SuAnanth K SureshSajag SwamiRuiyang TanNazia TasnimKhalid TounoussiPatteera TriamamornwoothMuhammad Saad UmarShankar VenkitachalamOksana VolchekLingbo WangDebela Desalegn YadetaRushikesh ZawarJinghan ZhangMike ZhangMarzieh FadaeeAkhil AroraK\'{a}roly BoczkaJulia Kreutzer
Oct 2026
Artificial IntelligenceNatural Language Processing
Abstract
As LLMs expand their language coverage, evaluating how well they understand and represent diverse cultures becomes increasingly important. However, many benchmarks remain English-centric, with limited cultural coverage and a focus on factual knowledge over its application in real-world cultural contexts. We propose CulturalRiddles, a benchmark of original, culturally grounded riddles created entirely by humans through a participatory community effort, spanning 62 cultures (45 countries, 51 languages). These riddles are deeply rooted in their respective cultures and require abductive and compositional reasoning, alongside detailed factual and social knowledge, language skills, and an understanding of culturally specific associations. We benchmark 28 LLM configurations using both automatic and large-scale human evaluation. Even frontier models achieve at most 22% accuracy in some communities. We publicly release all artifacts alongside an open contribution process to expand the benchmark's linguistic and cultural coverage.
This paper investigates developing real-world perception for active agents, proposes Gibson Environment for this purpose, and showcases a set of perceptual tasks learned therein.
F. Xia, Amir Zamir, Zhi-Yang He et al.· 2018 IEEE/CVF Conference on...· 1,069 citations· ⚡112
This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.
P. Abrahamsson, O. Salo, Jussi Ronkainen et al.· arXiv.org· 727 citations· ⚡54
Consequences of happiness and unhappiness that are beneficial and detrimental for developers' mental well-being, the software development process, and the produced artifacts are found.
D. Graziotin, Fabian Fagerholm, Xiaofeng Wang et al.· Journal of Systems and Softw...· 236 citations· ⚡13
The Mobile-D approach is briefly outlined here and the experiences gained from four case studies are discussed, which helped develop an agile development approach for mobile application development.
P. Abrahamsson, Antti Hanhineva, H. Hulkko et al.· Conference on Object-Oriente...· 225 citations· ⚡18
GAOKAO-Bench is introduced, an intuitive benchmark that employs questions from the Chinese GAOKAO examination as test samples, including both subjective and objective questions that contribute a robust evaluation benchmark for future large language models and offers valuable insights into the advantages and limitations...
Xiaotian Zhang, Chun-yan Li, Yi Zong et al.· arXiv.org· 216 citations· ⚡17
A study with 42 participants investigates the relationship between the affective states, creativity, and analytical problem-solving skills of software developers and offers support for the claim that happy developers are indeed better problem solvers in terms of their analytical abilities.
D. Graziotin, Xiaofeng Wang, P. Abrahamsson· PeerJ· 216 citations· ⚡13
