Evaluating the capability and efficiency of LLMs from the DeepSeek-R1-Distill model family across four classes of arithmetic and algorithmic reasoning problems reveals potential limitations of naive scaling as a strategy for developing more capable AI systems.
Moritz Laber, Zohair Shafi, Germans Savcisens et al.· 0 citations
Major life events have proven difficult to predict. Does this reflect limits of theory, data, and algorithms, or the large role of chance? We examine one outcome - having a child within three years - through a near-ideal setting for prediction: a data challenge where 147 researchers predicted births for Dutch residents...
E. Sivak, Emily M Cantrell, Thomas Emery et al.· 0 citations
It is shown that simple persistence-based opinion-dynamics models reproduce collective outcomes in all-generalist LLM populations, whereas heterogeneous LLM populations require population-level belief composition to reproduce consensus and agent identity to predict individual belief transitions.
Germans Savcisens, Samantha Dies, Courtney Maynard et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.