This article introduces a framework for designing and running simulated experiments with LLM‐powered agents and applies the framework to the exploration–exploitation dilemma and shows that LLM‐based experiments reproduce patterns observed among human participants.
Abstract
We explore how Large Language Models (LLMs) can serve as synthetic subjects to inform strategy research. We introduce a framework for designing and running simulated experiments with LLM‐powered agents. We argue that this approach is useful for rapid, low‐cost prototyping of human experiments and for generating novel hypotheses. We apply the framework to the exploration–exploitation dilemma and show that LLM‐based experiments reproduce patterns observed among human participants. We then vary parameters and boundary conditions to illustrate how the same setup can support design iteration and surface hypotheses about when and why established results change. In the conclusion, we discuss the promise and limitations of artificial intelligence agents as “model organisms” for strategy.
Artificial intelligence (AI) agents are beginning to enter firms as tools that can execute work, from writing code to coordinating complex tasks across systems. This article argues that their value for strategy extends beyond task automation: AI agents can also be used to simulate strategic interactions and assess how strategies perform under alternative assumptions. In our exploration–exploitation application, these simulations reproduce core patterns from prior human experiments and reveal where those patterns weaken or reverse. Used this way, AI agents can help firms prototype strategic choices, stress‐test assumptions, and direct managerial attention toward promising leads before larger commitments of time and effort.
This work introduces Multi- Agent Contextual Exploration (MACE), a lightweight framework that explicitly promotes exploration through structured peer selection that substantially improves exploration behavior and downstream task performance and shows theoretically that the value of exploration increases with agent dive...
Hyeong Kyu Choi, Jiatong Li, Wendi Li et al.· arXiv.org· 1 citation
This work argues that studying AI Scientists as human-agent systems (HAS) is both underexplored and undervalued, and calls for new research that adopts the HAS lens to develop mathematical frameworks for understanding and fostering human-AI synergy in scientific discovery.
P. Emami, Sameera Horawalavithana, T. Nguyễn et al.· 0 citations
It is shown that AI-discovered strategies propagate and persist in human populations, producing cultural shifts when non-trivial, learnable, and advantageous.
L. Brinkmann, Thomas F. Eisenmann, Anne-Marie Nussberger et al.· Nature Communications· 2 citations
Large Language Models (LLMs) are increasingly used in simulations, either in academic settings for research studies or in industry for prototyping. Previous research has investigated the extent to which agents can mimic human behavior in socioeconomic settings; however, there is limited research on greedy decision-maki...
Landy Rakotoarison, Fanamby T. Randriamahenintsoa· International Conference on...· 0 citations
An analysis that derives task-specific algorithmic design spaces from human-designed methods, maps both human- and agent-designed methods into these spaces, and quantifies their algorithmic differences at the module level suggests that although current agents can occasionally match or surpass human SOTA performance, th...
Yikang Yang, Zhengxin Yang, Luzhou Peng et al.· 0 citations
An organizing framework for understanding LLM‐based agents is established, systematically deconstructing both single‐agent and multi‐agent systems into their core components, and the architectural principles and key mechanisms that underpin their intelligence are analyzed.
Yuheng Cheng, Ceyao Zhang, Zhengwen Zhang et al.· WIREs Data Mining and Knowle...· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.