We study a decision-maker who explores --- dynamically choosing what to learn --- before stopping to act. We first reduce this dynamic control problem to a static one: any exploration-and-stopping strategy is equivalent to a choice of the joint distribution of the stopped state and the stopping time, subject to one information-budget constraint at each date, and we characterize exactly which distributions are attainable. The reduced problem is a convex program with a linear objective; its dual prices information over time, and the optimal policy concavifies the stopping payoff net of these shadow prices. The curvature of the decision-maker's time preference then governs the shape of optimal exploration: convex time preference induces Poisson exploration, concave time preference confines stopping to a window whose length is controlled by the dispersion of the marginal cost of delay --- forcing an initial phase of pure exploration when the window is short --- and the linear case lies at the boundary between them. We apply the framework to real options, to the speed--accuracy tradeoff in information acquisition, and to a continuous-time exploration contest.
We study optimal consumption and portfolio policies for an agent with a finite planning horizon and an irreversible consumption ratcheting constraint. During the planning horizon, the agent may increase consumption but cannot reduce it. After the terminal date, the consumption level reached by that time is permanentl...
Junkee Jeon, Takwon Kim· Advances in Continuous and D...· 0 citations
A three-player game is constructed with a preferentially stable set whose span is dynamically unstable, showing that preferences do not suffice as a criterion of dynamic stability and bridges the gap via the notion of resilience under aggregate deviations.
Omar Abbadi, R. Laraki, P. Mertikopoulos· 2 citations
We study the value of information in predicting the evolving state of a finite Markov chain. At each stage, a decision maker chooses a state and observes only whether the current state of the chain matches her choice; the resulting information is used to make a prediction on the state at the final stage of the problem....
Motivated by markets in which new entrants challenge established monopolies, we study the problem of determining an optimal switching time for consumers facing competing stochastic price dynamics. In the particular case of the sequences of prices—or premiums—being sub-martingales, an optimal stopping time is described...
M. L. Esquível, N. P. Krasii· Global and Stochastic Analys...· 0 citations
Prediction markets have become a prominent way of aggregating beliefs about binary future events, and their price processes are often interpreted as evolving win probabilities, or ``win-martingales.''Motivated by this perspective and recent work on Aldous'``most exciting game,''we study when a decision maker should sto...
Steven Campbell, Karl Kristian Engelund· 0 citations
A two-player zero-sum repeated game between a learner and nature whose value identity generates Bayesian updating and an exact accounting of exponential-weights regret at once is given, and supplies the comparator-class variational form that a wide class of concentration phenomena share.
Akshay Balsubramani· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.