Aug 2026· 1 citation· ⚡ 1 influential· 61 references
Computer Science
Abstract
We introduce TinyCast, an attention-free zero-shot forecaster that emits a predictive distribution from 146,505 parameters, on the premise that at this size the periodic structure of a context is worth computing rather than learning. A zero-parameter spectral detector supplies the dominant periods, the context is folded on their phase, and a dilated convolutional encoder and a block-autoregressive quantile decoder model the rest. It is smaller than every zero-shot entry on the GIFT-Eval board whose parameter count can be established. On probabilistic accuracy it defines the size-accuracy frontier. Among zero-shot entries declaring no test-data leakage it is the only one below 1.4M parameters that emits a predictive distribution, and every entry scoring better carries at least that budget. On Chronos-ZS and fev-bench every neural model ahead of it carries at least 28 times its parameters. Because the mixing path is convolutions and matrix multiplications only, it exports to static INT8 and forecasts end to end on an embedded device without per-signal fitting.
The evidence indicates that a frozen foundation model often matches a per-dataset deep model while removing training cost at deployment, though a tuned specialist still leads on some series.
Win Mathew John· Eduschool International Jour...· 0 citations
Four architectural additions that did not help, a computed lexicon reaching 94% of a learned table's top-1 accuracy at one fifth of the parameters, and a computed lexicon reaching 94% of a learned table's top-1 accuracy at one fifth of the parameters.
Rollout-Decoded Reconstruction (RDR) closes this gap with a single loss term that free-runs the model during training exactly as evaluation will, decodes every rollout latent, and penalizes reconstruction error against ground truth.
This work introduces a deterministic, pilot-informed selector for leaky linear reservoirs followed by coordinate-wise nonlinear features and positions free-probability kernels as deterministic surrogates for selecting reservoir operating regimes when validation rollouts are scarce.
Sara Malacarne, Andrea Ceni, Claudio Gallicchio· 0 citations
Halo is a modification that reuses an existing deep forecaster's architecture, giving it a second output for the scale of its implied distribution and training it under the matching negative log likelihood, and shows it improves the point estimate, in contrast to reported negative results for heteroscedastic estimation...
This work shows the attention layer itself can close that gap between deep models for irregularly-sampled time series answer queries at arbitrary continuous timestamps: with the right stochastic formulation, the pass that makes each prediction also reports how far it should be trusted.
S. Chatzis, Loukas Papadoulas· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.