Prompting Particle Physics: Tokenized Multi-modal Foundation Models for Combinatorially Many Tasks
This work represents every object in a jet in a single shared token vocabulary and train one model to map any subset of these modalities to any other, with the autoregressive model particularly faithful to output from Geant4.