Pretraining EHR Foundation Models with Patient-Aware Sampling
It is shown that stochastic Patient Sampling with controllable weighting improves performance on real-world EHR data, and training and validation sequence construction are identified as important and underexplored design choices for autoregressive EHR foundation models.