Giacomo Cirò

Scaling recipes for single-cell RNA sequencing foundation models: when do scaling laws hold?

Empirical relationships linking the optimal learning rate and depth-to-width ratio to model size and depth or compute provide a quantitative framework for estimating the expected returns from additional resources and selecting suitable hyperparameters and architectures, thereby supporting the development of increasingl...