RT-J: Large-Scale Pretraining of Relational Transformers for Context-Efficient Predictions
Foundation models for tables and relational databases are increasingly used for predictive tasks across various scientific and industrial domains. However, adapting existing models to unseen datasets requires tens of thousands of examples. Here we introduce RT-J, an 85M-parameter relational foundation model (RFM) that...
Rishabh Ranjan, Vignesh Kothapalli, Harsh Agarwal et al.
· 0 citations