Si-Yuan Du

LoRKD: Low-Rank Knowledge Decomposition for Medical Foundation Models.

The widespread adoption of large-scale pre-training techniques has significantly advanced the development of medical foundation models, enabling them to serve as versatile tools across a broad range of medical tasks. However, despite their strong generalization capabilities, medical foundation models pre-trained on lar...