Successive Capacity Growth: Task-Complexity-Driven Width and Depth Expansion for Vision Transformer Encoders in JEPA World Models
Successive Capacity Growth (SCG) is proposed, a method that starts from a minimal encoder and grows incrementally in width or depth and can grow successively as the task demands, achieving significant compute and data efficiency while maintaining representation quality.
Frederik Berenz
· 0 citations