In-Memory Computing Architectures for Accelerating Large-Scale Models: Principles, Devices, and System Challenges
Memory bandwidth is the binding constraint for large-model inference today. In-memory computing (IMC) addresses this limitation. This paper reviews where the technology stands. It compares analog and digital IMC implementations and find that analog arrays currently lead on energy efficiency, while digital designs maint...