Stephen O. Mussmann

Learning Computational Structure for Sample-Efficient Prediction

Inspired by the spatial organization of biological neural circuits, LeWi is introduced: each neuron has a learned low-dimensional embedding, only nearby neurons connect, and embeddings and weights are trained jointly, showing that jointly learning connectivity and weights can exploit computational structure to improve...