CED-EF: Compressed Exact Diffusion with Error Feedback for Multi-Agent Learning
We study decentralized stochastic optimization over a network of $N$ agents under compressed communication. We propose CED-EF, an exact diffusion-based method with error feedback that directly accommodates biased $\delta$-contractive compressors while communicating one compressed model-sized vector per node per iterati...