Timezone: »

 
Poster
Communication Efficient Distributed Machine Learning with the Parameter Server
Mu Li · David G Andersen · Alexander Smola · Kai Yu

Thu Dec 11 11:00 AM -- 03:00 PM (PST) @ Level 2, room 210D
in Poster Session »
This paper describes a third-generation parameter server framework for distributed machine learning. This framework offers two relaxations to balance system performance and algorithm efficiency. We propose a new algorithm that takes advantage of this framework to solve non-convex non-smooth problems with convergence guarantees. We present an in-depth analysis of two large scale machine learning problems ranging from $\ell_1$-regularized logistic regression on CPUs to reconstruction ICA on GPUs, using 636TB of real data with hundreds of billions of samples and dimensions. We demonstrate using these examples that the parameter server framework is an effective and straightforward way to scale machine learning to larger problems and systems than have been previously achieved.
[ PDF] 

Author Information

Mu Li (CMU)
David G Andersen (Carnegie Mellon University)
Alexander Smola (Amazon)

**AWS Machine Learning**

Kai Yu (Baidu)

More from the Same Authors