Timezone: »
In the recent decade, we have witnessed rapid progress in machine learning in general and deep learning in particular, mostly driven by tremendous data. As these intelligent algorithms, systems, and applications are deployed in real-world scenarios, we are now facing new challenges, such as scalability, security, privacy, trust, cost, regulation, and environmental and societal impacts. In the meantime, data privacy and ownership has become more and more critical in many domains, such as finance, health, government, and social networks. Federated learning (FL) has emerged to address data privacy issues. To make FL practically scalable, useful, efficient, and effective on security and privacy mechanisms and policies, it calls for joint efforts from the community, academia, and industry. More challenges, interplays, and tradeoffs in scalability, privacy, and security need to be investigated in a more holistic and comprehensive manner by the community. We are expecting broader, deeper, and greater evolution of these concepts and technologies, and confluence towards holistic trustworthy AI ecosystems.
This workshop provides an open forum for researchers, practitioners, and system builders to exchange ideas, discuss, and shape roadmaps towards scalable and privacy-preserving federated learning in particular, and scalable and trustworthy AI ecosystems in general.
Sat 8:20 a.m. - 8:30 a.m.
|
Opening Remarks
Introductory comments by the organizers. |
Xiaolin Andy Li 🔗 |
Sat 8:30 a.m. - 9:00 a.m.
|
Keynote Talk 1: Dawn Song
|
🔗 |
Sat 9:00 a.m. - 9:15 a.m.
|
A Better Alternative to Error Feedback for Communication-Efficient Distributed Learning, Samuel Horváth and Peter Richtárik
(
Contributed Talk
)
|
🔗 |
Sat 9:15 a.m. - 9:30 a.m.
|
Backdoor Attacks on Federated Meta-Learning, Chien-Lun Chen, Leana Golubchik and Marco Paolieri
(
Contributed Talk
)
|
🔗 |
Sat 9:30 a.m. - 9:45 a.m.
|
FedBE: Making Bayesian Model Ensemble Applicable to Federated Learning, Hong-You Chen and Wei-Lun Chao
(
Contributed Talk
)
|
🔗 |
Sat 9:45 a.m. - 10:00 a.m.
|
Preventing Backdoors in Federated Learningby Adjusting Server-side Learning Rate, Mustafa Ozdayi, Murat Kantarcioglu and Yulia Gel
(
Contributed Talk
)
|
🔗 |
Sat 10:00 a.m. - 10:30 a.m.
|
Keynote Talk 2: H. Brendan McMahan
|
🔗 |
Sat 10:30 a.m. - 10:50 a.m.
|
Lightning Talk Session 1: 10 papers, 2m each
(
Lightning Talk Session 1
)
|
🔗 |
Sat 10:50 a.m. - 11:20 a.m.
|
Keynote Talk 3: Ruslan Salakhutdinov
|
🔗 |
Sat 11:20 a.m. - 11:35 a.m.
|
FedML: A Research Library and Benchmark for Federated Machine Learning, Chaoyang He, et. al.
(
Contributed Talk
)
Chaoyang He, Songze Li, Jinhyun So, Mi Zhang, Xiao Zeng, Hongyi Wang, Xiaoyang Wang, Praneeth Vepakomma, Abhishek Singh, Hang Qiu, Xinghua Zhu, Jianzong Wang, Li Shen, Peilin Zhao, Yan Kang, Yang Liu, Ramesh Raskar, Qiang Yang, Murali Annavaram and Salman Avestimehr |
🔗 |
Sat 11:35 a.m. - 11:50 a.m.
|
Learning to Attack Distributionally Robust Federated Learning, Wen Shen, Henger Li and Zizhan Zheng
(
Contributed Talk
)
|
🔗 |
Sat 11:50 a.m. - 12:20 p.m.
|
Keynote Talk 4: Virginia Smith
|
🔗 |
Sat 12:20 p.m. - 12:36 p.m.
|
Lightning Talk Session 2: 8 papers, 2m each
(
Lightning Talk Session 2
)
|
🔗 |
Sat 12:36 p.m. - 1:30 p.m.
|
Poster Session 1
|
🔗 |
Sat 1:30 p.m. - 2:00 p.m.
|
Keynote Talk 5: John C. Duchi
|
🔗 |
Sat 2:00 p.m. - 2:15 p.m.
|
On Biased Compression for Distributed Learning, Aleksandr Beznosikov, Samuel Horváth, Mher Safaryan and Peter Richtarik
(
Contributed Talk
)
|
🔗 |
Sat 2:15 p.m. - 2:30 p.m.
|
PAC Identifiability in Federated Personalization, Ben London
(
Contributed Talk
)
|
🔗 |
Sat 2:30 p.m. - 2:45 p.m.
|
Model Pruning Enables Efficient Federated Learning on Edge Devices, Yuang Jiang, Shiqiang Wang, Victor Valls, Bong Jun Ko, Wei-Han Lee, Kin Leung and Leandros Tassiulas
(
Contributed Talk
)
|
🔗 |
Sat 2:45 p.m. - 3:00 p.m.
|
Hybrid FL: Algorithms and Implementation, Xinwei Zhang, Tianyi Chen, Mingyi Hong and Wotao Yin
(
Contributed Talk
)
|
🔗 |
Sat 3:00 p.m. - 3:30 p.m.
|
Break
|
🔗 |
Sat 3:30 p.m. - 4:00 p.m.
|
Keynote Talk 6: Tao Yang
|
🔗 |
Sat 4:00 p.m. - 4:20 p.m.
|
Lightning Talk Session 3: 10 papers, 2m each
(
Lightning Talk Session 3
)
|
🔗 |
Sat 4:20 p.m. - 4:50 p.m.
|
Keynote Talk 7: Tong Zhang
|
🔗 |
Sat 4:50 p.m. - 5:00 p.m.
|
Lightning Talk Session 4: 5 papers, 2m each
(
Lightning Talk Session 4
)
|
🔗 |
Sat 5:00 p.m. - 6:00 p.m.
|
Panel Discussion
|
🔗 |
Sat 6:00 p.m. - 7:00 p.m.
|
Poster Session 2 (Papers presented in the afternoon)
|
🔗 |
Sat 7:00 p.m. - 7:10 p.m.
|
Closing Remarks
(
Talk
)
Comments by the organizers |
Xiaolin Andy Li 🔗 |
Author Information
Xiaolin Andy Li (Cognization Lab)
Dr. Xiaolin Andy Li is the Chief Scientist at Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences (CAS), heading the Center for AI and Intelligent Medicine (AIM). He is also the founder of ElasticMind.AI. He was a Partner of Tongdun Technology, heading the AI Institute and Cognization Lab at Palo Alto Square, near Stanford University. He was a tenured Full Professor and University Term Professor in Computer Engineering at the University of Florida. As the founding center director, he founded NSF Center for Big Learning (CBL) with UF, CMU, UMKC and UO and three dozens of leading companies as industry members, the first national center on deep learning in USA. He was also the director of Large-scale Intelligent Systems Laboratory (Li Lab). His research interests include machine learning/deep learning, intelligent platform, cloud computing, Internet-of-Things, security & privacy, precision medicine, and logistics. He led the design and deployment of one of the first software-defined 100G campus research networks and campus clouds GatorCloud, the best campus research network in the nation. His team designed and developed many platforms and tools, such as DeepCloud, CognitiveEngine, DeepEyes, OneTask, DeepSLAM, CloudBay, SMART, GemsCloud, Guoguo, FindingNemo, ToGathor, DeepDDoS, DeepMalware, S3PAS, DeepFolding, FoldingZero, PrimateAI, MySurgeryRisk and DeepDrug. He received the NSF CAREER Award, the Internet2 Innovative Application Award, NSF I-Corps Top Team Award, Top Team Award (DeepBipolar) in the CAGI Challenge, and Best Paper Awards (IEEE ICMLA 2016, IEEE SECON 2016, ACM CAC 2013, and IEEE UbiSafe 2007). He has published over 150 peer-reviewed papers and dozens of patent applications. He received PhD in Computer Engineering from Rutgers University.
Dejing Dou (" University of Oregon, USA")
Ameet Talwalkar (CMU)
Hongyu Li (tongdun)
Jianzong Wang (Ping An Technology (Shenzhen) Co., Ltd)
Yanzhi Wang (Northeastern University)
More from the Same Authors
-
2020 : Paper 20: YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design »
YUXUAN CAI · Wei Niu · Yanzhi Wang -
2021 Spotlight: Property-Aware Relation Networks for Few-Shot Molecular Property Prediction »
Yaqing Wang · Abulikemu Abuduweili · Quanming Yao · Dejing Dou -
2021 Spotlight: MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge »
Geng Yuan · Xiaolong Ma · Wei Niu · Zhengang Li · Zhenglun Kong · Ning Liu · Yifan Gong · Zheng Zhan · Chaoyang He · Qing Jin · Siyue Wang · Minghai Qin · Bin Ren · Yanzhi Wang · Sijia Liu · Xue Lin -
2021 : Simulated User Studies for Explanation Evaluation »
Valerie Chen · Gregory Plumb · Nicholay Topin · Ameet S Talwalkar -
2021 : Bayesian Persuasion for Algorithmic Recourse »
Keegan Harris · Valerie Chen · Joon Sik Kim · Ameet Talwalkar · Hoda Heidari · Steven Wu -
2021 : Bayesian Persuasion for Algorithmic Recourse »
Keegan Harris · Valerie Chen · Joon Kim · Ameet S Talwalkar · Hoda Heidari · Steven Wu -
2021 : Bayesian Persuasion for Algorithmic Recourse »
Keegan Harris · Valerie Chen · Joon Kim · Ameet S Talwalkar · Hoda Heidari · Steven Wu -
2022 : AutoML for Climate Change: A Call to Action »
Renbo Tu · Nicholas Roberts · Vishak Prasad C · Sibasis Nayak · Paarth Jain · Frederic Sala · Ganesh Ramakrishnan · Ameet Talwalkar · Willie Neiswanger · Colin White -
2022 Competition: AutoML Decathlon: Diverse Tasks, Modern Methods, and Efficiency at Scale »
Samuel Guo · Cong Xu · Nicholas Roberts · Misha Khodak · Junhong Shen · Evan Sparks · Ameet Talwalkar · Yuriy Nevmyvaka · Frederic Sala · Anderson Schneider -
2022 Poster: Use-Case-Grounded Simulations for Explanation Evaluation »
Valerie Chen · Nari Johnson · Nicholay Topin · Gregory Plumb · Ameet Talwalkar -
2022 Poster: Provably tuning the ElasticNet across instances »
Maria-Florina Balcan · Misha Khodak · Dravyansh Sharma · Ameet Talwalkar -
2022 Poster: Learning Predictions for Algorithms with Predictions »
Misha Khodak · Maria-Florina Balcan · Ameet Talwalkar · Sergei Vassilvitskii -
2022 Poster: SparCL: Sparse Continual Learning on the Edge »
Zifeng Wang · Zheng Zhan · Yifan Gong · Geng Yuan · Wei Niu · Tong Jian · Bin Ren · Stratis Ioannidis · Yanzhi Wang · Jennifer Dy -
2022 Poster: Advancing Model Pruning via Bi-level Optimization »
Yihua Zhang · Yuguang Yao · Parikshit Ram · Pu Zhao · Tianlong Chen · Mingyi Hong · Yanzhi Wang · Sijia Liu -
2022 Poster: Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training »
Geng Yuan · Yanyu Li · Sheng Li · Zhenglun Kong · Sergey Tulyakov · Xulong Tang · Yanzhi Wang · Jian Ren -
2022 Poster: Efficient Architecture Search for Diverse Tasks »
Junhong Shen · Misha Khodak · Ameet Talwalkar -
2022 Poster: EfficientFormer: Vision Transformers at MobileNet Speed »
Yanyu Li · Geng Yuan · Yang Wen · Ju Hu · Georgios Evangelidis · Sergey Tulyakov · Yanzhi Wang · Jian Ren -
2022 Poster: Bayesian Persuasion for Algorithmic Recourse »
Keegan Harris · Valerie Chen · Joon Kim · Ameet Talwalkar · Hoda Heidari · Steven Wu -
2022 Poster: NAS-Bench-360: Benchmarking Neural Architecture Search on Diverse Tasks »
Renbo Tu · Nicholas Roberts · Misha Khodak · Junhong Shen · Frederic Sala · Ameet Talwalkar -
2021 : [S9] Simulated User Studies for Explanation Evaluation »
Valerie Chen · Gregory Plumb · Nicholay Topin · Ameet S Talwalkar -
2021 : Bayesian Persuasion for Algorithmic Recourse »
Keegan Harris · Valerie Chen · Joon Sik Kim · Ameet Talwalkar · Hoda Heidari · Steven Wu -
2021 Poster: Property-Aware Relation Networks for Few-Shot Molecular Property Prediction »
Yaqing Wang · Abulikemu Abuduweili · Quanming Yao · Dejing Dou -
2021 Poster: Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing »
Mikhail Khodak · Renbo Tu · Tian Li · Liam Li · Maria-Florina Balcan · Virginia Smith · Ameet Talwalkar -
2021 Poster: ScaleCert: Scalable Certified Defense against Adversarial Patches with Sparse Superficial Layers »
Husheng Han · Kaidi Xu · Xing Hu · Xiaobing Chen · LING LIANG · Zidong Du · Qi Guo · Yanzhi Wang · Yunji Chen -
2021 Poster: Validating the Lottery Ticket Hypothesis with Inertial Manifold Theory »
Zeru Zhang · Jiayin Jin · Zijie Zhang · Yang Zhou · Xin Zhao · Jiaxiang Ren · Ji Liu · Lingfei Wu · Ruoming Jin · Dejing Dou -
2021 Poster: Rethinking Neural Operations for Diverse Tasks »
Nicholas Roberts · Mikhail Khodak · Tri Dao · Liam Li · Christopher Ré · Ameet Talwalkar -
2021 Poster: Generalized DataWeighting via Class-Level Gradient Manipulation »
Can Chen · Shuhao Zheng · Xi Chen · Erqun Dong · Xue (Steve) Liu · Hao Liu · Dejing Dou -
2021 Poster: Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot? »
Xiaolong Ma · Geng Yuan · Xuan Shen · Tianlong Chen · Xuxi Chen · Xiaohan Chen · Ning Liu · Minghai Qin · Sijia Liu · Zhangyang Wang · Yanzhi Wang -
2021 Poster: Learning-to-learn non-convex piecewise-Lipschitz functions »
Maria-Florina Balcan · Mikhail Khodak · Dravyansh Sharma · Ameet Talwalkar -
2021 Poster: MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge »
Geng Yuan · Xiaolong Ma · Wei Niu · Zhengang Li · Zhenglun Kong · Ning Liu · Yifan Gong · Zheng Zhan · Chaoyang He · Qing Jin · Siyue Wang · Minghai Qin · Bin Ren · Yanzhi Wang · Sijia Liu · Xue Lin -
2020 : Closing Remarks »
Xiaolin Andy Li -
2020 : Opening Remarks »
Xiaolin Andy Li -
2020 Poster: Regularizing Black-box Models for Improved Interpretability »
Gregory Plumb · Maruan Al-Shedivat · Ángel Alexander Cabrera · Adam Perer · Eric Xing · Ameet Talwalkar -
2020 Poster: Adversarial Attacks on Deep Graph Matching »
Zijie Zhang · Zeru Zhang · Yang Zhou · Yelong Shen · Ruoming Jin · Dejing Dou -
2019 : TBD »
Ameet Talwalkar -
2019 Poster: Adaptive Gradient-Based Meta-Learning Methods »
Misha Khodak · Maria-Florina Balcan · Ameet Talwalkar -
2018 Poster: Model Agnostic Supervised Local Explanations »
Gregory Plumb · Denali Molitor · Ameet Talwalkar -
2017 Poster: Variable Importance Using Decision Trees »
Jalil Kazemitabar · Arash Amini · Adam Bloniarz · Ameet S Talwalkar -
2017 Poster: Federated Multi-Task Learning »
Virginia Smith · Chao-Kai Chiang · Maziar Sanjabi · Ameet S Talwalkar -
2016 : Invited Talk: Paleo: A Performance Model for Deep Neural Networks (Ameet Talwalkar, UCLA) »
Ameet S Talwalkar -
2016 Poster: Yggdrasil: An Optimized System for Training Deep Decision Trees at Scale »
Firas Abuzaid · Joseph K Bradley · Feynman Liang · Andrew Feng · Lee Yang · Matei Zaharia · Ameet S Talwalkar -
2014 Workshop: Distributed Machine Learning and Matrix Computations »
Reza Zadeh · Ion Stoica · Ameet S Talwalkar -
2011 Workshop: Sparse Representation and Low-rank Approximation »
Ameet S Talwalkar · Lester W Mackey · Mehryar Mohri · Michael W Mahoney · Francis Bach · Mike Davies · Remi Gribonval · Guillaume R Obozinski -
2011 Poster: Divide-and-Conquer Matrix Factorization »
Lester W Mackey · Ameet S Talwalkar · Michael Jordan -
2010 Workshop: Low-rank Methods for Large-scale Machine Learning »
Arthur Gretton · Michael W Mahoney · Mehryar Mohri · Ameet S Talwalkar -
2009 Poster: Ensemble Nystrom Method »
Sanjiv Kumar · Mehryar Mohri · Ameet S Talwalkar