Competition
Edge-LLMs: Edge-Device Large Language Model Competition
Shiwei Liu · Kai Han · Adriana Fernandez-Lopez · AJAY JAISWAL · Zahra Atashgahi · Boqian Wu · Edoardo Maria Ponti · Cong Hao · Rebekka Burkholz · Olga Saukh · Lu Yin · Andreas Zinonos · Tianjin Huang · Jared Tanner · Yunhe Wang
West Meeting Room 209
The Edge-Device Large Language Model Competition seeks to explore the capabilities and potential of large language models (LLMs) deployed directly on edge devices. The incredible capacity of LLMs makes it extremely tantalizing to be applied to practical edge devices to enable wide applications of LLMs in various disciplines. However, the massive size of LLMs poses significant challenges for edge devices where the computing resources and memory are strictly limited. For instance, deploying a small-scale 10B LLM could require up to 20GB of main memory (DRAM) even after adopting INT8 quantization, which unfortunately has exceeded the memory of most commodity smartphones. Besides, the high energy consumption of LLMs will drain smartphones' battery quickly. To facilitate applications of LLMs in a wide range of practical scenarios, we propose this timely competition to encourage practitioners in both academia and industry to come up with effective solutions for this pressing need. By challenging participants to develop efficient and optimized models that can run on resource-constrained edge devices, the competition aims to address critical economic and environmental issues related to LLMs, foster interdisciplinary research collaborations, and enhance the privacy and security of AI systems.
Live content is unavailable. Log in and register to view live content
Schedule
Sun 1:30 p.m. - 1:35 p.m.
|
Opening Remarks
(
Kai Han
)
>
|
Kai Han 🔗 |
Sun 1:35 p.m. - 2:05 p.m.
|
Invited Spearker: Tianqi Chen
(
Invited Talk
)
>
SlidesLive Video |
Tianqi Chen 🔗 |
Sun 2:05 p.m. - 2:35 p.m.
|
Invited Speaker: Pavlo Molchanov
(
Invited talk
)
>
|
Pavlo Molchanov 🔗 |
Sun 2:35 p.m. - 2:50 p.m.
|
Oral Presentation from the winning team Tinytron
(
Oral presentation
)
>
|
Lvfang Tao 🔗 |
Sun 3:15 p.m. - 3:45 p.m.
|
Invited Spearker: Boxing Chen (Invited Talk)
(
Invited talk
)
>
|
🔗 |
Sun 3:45 p.m. - 4:15 p.m.
|
Invited Spearker: Atlas Wang (Invited Talk)
(
Invited talk
)
>
SlidesLive Video |
Zhangyang "Atlas" Wang 🔗 |
Sun 4:15 p.m. - 4:30 p.m.
|
Oral Presentation from the winning team NICSEffalg
(
Oral presentation
)
>
|
Xuefei Ning 🔗 |
Sun 4:30 p.m. - 4:30 p.m.
|
Award Ceremony
(
Feng Wen
)
>
|
🔗 |