|
Poster
|
Tue 9:00 |
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models Yonatan Bitton · Nitzan Bitton Guetta · Ron Yosef · Yuval Elovici · Mohit Bansal · Gabriel Stanovsky · Roy Schwartz |
|
|
Poster
|
Thu 9:00 |
Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real world Eugene Vinitsky · Nathan Lichtlé · Xiaomeng Yang · Brandon Amos · Jakob Foerster |
|
|
Poster
|
Thu 9:00 |
CARLANE: A Lane Detection Benchmark for Unsupervised Domain Adaptation from Simulation to multiple Real-World Domains Bonifaz Stuhr · Johann Haselberger · Julian Gebele |
|
|
Poster
|
Tue 9:00 |
FinRL-Meta: Market Environments and Benchmarks for Data-Driven Financial Reinforcement Learning Xiao-Yang Liu · Ziyi Xia · Jingyang Rui · Jiechao Gao · Hongyang Yang · Ming Zhu · Christina Wang · Zhaoran Wang · Jian Guo |
|
|
Poster
|
Tenrec: A Large-scale Multipurpose Benchmark Dataset for Recommender Systems Guanghu Yuan · Fajie Yuan · Yudong Li · Beibei Kong · Shujie Li · Lei Chen · Min Yang · Chenyun YU · Bo Hu · Zang Li · Yu Xu · Xiaohu Qie |
||
|
Poster
|
TGEA 2.0: A Large-Scale Diagnostically Annotated Dataset with Benchmark Tasks for Text Generation of Pretrained Language Models Huibin Ge · Xiaohu Zhao · Chuang Liu · Yulong Zeng · Qun Liu · Deyi Xiong |
||
|
Poster
|
BLOX: Macro Neural Architecture Search Benchmark and Algorithms Thomas Chau · Łukasz Dudziak · Hongkai Wen · Nicholas Lane · Mohamed Abdelfattah |
||
|
Poster
|
BackdoorBench: A Comprehensive Benchmark of Backdoor Learning Baoyuan Wu · Hongrui Chen · Mingda Zhang · Zihao Zhu · Shaokui Wei · Danni Yuan · Chao Shen |
||
|
Panel
|
Wed 10:30 |
Panel 3C-7: MineDojo: Building Open-Ended… & Avalon: A Benchmark… Linxi Fan · Joshua Albrecht |
|
|
Tutorial
|
Mon 5:20 |
The problem: currently used settings and benchmarks Gido van de Ven |
|
|
Poster
|
Thu 9:00 |
3DOS: Towards 3D Open Set Learning - Benchmarking and Understanding Semantic Novelty Detection on Point Clouds Antonio Alliegro · Francesco Cappio Borlino · Tatiana Tommasi |
|
|
Poster
|
Wed 14:00 |
FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settings Jean Ogier du Terrail · Samy-Safwan Ayed · Edwige Cyffers · Felix Grimberg · Chaoyang He · Regis Loeb · Paul Mangold · Tanguy Marchand · Othmane Marfoq · Erum Mushtaq · Boris Muzellec · Constantin Philippenko · Santiago Silva · Maria Teleńczuk · Shadi Albarqouni · Salman Avestimehr · Aurélien Bellet · Aymeric Dieuleveut · Martin Jaggi · Sai Praneeth Karimireddy · Marco Lorenzi · Giovanni Neglia · Marc Tommasi · Mathieu Andreux |