|
Workshop
|
|
BudgetLongformer: Can we Cheaply Pretrain a SOTA Legal Language Model From Scratch?
Joel Niklaus · Daniele Giofrè
|
|
|
Poster
|
Tue 9:00
|
CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning
Hung Le · Yue Wang · Akhilesh Deepak Gotmare · Silvio Savarese · Steven Chu Hong Hoi
|
|
|
Affinity Workshop
|
|
Panel: Pretrained Language Models for North African Languages: Prospects and Challenges
|
|
|
Workshop
|
|
Hidden State Variability of Pretrained Language Models Can Guide Computation Reduction for Transfer Learning
Shuo Xie · Jiahao Qiu · Ankita Pasad · Li Du · Qing Qu · Hongyuan Mei
|
|
|
Workshop
|
|
Pretrained protein language model transfer learning: is the final layer representation what we want?
Francesca-Zhoufan Li · Ava Soleimany · Kevin Yang · Alex X Lu
|
|
|
Poster
|
Tue 9:00
|
Generating Training Data with Language Models: Towards Zero-Shot Language Understanding
Yu Meng · Jiaxin Huang · Yu Zhang · Jiawei Han
|
|
|
Poster
|
Tue 14:00
|
CyCLIP: Cyclic Contrastive Language-Image Pretraining
Shashank Goel · Hritik Bansal · Sumit Bhatia · Ryan Rossi · Vishwa Vinay · Aditya Grover
|
|
|
Poster
|
Wed 14:00
|
Self-Supervised Pretraining for Large-Scale Point Clouds
Zaiwei Zhang · Min Bai · Erran Li Li
|
|
|
Workshop
|
|
Pretraining the Vision Transformer using self-supervised methods for vision based Deep Reinforcement Learning
Manuel Goulão · Arlindo L Oliveira
|
|
|
Workshop
|
|
Probing Representations of Numbers in Vision and Language Models
Ivana Kajic · Aida Nematzadeh
|
|
|
Poster
|
|
TGEA 2.0: A Large-Scale Diagnostically Annotated Dataset with Benchmark Tasks for Text Generation of Pretrained Language Models
Huibin Ge · Xiaohu Zhao · Chuang Liu · Yulong Zeng · Qun Liu · Deyi Xiong
|
|
|
Poster
|
Wed 14:00
|
Deep Bidirectional Language-Knowledge Graph Pretraining
Michihiro Yasunaga · Antoine Bosselut · Hongyu Ren · Xikun Zhang · Christopher D Manning · Percy Liang · Jure Leskovec
|
|
