`

Timezone: »

 
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation
Shuai Lu · Daya Guo · Shuo Ren · Junjie Huang · Alexey Svyatkovskiy · Ambrosio Blanco · Colin Clement · Dawn Drain · Daxin Jiang · Duyu Tang · Ge Li · Lidong Zhou · Linjun Shou · Long Zhou · Michele Tufano · MING GONG · Ming Zhou · Nan Duan · Neel Sundaresan · Shao Kun Deng · Shengyu Fu · Shujie LIU

@ None
in Dataset and Benchmark Poster Session 1 »

Benchmark datasets have a significant impact on accelerating research in programming language tasks. In this paper, we introduce CodeXGLUE, a benchmark dataset to foster machine learning research for program understanding and generation. CodeXGLUE includes a collection of 10 tasks across 14 datasets and a platform for model evaluation and comparison. CodeXGLUE also features three baseline systems, including the BERT-style, GPT-style, and Encoder-Decoder models, to make it easy for researchers to use the platform. The availability of such data and baselines can help the development and validation of new methods that can be applied to various program understanding and generation problems.

[ Chat]  [ Paper ]

Author Information

Shuai Lu (Microsoft Research China)
Daya Guo (Sun Yat-Sen University)
Shuo Ren (Beihang University)
Junjie Huang (Beihang University)
Alexey Svyatkovskiy (Microsoft)
Ambrosio Blanco
Colin Clement (Microsoft)
Dawn Drain (Microsoft)
Daxin Jiang (Microsoft)
Duyu Tang (Microsoft Research)
Ge Li (Peking University)
Lidong Zhou (None)
Linjun Shou (Microsoft)
Long Zhou (Microsoft Research Asia)
Michele Tufano (Microsoft)
MING GONG (Microsoft)
Ming Zhou (Microsoft Research)
Nan Duan (Microsoft Research Asia)
Neel Sundaresan (Microsoft)
Shao Kun Deng (Microsoft)
Shengyu Fu
Shujie LIU (Microsoft)

More from the Same Authors