Timezone: »
Word vector embeddings have been shown to contain and amplify biases in data they are extracted from. Consequently, many techniques have been proposed to identify, mitigate, and attenuate these biases in word representations. In this tutorial, we will review a collection of state-of-the-art debiasing techniques. To aid this, we provide an open source web-based visualization tool and offer hands-on experience in exploring the effects of these debiasing techniques on the geometry of high-dimensional word vectors. To help understand how various debiasing techniques change the underlying geometry, we decompose each technique into interpretable sequences of primitive operations, and study their effect on the word vectors using dimensionality reduction and interactive visual exploration.
Author Information
Archit Rathore (University of Utah)
Sunipa Dev (Google Research)
Computing Innovation Fellow 2020, Research Assistant at University of Utah, Postdoctoral Fellow at UCLA starting Jan 2020. Research interests are Responsible and Interpretable AI, NLP and Algorithmic Fairness.
Vivek Srikumar (University of Utah)
Jeff M Phillips (University of Utah)
Yan Zheng (Visa Research)
Michael Yeh (Visa Research)
Junpeng Wang (VISA Research)
Wei Zhang (Visa Research)
Bei Wang (University of Utah)
Bei Wang is an assistant professor at the School of Computing, a faculty member in the Scientific Computing and Imaging (SCI) Institute, and an adjunct assistant professor in the Department of Mathematics, University of Utah. She received her Ph.D. in Computer Science from Duke University. Her research interests include data visualization, topological data analysis, computational topology, computational geometry, machine learning, and data mining. She has worked on projects related to computational biology, bioinformatics, and robotics. Some of her current research activities draw inspirations from topology, geometry, and machine learning, in studying vector fields, tensor fields, high-dimensional point clouds, networks, and multivariate ensembles.
More from the Same Authors
-
2023 Poster: Building Socio-culturally Inclusive Stereotype Resources with Community Engagement »
Sunipa Dev · Jaya Goyal · Dinesh Tewari · Shachi Dave · Vinodkumar Prabhakaran -
2022 Workshop: Broadening Research Collaborations »
Sara Hooker · Rosanne Liu · Pablo Samuel Castro · FatemehSadat Mireshghallah · Sunipa Dev · Benjamin Rosman · João Madeira Araújo · Savannah Thais · Sara Hooker · Sunny Sanyal · Tejumade Afonja · Swapneel Mehta · Tyler Zhu -
2022 Poster: Batch Multi-Fidelity Active Learning with Budget Constraints »
Shibo Li · Jeff M Phillips · Xin Yu · Robert Kirby · Shandian Zhe -
2021 Poster: Self-Adaptable Point Processes with Nonparametric Time Decays »
Zhimeng Pan · Zheng Wang · Jeff M Phillips · Shandian Zhe -
2021 : PYLON: A PyTorch Framework for Learning with Constraints »
Kareem Ahmed · Tao Li · Nu Mai Thy Ton · Quan Guo · Kai-Wei Chang · Parisa Kordjamshidi · Vivek Srikumar · Guy Van den Broeck · Sameer Singh -
2020 Workshop: KR2ML - Knowledge Representation and Reasoning Meets Machine Learning »
Veronika Thost · Kartik Talamadupula · Vivek Srikumar · Chenwei Zhang · Josh Tenenbaum -
2020 : Invited Talk: Bei Wang: Topology and Neuron Activations in Deep Learning »
Bei Wang -
2019 : Invited Talk (Vivek Srikumar) »
Vivek Srikumar -
2016 Poster: The Robustness of Estimator Composition »
Pingfan Tang · Jeff M Phillips -
2014 Poster: Learning Distributed Representations for Structured Output Prediction »
Vivek Srikumar · Christopher D Manning -
2014 Spotlight: Learning Distributed Representations for Structured Output Prediction »
Vivek Srikumar · Christopher D Manning