Poster
Eliciting Categorical Data for Optimal Aggregation
Chien-Ju Ho · Rafael Frongillo · Yiling Chen

Tue Dec 6th 06:00 -- 09:30 PM @ Area 5+6+7+8 #111 #None
in Tuesday Posters »

Models for collecting and aggregating categorical data on crowdsourcing platforms typically fall into two broad categories: those assuming agents honest and consistent but with heterogeneous error rates, and those assuming agents strategic and seek to maximize their expected reward. The former often leads to tractable aggregation of elicited data, while the latter usually focuses on optimal elicitation and does not consider aggregation. In this paper, we develop a Bayesian model, wherein agents have differing quality of information, but also respond to incentives. Our model generalizes both categories and enables the joint exploration of optimal elicitation and aggregation. This model enables our exploration, both analytically and experimentally, of optimal aggregation of categorical data and optimal multiple-choice interface design.

Keywords: (Other) Probabilistic Models and Methods · (Application) Web Applications and Internet Data · Game Theory and Econometrics

Author Information

Chien-Ju Ho (Cornell University)
Rafael Frongillo (CU Boulder)
Yiling Chen (Harvard University)

More from the Same Authors