Timezone: »

 
Poster
Answerer in Questioner's Mind: Information Theoretic Approach to Goal-Oriented Visual Dialog
Sang-Woo Lee · Yu-Jung Heo · Byoung-Tak Zhang

Tue Dec 04 02:00 PM -- 04:00 PM (PST) @ Room 210 #95
in Tue Poster Session B »

Goal-oriented dialog has been given attention due to its numerous applications in artificial intelligence. Goal-oriented dialogue tasks occur when a questioner asks an action-oriented question and an answerer responds with the intent of letting the questioner know a correct action to take. To ask the adequate question, deep learning and reinforcement learning have been recently applied. However, these approaches struggle to find a competent recurrent neural questioner, owing to the complexity of learning a series of sentences. Motivated by theory of mind, we propose "Answerer in Questioner's Mind" (AQM), a novel information theoretic algorithm for goal-oriented dialog. With AQM, a questioner asks and infers based on an approximated probabilistic model of the answerer. The questioner figures out the answerer’s intention via selecting a plausible question by explicitly calculating the information gain of the candidate intentions and possible answers to each question. We test our framework on two goal-oriented visual dialog tasks: "MNIST Counting Dialog" and "GuessWhat?!". In our experiments, AQM outperforms comparative algorithms by a large margin.

Keywords: Visual Question Answering · Dialog- or Communication-Based Learning
[ Paper]  [ Poster] 

Author Information

Sang-Woo Lee (Naver Corp.)
Yu-Jung Heo (Seoul National University)
Byoung-Tak Zhang (Seoul National University & Surromind Robotics)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors