Interior Decoration Domain
(object ids were not visible to the user during the study)
In this study, a static 3D bedroom scene is shown to the user. The system verbally asks the user a list of questions one at a time about the bedroom and the user answers the questions by speaking to the system.
Collected Data
- The collected data includes users' speech and accompanying gaze fixations (with possibly selected objects identified by the system).
- Users' speech was transcribed.
- Download data used for Languge Processing and Acquisition (data description):
- data w/o audio (496K)
- data w/ audio (87.5M)
- Download data used for Reference Resolution (data description):
- data w/o audio (357K)
- Download demo.
