Interior Decoration Domain
In this domain, users were asked to accomplish tasks in two scenarios. Each scenario put the user into a specific role (e.g., college student, professor, etc.), and the task had to be completed with a set of constraints (e.g., budget of furnishings, bed size, number of domestic products, etc.). Users interacted with the system through a touchscreen using speech and deictic gesture.
Collected Data
- The collected data includes users' speech and accompanying gestures (with possibly selected objects identified by the system).
- Users' speech was transcribed; the intention (action to perform on an object) of each utterance and the true gesture selection were annotated.
- Download data (data description):
- data w/o audio (598K)
- data w/ audio (43.6M)
