This project Context-enriched semantic parsing, funded by the Labex EFL, aims at bootstrapping a new line of research that focuses on the handling of extra linguistics features for semantic parsing. The global idea is to anchor the analysis of a user-generated content with its direct environment, meaning extra-linguistics context.
So far we annotated a whole multimodal data set based on Alien vs Predator game's players interactions, that contains full transcript of all users discourse , non verbal reaction, games elements interactions and so on.
More to come !