Lab, News

New Publication at HCI+NLP Workshop @ EACL

SIGNAL Lab Ph.D. student Nada Alalyani and I have a new publication that will be appearing at the Bridging HCI and NLP workshop at the EACL conference in April! Embodied Multimodal Agents to Bridge the Understanding Gap argues that embodied multimodal agents such as virtual avatars and robots play an important role in moving natural language processing toward “deep understanding,” and a demonstrable retrieval of communicative intent from an utterance, a la the definition propounded by Emily Bender and Alexander Koller in their “Climbing towards NLU” paper from last year’s ACL. We discuss the role of multimodal conversational systems in computationally modeling contextually-grounded communication, and discuss ongoing experiments in multimodal referring expression interpretation and generation as an illustrative use case, using CSU/Brandeis/UF’s very own Diana agent.

The HCI+NLP workshop will be held in conjunction with the EACL conference, April 20th. The conference will be held virtually (may we banish COVID and return to in-person events soon!). Before the proceedings are released, the paper can be viewed here on my personal website, and will be appearing on arXiv soon.

Related article

Best Demo at ICAT-EGVE 2020

Our demo, Situational Awareness in Human Computer Interaction: Diana’s World has won the best demo...

Read more

SIGNAL Lab Colloquium Video

Traditionally, computer science faculty at CSU give rapid-fire research presentations at the beginning of the...

Read more

Neurosymbolic AI at ACS 2020

Today I presented a long paper, “Neurosymbolic AI for Situated Language Understanding” at the Advances...

Read more