Lab, News, Grants

DARPA FACT AIE Award

I am beyond excited that we have been awarded a contract on the DARPA Friction and Accountability in Conversational Transactions (FACT) AI Exploration program! Our project, TRACE: Transparency, Reflection, and Accountability in Conversational Exchanges, will address a lack of “friction” (deliberation and reflective reasoning) in LLMs that prevent them from being used reliably in mission-critical workflows.

Put simply, LLMs are incentivized to accept the premises in whatever is input to them, even if false or faulty, and generate responses accordingly. This is due to an inability to track and assess the validity of beliefs held by their interlocutors. Theory of Mind (ToM) provides a way of measuring and tracking such beliefs, such as in the course of a shared collaborative task. Therefore we’re going to build ToM into LLMs.

This project is a collaboration with Dr. James Pustejovsky at Brandeis University. Other CSU personnel include Dr. Nate Blanchard, Dr. Sarath Sreedharan, and Dr. Bruce Draper. I’m very excited to lead this excellent team!

(X-posted on nikhilkrishnaswamy.com)

Related article

Best Paper Nominee at HAI 2024 and AAAI Demo

Congratulations to Ph.D. student Sheikh Mannan and former SIGNAL Lab undergraduate researcher Paige Hansen! Our...

Read more

Congratulations to Shadi Manafi!

Congratulations to Dr. **Shadi Manafi** for successfully defending her Ph.D. dissertation! In Shadi's dissertation, *Smart...

Read more

Best Paper Award at EDM 2024

Exciting news! Our paper, *Propositional Extraction from Natural Speech in Small Group Collaborative Tasks*, was...

Read more