Lab, News, Grants

DARPA FACT AIE Award

I am beyond excited that we have been awarded a contract on the DARPA Friction and Accountability in Conversational Transactions (FACT) AI Exploration program! Our project, TRACE: Transparency, Reflection, and Accountability in Conversational Exchanges, will address a lack of “friction” (deliberation and reflective reasoning) in LLMs that prevent them from being used reliably in mission-critical workflows.

Put simply, LLMs are incentivized to accept the premises in whatever is input to them, even if false or faulty, and generate responses accordingly. This is due to an inability to track and assess the validity of beliefs held by their interlocutors. Theory of Mind (ToM) provides a way of measuring and tracking such beliefs, such as in the course of a shared collaborative task. Therefore we’re going to build ToM into LLMs.

This project is a collaboration with Dr. James Pustejovsky at Brandeis University. Other CSU personnel include Dr. Nate Blanchard, Dr. Sarath Sreedharan, and Dr. Bruce Draper. I’m very excited to lead this excellent team!

(X-posted on nikhilkrishnaswamy.com)

Related article

CS Department Scholarship Recipients

Three SIGNAL Lab students were awarded scholarships by the CSU CS department for meritorious achievements...

Read more

Congratulations to Hannah VanderHoeven!

Congratulations to **Hannah VanderHoeven** on successfully defending her Master's thesis! Hannah's thesis is entitled *Robust...

Read more

LREC-COLING Hat Trick and Other Stories

We are delighted to be 3 for 3 on submissions to LREC-COLING 2024, the first...

Read more