Walk the Talk? Measuring the Faithfulness of Large Language Model Explanations
Katie Matton, Robert Osazuwa Ness, John Guttag, Emre Kiciman
2025 International Conference on Learning Representations | April 2025
Robert Osazuwa Ness
Senior Researcher
Papiers de Collaboration
-
-
-
-
Causal Reasoning and Large Language Models: Opening a New Frontier for Causality
Emre Kiciman, Robert Osazuwa Ness, Amit Sharma, Chenhao Tan
Transactions on Machine Learning Research (TMLR) | August 2024
Featured Certification
Selected for presentation at ICLR 2025
-
MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answering
Robert Osazuwa Ness, Hayden Helm, Katie Matton, Sheng Zhang, Junaid Bajwa, Carey E. Priebe, Eric Horvitz
June 2024
-
From Local to Global: A Graph RAG Approach to Query-Focused Summarization
Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, Dasha Metropolitansky, Robert Osazuwa Ness, Jonathan Larson
April 2024
-
-
-
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
Harsha Nori, Yin Tat Lee, Sheng Zhang, Dean Carignan, Richard Edgar, Nicolo Fusi, Nicholas King, Jonathan Larson, Yuanzhi Li, Weishung Liu, Renqian Luo, Scott Mayer McKinney, Robert Osazuwa Ness, Hoifung Poon, Tao Qin, Naoto Usuyama, Chris White, Eric Horvitz
November 2023
-
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
-
Knowledge Guided Representation Learning and Causal Structure Learning in Soil Science
Somya Sharma, Swati Sharma, Licheng Liu, Rishabh Tushir, Andy Neal, Robert Osazuwa Ness, J. Crawford, Emre Kiciman, Ranveer Chandra
ArXiv | June 2023, Vol abs/2306.09302
-
-
-
A Causal AI Suite for Decision-Making
Emre Kiciman, Eleanor Dillon, Darren Edge, Adam Foster, Agrin Hilmkil, Joel Jennings, Chao Ma, Robert Osazuwa Ness, Nick Pawlowski, Amit Sharma, Cheng Zhang
NeurIPS 2022 Workshop on Causality for Real-world Impact | December 2022
-
-
-
Walk the Talk? Measuring the Faithfulness of Large Language Model Explanations
Katie Matton, Robert Osazuwa Ness, John Guttag, Emre Kiciman
2025 International Conference on Learning Representations | April 2025
-
Causal Reasoning and Large Language Models: Opening a New Frontier for Causality
Emre Kiciman, Robert Osazuwa Ness, Amit Sharma, Chenhao Tan
Transactions on Machine Learning Research (TMLR) | August 2024
Featured Certification
Selected for presentation at ICLR 2025
-
MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answering
Robert Osazuwa Ness, Hayden Helm, Katie Matton, Sheng Zhang, Junaid Bajwa, Carey E. Priebe, Eric Horvitz
June 2024
-
From Local to Global: A Graph RAG Approach to Query-Focused Summarization
Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, Dasha Metropolitansky, Robert Osazuwa Ness, Jonathan Larson
April 2024
-
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
Harsha Nori, Yin Tat Lee, Sheng Zhang, Dean Carignan, Richard Edgar, Nicolo Fusi, Nicholas King, Jonathan Larson, Yuanzhi Li, Weishung Liu, Renqian Luo, Scott Mayer McKinney, Robert Osazuwa Ness, Hoifung Poon, Tao Qin, Naoto Usuyama, Chris White, Eric Horvitz
November 2023
-
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
-
Knowledge Guided Representation Learning and Causal Structure Learning in Soil Science
Somya Sharma, Swati Sharma, Licheng Liu, Rishabh Tushir, Andy Neal, Robert Osazuwa Ness, J. Crawford, Emre Kiciman, Ranveer Chandra
ArXiv | June 2023, Vol abs/2306.09302
-
A Causal AI Suite for Decision-Making
Emre Kiciman, Eleanor Dillon, Darren Edge, Adam Foster, Agrin Hilmkil, Joel Jennings, Chao Ma, Robert Osazuwa Ness, Nick Pawlowski, Amit Sharma, Cheng Zhang
NeurIPS 2022 Workshop on Causality for Real-world Impact | December 2022
-
-
-
From Local to Global: A Graph RAG Approach to Query-Focused Summarization
Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, Dasha Metropolitansky, Robert Osazuwa Ness, Jonathan Larson
April 2024
-
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
-
-
-
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
Harsha Nori, Yin Tat Lee, Sheng Zhang, Dean Carignan, Richard Edgar, Nicolo Fusi, Nicholas King, Jonathan Larson, Yuanzhi Li, Weishung Liu, Renqian Luo, Scott Mayer McKinney, Robert Osazuwa Ness, Hoifung Poon, Tao Qin, Naoto Usuyama, Chris White, Eric Horvitz
November 2023
-
-
-
Walk the Talk? Measuring the Faithfulness of Large Language Model Explanations
Katie Matton, Robert Osazuwa Ness, John Guttag, Emre Kiciman
2025 International Conference on Learning Representations | April 2025
-
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
-
A Causal AI Suite for Decision-Making
Emre Kiciman, Eleanor Dillon, Darren Edge, Adam Foster, Agrin Hilmkil, Joel Jennings, Chao Ma, Robert Osazuwa Ness, Nick Pawlowski, Amit Sharma, Cheng Zhang
NeurIPS 2022 Workshop on Causality for Real-world Impact | December 2022
-
-
-
Causal Reasoning and Large Language Models: Opening a New Frontier for Causality
Emre Kiciman, Robert Osazuwa Ness, Amit Sharma, Chenhao Tan
Transactions on Machine Learning Research (TMLR) | August 2024
Featured Certification
Selected for presentation at ICLR 2025
-
Knowledge Guided Representation Learning and Causal Structure Learning in Soil Science
Somya Sharma, Swati Sharma, Licheng Liu, Rishabh Tushir, Andy Neal, Robert Osazuwa Ness, J. Crawford, Emre Kiciman, Ranveer Chandra
ArXiv | June 2023, Vol abs/2306.09302
-
-
-
MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answering
Robert Osazuwa Ness, Hayden Helm, Katie Matton, Sheng Zhang, Junaid Bajwa, Carey E. Priebe, Eric Horvitz
June 2024
-
From Local to Global: A Graph RAG Approach to Query-Focused Summarization
Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, Dasha Metropolitansky, Robert Osazuwa Ness, Jonathan Larson
April 2024
-
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
Harsha Nori, Yin Tat Lee, Sheng Zhang, Dean Carignan, Richard Edgar, Nicolo Fusi, Nicholas King, Jonathan Larson, Yuanzhi Li, Weishung Liu, Renqian Luo, Scott Mayer McKinney, Robert Osazuwa Ness, Hoifung Poon, Tao Qin, Naoto Usuyama, Chris White, Eric Horvitz
November 2023
-