Publication Dimensions of Generative AI Evaluation Design Alex Dow, Jennifer Wortman Vaughan, Solon Barocas, Chad Atalla, Alex Chouldechova, Hanna Wallach November 2024
Publication Evaluating Generative AI Systems is a Social Science Measurement Challenge Hanna Wallach, Meera Desai, Nick Pangakis, A. Feder Cooper, Angelina Wang, Solon Barocas, Alex Chouldechova, Chad Atalla, Su Lin Blodgett, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs November 2024
Publication (De)Noise: Moderating the Inconsistency Between Human Decision-Makers Nina Grgić-Hlača, Junaid Ali, Krishna P. Gummadi, Jennifer Wortman Vaughan ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 2024) | November 2024
Publication ASL STEM Wiki: Dataset and Benchmark for Interpreting STEM Articles Kayo Yin, Chinmay Singh, Fyodor O. Minakov, Vanessa Milan, Hal Daumé, Cyril Zhang, Alex Lu, Danielle Bragg Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing | November 2024 Project
Publication Easy2Hard-Bench: Standardized Difficulty Labels for Profiling LLM Performance and Generalization Mucong Ding, Chenghao Deng, Jocelyn Choo, Zichu Wu, Aakriti Agrawal, Avi Schwarzschild, Tianyi Zhou, Tom Goldstein, John Langford, A. Anandkumar, Furong Huang NeurIPS 2024 | September 2024
Publication Understanding the Impacts of Language Technologies’ Performance Disparities on African American Language Speakers Jay Cunningham, Su Lin Blodgett, Hal Daumé III, Christina Harrington, Hanna Wallach, Michael Madaio Findings of the Association for Computational Linguistics: ACL 2024 | August 2024
Publication Is Behavior Cloning All You Need? Understanding Horizon in Imitation Learning Dylan Foster, Adam Block, Dipendra Misra NeurIPS 2024 | July 2024
Publication As Generative Models Improve, People Adapt Their Prompts E. Jahani, Benjamin S. Manning, Joe Zhang, Hong-Yi TuYe, Mohammed Alsobay, Christos Nicolaides, Siddharth Suri, David Holtz July 2024
Publication Impact of Decentralized Learning on Player Utilities in Stackelberg Games Kate Donahue, Nicole Immorlica, Meena Jagadeesan, Brendan Lucier, Aleksandrs Slivkins ICML 2024 | June 2024
