Publication Search and Society: Reimagining Information Access for Radical Futures Bhaskar Mitra Information Retrieval Research Journal (IRRJ) | March 2025
Publication Overview of the TREC 2024 Tip-of-the-Tongue Track Jaime Arguello, Samarth Bhargav, Fernando Diaz, To Eun Kim, Yifan He, Evangelos Kanoulas, Bhaskar Mitra Text REtrieval Conference (TREC) | March 2025 Télécharger
Publication AI Automatons: AI Systems Intended to Imitate Humans Alexandra Olteanu, Solon Barocas, Su Lin Blodgett, Lisa Egede, Alicia DeVrio, Myra Cheng March 2025
Publication Tip of the Tongue Query Elicitation for Simulated Evaluation Yifan He, To Eun Kim, Fernando Diaz, Jaime Arguello, Bhaskar Mitra 2025 International ACM SIGIR Conference on Research and Development in Information Retrieval | February 2025
Publication Judging the Judges: A Collection of LLM-Generated Relevance Judgements Hossein A. Rahmani, Clemencia Siro, Mohammad Aliannejadi, Nick Craswell, Charles L. A. Clarke, Guglielmo Faggioli, Bhaskar Mitra, Paul Thomas, Emine Yilmaz February 2025
Publication Recall, Robustness, and Lexicographic Evaluation Fernando Diaz, Michael D. Ekstrand, Bhaskar Mitra ACM Transactions on Recommender Systems | February 2025
Publication Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge Hanna Wallach, Meera Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alex Chouldechova, Emily Corvi, Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs ICML 2025 | January 2025
Publication JudgeBlender: Ensembling Judgments for Automatic Relevance Assessment Hossein A. Rahmani, Emine Yilmaz, Nick Craswell, Bhaskar Mitra 2025 The Web Conference | January 2025
Publication SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval Hossein A. Rahmani, Xi Wang, Emine Yilmaz, Nick Craswell, Bhaskar Mitra, Paul Thomas 2025 The Web Conference | January 2025
