Publication debug-gym: A Text-Based Environment for Interactive Debugging Xingdi Yuan, Morgane M Moss, Charbel Feghali, Chinmay Singh, Darya Moldavskaya, Drew MacPhee, Lucas Caccia, Matheus Pereira, Minseon Kim, Alessandro Sordoni, Marc-Alexandre Côté March 2025
Publication Search and Society: Reimagining Information Access for Radical Futures Bhaskar Mitra Information Retrieval Research Journal (IRRJ) | March 2025
Publication Overview of the TREC 2024 Tip-of-the-Tongue Track Jaime Arguello, Samarth Bhargav, Fernando Diaz, To Eun Kim, Yifan He, Evangelos Kanoulas, Bhaskar Mitra Text REtrieval Conference (TREC) | March 2025 Download
Publication Tip of the Tongue Query Elicitation for Simulated Evaluation Yifan He, To Eun Kim, Fernando Diaz, Jaime Arguello, Bhaskar Mitra 2025 International ACM SIGIR Conference on Research and Development in Information Retrieval | February 2025
Publication Judging the Judges: A Collection of LLM-Generated Relevance Judgements Hossein A. Rahmani, Clemencia Siro, Mohammad Aliannejadi, Nick Craswell, Charles L. A. Clarke, Guglielmo Faggioli, Bhaskar Mitra, Paul Thomas, Emine Yilmaz February 2025
Publication Recall, Robustness, and Lexicographic Evaluation Fernando Diaz, Michael D. Ekstrand, Bhaskar Mitra ACM Transactions on Recommender Systems | February 2025
Publication Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge Hanna Wallach, Meera Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alex Chouldechova, Emily Corvi, P. A. Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nick Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs January 2025
Publication JudgeBlender: Ensembling Judgments for Automatic Relevance Assessment Hossein A. Rahmani, Emine Yilmaz, Nick Craswell, Bhaskar Mitra 2025 The Web Conference | January 2025
Publication SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval Hossein A. Rahmani, Xi Wang, Emine Yilmaz, Nick Craswell, Bhaskar Mitra, Paul Thomas 2025 The Web Conference | January 2025
