Research Theme: Neural Information Retrieval
Neural information retrieval refers to the applications of neural networks, specifically deep neural networks, for information retrieval tasks including ranking and query auto-completion. This research theme focuses on designing novel neural methods for IR and developing benchmarks for their evaluation.
Keynotes, invited talks, and lectures
What’s next for deep learning for Search?
Etsy
Virtual, November 2022
SlideShare | PPT
Efficient Machine Learning and Machine Learning for Efficiency in Information Retrieval
The Workshop on Reaching Efficiency in Neural Information Retrieval (ReNeuIR), SIGIR
Virtual, July 2022
SlideShare | PPT
Neural Learning to Rank
Dayananda Sagar College of Engineering
Virtual, May 2022
SlideShare | PPT
Deep Learning for Effective, Exposure-Aware, and Efficient Information Retrieval
Microsoft Research Cambridge
Virtual, April 2022
Neural Information Retrieval: In search of meaningful progress
CIIR Talk Series, University of Massachusetts Amherst
Virtual, March 2021
Details | SlideShare | PPT | Recording
Neural Information Retrieval: In search of meaningful progress
CLIP Colloquium, University of Maryland
Virtual, March 2021
Details | SlideShare | PPT
Deep Neural Methods for Retrieval
University College London
Virtual, March 2021
SlideShare | PPT
Neural Learning to Rank
University College London
Virtual, March 2021
SlideShare | PPT
Benchmarking for Neural Information Retrieval: MS MARCO, TREC, and Beyond
NLIWOD workshop, International Semantic Web Conference
Virtual, November 2020
SlideShare | PPT
Deep Neural Methods for Retrieval
Emory University
Virtual, April 2020
SlideShare | PPT | Recording
Neural Learning to Rank
Emory University
Virtual, April 2020
SlideShare | PPT | Recording
Learning to Rank for Information Retrieval with Neural Networks
ACM SIGIR/SIGKDD Africa Summer School on Machine Learning for Data Mining and Search (AFIRM)
Cape Town, South Africa, January 2020
SlideShare | PPT | Recording | Hands-on lab materials
Deep Learning for Search
ACM SIGIR/SIGKDD Africa Summer School on Machine Learning for Data Mining and Search (AFIRM)
Cape Town, South Africa, January 2019
SlideShare | PPT | Hands-on lab materials
5 Lessons Learned from Designing Neural Models for Information Retrieval
The 10th Recherche d’Information SEmantique (RISE) workshop, The CORIA-TALN-RJC conference
Rennes, France, May 2018
SlideShare | PPT
A Simple Introduction to Neural Information Retrieval
University College London
London, UK, March 2018
SlideShare | PPT
Neural Models for Information Retrieval
Facebook
Seattle, USA, November 2017
SlideShare | PPT
Neural Models for Information Retrieval
Microsoft Research Redmond
Redmond, USA, November 2017
SlideShare | PPT | Recording
Neural Models for Information Retrieval
School of Computing Sciences, University of Glasgow
Glasgow, UK, November 2017
SlideShare | PPT
Neural Models for Document Ranking
The 4th International Alexandria Workshop
Hannover, Germany, October 2017
SlideShare | PPT
Neural Models for Information Retrieval
The NLIP seminar series, University of Cambridge computer laboratory
Cambridge, UK, October 2017
SlideShare | PPT
Using Text Embeddings for Information Retrieval
School of Computing Sciences, University of Glasgow
Glasgow, UK, May 2016
SlideShare | PPT
Vectorland: Brief Notes from Using Text Embeddings for Search
Search Solutions
London, UK, November 2015
SlideShare | PPT
Shared task organization
Workshop organization
Tutorial organization
- Learning to Rank for Information Retrieval with Neural Networks (slides + video + hands-on lab materials), ACM SIGIR/SIGKDD Africa Summer School on Machine Learning for Data Mining and Search (AFIRM), January 2020
- Deep Learning for Search (slides), Forum for Information Retrieval Evaluation (FIRE), December 2019
- Neural Learning to Rank (slides), IVADO recommender systems summer school, August 2019
- Deep Learning for Search (slides + hands-on lab materials), ACM SIGIR/SIGKDD Africa Summer School on Machine Learning for Data Mining and Search (AFIRM), January 2019
- Neural Networks for Information Retrieval, ECIR, March 2018
- Neural Networks for Information Retrieval, WSDM, February 2018
- NN4IR: The SIGIR 2017 tutorial on Neural Networks for Information Retrieval, SIGIR, August 2017
- The WSDM 2017 Tutorial on Neural Text Embeddings for Information Retrieval (slides), WSDM, February 2017
Publications
ReNeuIR at SIGIR 2024: The Third Workshop on Reaching Efficiency in Neural Information Retrieval
Maik Fröbe, Joel Mackenzie, Bhaskar Mitra, Franco Maria Nardini, and Martin Potthast
In proc. ACM SIGIR, 2024
Publication | PDFOverview of the TREC 2023 Deep Learning Track
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Hossein A. Rahmani, Daniel Campos, Jimmy Lin, Ellen M. Voorhees, and Ian Soboroff
In proc. Text REtrieval Conference (TREC), 2024
Publication | PDF | ArXivOverview of the TREC 2022 Deep Learning Track
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Jimmy Lin, Ellen M. Voorhees, and Ian Soboroff
In proc. Text REtrieval Conference (TREC), 2023
Publication | PDF | ArXivAre We There Yet? A Decision Framework for Replacing Term-Based Retrieval with Dense Retrieval Systems
Sebastian Hofstätter, Nick Craswell, Bhaskar Mitra, Hamed Zamani, and Allan Hanbury
Preprint, 2022
PDF | ArXivFostering Coopetition While Plugging Leaks: The Design and Implementation of the MS MARCO Leaderboards
Jimmy Lin, Daniel Campos, Nick Craswell, Bhaskar Mitra, and Emine Yilmaz
In proc. ACM SIGIR, 2022
Publication | PDFInconsistent Ranking Assumptions in Medical Search and Their Downstream Consequences
Daniel Cohen, Kevin Du, Bhaskar Mitra, Laura Mercurio, Navid Rekabsaz, and Carsten Eickhoff
In proc. ACM SIGIR, 2022
Publication | PDFLess is Less: When are Snippets Insufficient for Human vs Machine Relevance Estimation?
Gabriella Kazai, Bhaskar Mitra, Anlei Dong, Nick Craswell, and Linjun Yang
In proc. ECIR, 2022
Publication | PDF | ArXivOverview of the TREC 2021 Deep Learning Track
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, and Jimmy Lin
In proc. Text REtrieval Conference (TREC), 2022
Publication | PDF | ArXivMS MARCO Chameleons: Challenging the MS MARCO Leaderboard with Extremely Obstinate Queries
Negar Arabzadeh, Bhaskar Mitra, and Ebrahim Bagheri
In proc. ACM CIKM, 2021
Publication | PDFIntra-Document Cascading: Learning to Select Passages for Neural Document Ranking
Sebastian Hofstätter, Bhaskar Mitra, Hamed Zamani, Nick Craswell, and Allan Hanbury
In proc. ACM SIGIR, 2021
Publication | PDF | ArXivNot All Relevance Scores are Equal: Efficient Uncertainty and Calibration Modeling for Deep Retrieval Models
Daniel Cohen, Bhaskar Mitra, Oleg Lesota, Navid Rekabsaz, and Carsten Eickhoff
In proc. ACM SIGIR, 2021
Publication | PDF | ArXivImproving Transformer-Kernel Ranking Model Using Conformer and Query Term Independence
Bhaskar Mitra, Sebastian Hofstätter, Hamed Zamani, and Nick Craswell
In proc. ACM SIGIR, 2021
Publication | PDF | ArXivMS MARCO: Benchmarking Ranking Models in the Large-Data Regime
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, and Jimmy Lin
In proc. ACM SIGIR, 2021
Publication | PDF | ArXivTREC Deep Learning Track: Reusable Test Collections in the Large Data Regime
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Ellen M. Voorhees, and Ian Soboroff
In proc. ACM SIGIR, 2021
Publication | PDF | ArXivSignificant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard
Jimmy Lin, Daniel Campos, Nick Craswell, Bhaskar Mitra, and Emine Yilmaz
In proc. ACM SIGIR, 2021
Publication | PDF | ArXivNeural methods for effective, efficient, and exposure-aware information retrieval
Bhaskar Mitra
In ACM SIGIR Forum, 2021
Publication | PDFNeural Methods for Effective, Efficient, and Exposure-Aware Information Retrieval
Bhaskar Mitra
PhD thesis, University College London, 2021
Publication | PDF | ArXivConformer-Kernel with Query Term Independence at TREC 2020 Deep Learning Track
Bhaskar Mitra, Sebastian Hofstatter, Hamed Zamani, and Nick Craswell
In proc. Text REtrieval Conference (TREC), 2021
Publication | PDF | ArXivOverview of the TREC 2020 Deep Learning Track
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, and Daniel Campos
In proc. Text REtrieval Conference (TREC), 2021
Publication | PDF | ArXivSemantic Product Search for Matching Structured Product Catalogs in E-Commerce
Jason Ingyu Choi, Surya Kallumadi, Bhaskar Mitra, Eugene Agichtein, and Faizan Javed
Preprint, 2020
PDF | ArXivConformer-Kernel with Query Term Independence for Document Retrieval
Bhaskar Mitra, Sebastian Hofstatter, Hamed Zamani, and Nick Craswell
Preprint, 2020
PDF | ArXivLocal Self-Attention over Long Text for Efficient Document Retrieval
Sebastian Hofstätter, Hamed Zamani, Bhaskar Mitra, Nick Craswell, and Allan Hanbury
In proc. ACM SIGIR, 2020
Publication | PDF | ArXivOn the Reliability of Test Collections for Evaluating Systems of Different Types
Emine Yilmaz, Nick Craswell, Bhaskar Mitra, and Daniel Campos
In proc. ACM SIGIR, 2020
Publication | PDF | ArXivDuet at TREC 2019 Deep Learning Track
Bhaskar Mitra and Nick Craswell
In proc. Text REtrieval Conference (TREC), 2020
Publication | PDF | ArXivOverview of the TREC 2019 Deep Learning Track
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, and Ellen M. Voorhees
In proc. Text REtrieval Conference (TREC), 2020
Publication | PDF | ArXivIncorporating Query Term Independence Assumption for Efficient Retrieval and Ranking using Deep Neural Networks
Bhaskar Mitra, Corby Rosset, David Hawking, Nick Craswell, Fernando Diaz, and Emine Yilmaz
Preprint, 2019
PDF | ArXivAn Updated Duet Model for Passage Re-ranking
Bhaskar Mitra and Nick Craswell
Preprint, 2019
PDF | ArXivAn Axiomatic Approach to Regularizing Neural Ranking Models
Corby Rosset, Bhaskar Mitra, Chenyan Xiong, Nick Craswell, Xia Song, and Saurabh Tiwary
In proc. ACM SIGIR, 2019
Publication | PDF | ArXivAn Introduction to Neural Information Retrieval
Bhaskar Mitra and Nick Craswell
In Foundations and Trends® in Information Retrieval (FnTIR), 2018
Publication | PDFA Line in the Sand: Recommendation or Ad-hoc Retrieval?
Surya Kallumadi, Bhaskar Mitra, and Tereza Iofciu
ACM RecSys Challenge, 2018
PDF | ArXivCross Domain Regularization for Neural Ranking Models using Adversarial Learning
Daniel Cohen, Bhaskar Mitra, Katja Hofmann, and W. Bruce Croft
In proc. ACM SIGIR, 2018
🏆 Best Short Research Paper Award
Publication | PDF | ArXivOptimizing Query Evaluations Using Reinforcement Learning for Web Search
Corby Rosset, Damien Jose, Gargi Ghosh, Bhaskar Mitra, and Saurabh Tiwary
In proc. ACM SIGIR, 2018
Publication | PDF | ArXivNeural Networks for Information Retrieval
Tom Kenter, Alexey Borisov, Christophe Van Gysel, Mostafa Dehghani, Maarten de Rijke, and Bhaskar Mitra
ECIR, 2018
PDFNeural Networks for Information Retrieval
Tom Kenter, Alexey Borisov, Christophe Van Gysel, Mostafa Dehghani, Maarten de Rijke, and Bhaskar Mitra
ACM WSDM, 2018
PDF | ArXivNeural Ranking Models with Multiple Document Fields
Hamed Zamani, Bhaskar Mitra, Xia Song, Nick Craswell, and Saurabh Tiwary
In proc. ACM WSDM, 2018
Publication | PDF | ArXivNeural Models for Information Retrieval
Bhaskar Mitra and Nick Craswell
Preprint, 2017
PDF | ArXiv | Talk | SlideShare | PPTNeural information retrieval: introduction to the special issue
Nick Craswell, W. Bruce Croft, Maarten de Rijke, Jiafeng Guo, and Bhaskar Mitra
In the special issue of the Information Retrieval Journal (IRJ) on neural information retrieval, Springer Nature, 2017
Publication | PDFLearning to Match using Local and Distributed Representations of Text for Web Search
Bhaskar Mitra, Fernando Diaz, and Nick Craswell
In proc. WWW, 2017
Publication | PDF | ArXivReply With: Proactive Recommendation of Email Attachments
Christophe Van Gysel, Bhaskar Mitra, Matteo Venanzi, Roy Rosemarin, Grzegorz Kukla, Piotr Grudzien, and Nicola Cancedda
In proc. ACM CIKM, 2017
Publication | PDF | ArXivToward Incorporation of Relevant Documents in word2vec
Navid Rekabsaz, Bhaskar Mitra, Mihai Lupu, and Allan Hanbury
In proc. Workshop on Neural Information Retrieval (Neu-IR'17), ACM SIGIR, 2017
PDF | ArXivReport on the Second SIGIR Workshop on Neural Information Retrieval (Neu-IR'17)
Nick Craswell, W. Bruce Croft, Maarten de Rijke, Jiafeng Guo, and Bhaskar Mitra
In ACM SIGIR Forum, 2017
Publication | PDFLuandri: A Clean Lua Interface to the Indri Search Engine
Bhaskar Mitra, Fernando Diaz, and Nick Craswell
In proc. ACM SIGIR, 2017
Publication | PDF | ArXivNeural Networks for Information Retrieval
Tom Kenter, Alexey Borisov, Christophe Van Gysel, Mostafa Dehghani, Maarten de Rijke, and Bhaskar Mitra
In proc. ACM SIGIR, 2017
Publication | PDF | ArXivSIGIR 2017 Workshop on Neural Information Retrieval (Neu-IR'17)
Nick Craswell, W Bruce Croft, Maarten de Rijke, Jiafeng Guo, and Bhaskar Mitra
In proc. ACM SIGIR, 2017
Publication | PDFNeural Text Embeddings for Information Retrieval
Bhaskar Mitra and Nick Craswell
In proc. ACM WSDM, 2017
Publication | PDFReport on the SIGIR 2016 Workshop on Neural Information Retrieval (Neu-IR)
Nick Craswell, W. Bruce Croft, Jiafeng Guo, Bhaskar Mitra, and Maarten de Rijke
In ACM SIGIR Forum, 2016
Publication | PDFNeu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval
Nick Craswell, W. Bruce Croft, Jiafeng Guo, Bhaskar Mitra, and Maarten de Rijke
In proc. ACM SIGIR, 2016
Publication | PDFQuery Expansion with Locally-Trained Word Embeddings
Fernando Diaz, Bhaskar Mitra, and Nick Craswell
In proc. ACL, 2016
Publication | PDF | ArXivA Dual Embedding Space Model for Document Ranking
Bhaskar Mitra, Eric Nalisnick, Nick Craswell, and Rich Caruana
Preprint, 2016
PDF | ArXivImproving Document Ranking with Dual Word Embeddings
Eric Nalisnick, Bhaskar Mitra, Nick Craswell, and Rich Caruana
In proc. WWW, 2016
Publication | PDFQuery Auto-Completion for Rare Prefixes
Bhaskar Mitra and Nick Craswell
In proc. ACM CIKM, 2015
Publication | PDFExploring Session Context using Distributed Representations of Queries and Reformulations
Bhaskar Mitra
In proc. ACM SIGIR, 2015
Publication | PDFAn Introduction to Computational Networks and the Computational Network Toolkit
Amit Agarwal, Eldar Akchurin, Chris Basoglu, Guoguo Chen, Scott Cyphers, Jasha Droppo, Adam Eversole, Brian Guenter, Mark Hillebrand, Xuedong Huang, Zhiheng Huang, Vladimir Ivanov, Alexey Kamenev, Philipp Kranen, Oleksii Kuchaiev, Wolfgang Manousek, Avner May, Bhaskar Mitra, Olivier Nano, Gaizka Navarro, Alexey Orlov, Marko Padmilac, Hari Parthasarathi, Baolin Peng, Alexey Reznichenko, Frank Seide, Michael L. Seltzer, Malcolm Slaney, Andreas Stolcke, Huaming Wang, Kaisheng Yao, Dong Yu, Yu Zhang, and Geoffrey Zweig
Tech report MSR-TR-2014-112, 2014
Publication | PDF