Embedding-based Retrieval in Facebook Search

By Jui-Ting Huang, Jui-Ting Huang, Ashish Sharma, Shuying Sun, Li Xia, David Zhang, Philip Pronin, Janani Padmanabhan, Giuseppe Ottaviano, Linjun Yang. 2020

410 citations recorded by the source corpus.

Search in social networks such as Facebook poses different challenges than in classical web search: besides the query text, it is important to take into account the searcher's context to provide relevant results. Their social graph is an integral part of this context and is a unique aspect of Facebook search. While embedding-based retrieval (EBR) has been applied in web search engines for years, Facebook search was still mainly based on a Boolean matching model. In this paper, we discuss the techniques for applying EBR to a Facebook Search system. We introduce the unified embedding framework developed to model semantic embeddings for personalized search, and the system to serve embedding-based retrieval in a typical search system based on an inverted index. We discuss various tricks and experiences on end-to-end optimization of the whole system, including ANN parameter tuning and full-stack optimization. Finally, we present our progress on two selected advanced topics about modeling. We evaluated EBR on verticals for Facebook Search with significant metrics gains observed in online A/B experiments. We believe this paper will provide useful insights and experiences to help people on developing embedding-based retrieval systems in search engines.

Subfields: Computer Vision and Pattern Recognition, Information Retrieval & Search, Representation & Self-Supervised Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Ji-rong Wen
  2. Wayne Xin Zhao
  3. Jing Liu
  4. Ruiyang Ren
  5. Haifeng Wang
  6. Niklas Muennighoff
  7. Hua Wu
  8. Chenyan Xiong

In Information Retrieval & Search

  1. Jamie Callan
  2. Jimmy J. Lin
  3. Luyu Gao
  4. Chenyan Xiong
  5. Jing Liu
  6. Ruiyang Ren
  7. Ji-rong Wen
  8. Wayne Xin Zhao

In Representation & Self-Supervised Learning

  1. Niklas Muennighoff
  2. Nouamane Tazi
  3. Nils Reimers
  4. L. Magne
  5. Ji-rong Wen
  6. Wayne Xin Zhao
  7. Jing Liu
  8. Ruiyang Ren

Citations in the corpus