Of Ivory and Smurfs: Loxodontan MapReduce Experiments for Web Search

By Jimmy J. Lin, Tamer Elsayed, Lidan Wang, Donald Metzler. 2009

52 citations recorded by the source corpus.

Subfields: Information Retrieval & Search, ML Systems & Hardware

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Information Retrieval & Search

1. Jimmy J. Lin
2. Rodrigo Nogueira
3. Andrew Yates
4. Zeynep Akkalyoncu Yilmaz
5. Jamie Callan
6. Allan Hanbury
7. Wei Yang
8. Sebastian Hofstätter

In ML Systems & Hardware

1. Jimmy J. Lin
2. Ferhan Ture
3. Lidan Wang
4. Donald Metzler
5. Matt Crane

Citations in the corpus

• Pretrained Transformers for Text Ranking: BERT and Beyond (2020, background): “bitrary order) Lemur/Indri [Metzler and Croft, 2004, Metzler et al., 2004], Galago [Cartright et al., 2012], Terrier [Ounis et al., 2006, Macdonald et al., 2012], ATIRE [Trotman et al., 2012], Ivory [Lin et al., 2009], JASS [Lin and Trotman, 2015], JASSv2 [Trotman and Crane, 2019], MG4J [Boldi and V”
• Anserini (2018, background): “Furthermore, Lucene is able to achieve this feat in a multi-threaded setting on a single server, without having to resort to distributed frameworks such as MapReduce, as with previous academic systems [15, 30].”
• Anserini: Enabling the Use of Lucene for Information Retrieval Research (2017, background): “While academic researchers have attempted to address this issue via MapReduce and related frameworks [5, 11], these solutions impose the burden of requiring clusters and additional software infrastructure.”
• Efficient and effective spam filtering and re-ranking for large web datasets (2010, methodology): “At least three participants (Hauff and Hiemstra 2009; Lin et al. 2009) used spam filters of some sort; one from a commercial search provider.”
• A cascade ranking model for efficient ranked retrieval (2011, methodology): “All models were implemented in the Ivory open-source retrieval toolkit [15].”
• The Lucene for Information Access and Retrieval Research (LIARR) Workshop at SIGIR 2017 (2017, methodology): “An incomplete list includes SMART [18], Lemur/Indri [15, 16], Galago [8], Terrier [14, 17], ATIRE [20], Ivory [12], JASS [13], MG4J [6], Wumpus [21], and ZeŠair [25].”
• Why Not Grab a Free Lunch? Mining Large Corpora for Parallel Sentences to Improve Translation Modeling (2012, methodology): “Finally, the code and datasets are available as part of the Ivory, an open-source Hadoop toolkit for webscale information retrieval (Lin et al., 2009).”
• Learning to efficiently rank (2010, unknown): “scale information retrieval engine [14].”