Breadth-first crawling yields high-quality pages

By Marc Najork, Janet L. Wiener. The Web Conference, 2001

328 citations recorded by the source corpus.

Subfields: Computer Networks and Communications, Information Systems

View Paper: https://www.semanticscholar.org/paper/6123995064289e53b3354ad8d368d5750c4d752a

Citations in the corpus

• Review of "Mining the Web: discovering knowledge from hypertext data" by Soumen Chakrabati. Morgan Kaufman 2003. (2002, unknown): “More recently, Najork and Weiner [155] ran a crawler with a simple breadth-first prioritization to collect over 328 million pages from the entire web, covering more than 7 million distinct hosts.”
• Topical web crawlers: Evaluating adaptive algorithms (2004, unknown): “2001; Menczer and Belew 2000; Najork and Wiener 2001] for the topic including that received via relevance feedback.”