Focused Crawling Using Context Graphs

By Michelangelo Diligenti, Frans Coetzee, Steve Lawrence, C. Lee Giles, Marco Gori. Very Large Data Bases Conference, 2000

687 citations recorded by the source corpus.

View Paper: https://www.semanticscholar.org/paper/9635499fa5b0d065628211e193c92f7537dc7a3a

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Small-World Phenomena and the Dynamics of Information (2001, background): “Small-World Phenomena and the Dynamics of Information Jon Kleinberg Department of Computer Science Cornell University Ithaca NY 14853”
Sentiment Analysis on Social Media (2012, background): “Even more complex sources, such as audio and/or video files, might be suitably processed so as to extract a textual-based labeling, based on both the recognition of speeches, videos and images [8][13].”
Review of "Mining the Web: discovering knowledge from hypertext data" by Soumen Chakrabati. Morgan Kaufman 2003. (2002, unknown): “Diligenti et al [68] propose supervised learning on the structure of paths leading to relevant pages to enhance the focused crawlers discussed so far.”
Context in Web Search. (2000, methodology): “[22] Michelangelo Diligenti, Frans Coetzee, Steve Lawrenc e, C.”
Topical web crawlers: Evaluating adaptive algorithms (2004, unknown): “There are crawlers whose decisions rely heavily on link based criteria [Cho et al. 1998; Diligenti et al. 2000].”
Crawling the Hidden Web (2001, background): “The work on focused crawling[3, 7, 16] addresses the resource discovery problem, (i.”
Smart Recommendation for an Evolving E-Learning System: Architecture and Experiment (2005, background): “Similar to the crawlers in, for example, [26, 27], our web crawler is a topic-driven web crawler(3), which exploits the content-similarity between course topics and candidate papers.”
Intelligent crawling on the World Wide Web with arbitrary predicates (2001, methodology): “Starting with these methods, there has been some recent work on various crawlers which use similar concepts [8, 14] in order to improve the e ciency of the crawl.”
Design and implementation of a high-performance distributed Web crawler (2002, methodology): “There has been some recent academic interest in the first issue, including work on strategies for crawling important pages first [12, 21], crawling pages on a particular topic or of a particular type [9, 8, 23, 13], recrawling (refreshing) pages in order to optimize the overall “freshness” of a coll”
Effective page refresh policies for Web crawlers (2003, background): “…focus on different issues, such as the crawler architecture [Heydon and Najork 1999; Page and Brin 1998], page selection [Menczer et al. 2001; Cho et al. 1998; Chakrabarti et al. 1999; Diligenti et al. 2000] crawler parallelization [Shkapenyuk and Suel 2002; Cho and Garcia-Molina 2002], etc.”
Detecting near-duplicates for web crawling (2007, background): “Generic crawlers [1, 9] crawl documents and links belonging to a variety of topics, whereas focused crawlers [27, 43, 46] use some specialized knowledge to limit the crawl to pages pertaining to specific topics.”