Crawling the Hidden Web

By Sriram Raghavan, Hector Garcia-Molina. Very Large Data Bases Conference, 2001

862 citations recorded by the source corpus.

View Paper: https://www.semanticscholar.org/paper/f6c480ecfd35fd355eda7ca3fa0d9904ae7ed356

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Design and implementation of a high-performance distributed Web crawler (2002, background): “Work in [22] has looked at techniques for crawling this data.”
Data extraction and label assignment for web databases (2003, background): “Second, the wrapper generated for each web site needs to be complex enough to extract not only plain-structured data, but also nested-structured data.”
An interactive clustering-based approach to integrating source query interfaces on the deep Web (2004, methodology): “Note that it is possible to utilize the techniques developed in [24] to facilitate the transformation.”
Web-Scale Data Integration: You can afford to Pay as You Go (2007, background): “While much of the web-integration works have focused on virtual integration, to the best of our knowledge, only one earlier work [29] considered surfacing, though in a limited context, as a means of crawling deep-web content.”
Google's Deep Web crawl (2008, methodology): “Multi-input forms are considered in [18] and [14].”
Fully automatic wrapper generation for search engines (2005, background): “As another example, deep web crawling is to crawl documents or data records from (deep web) search engines [24] and it too needs to extract the search results from the result pages returned by search engines.”
Efficient Filtering on Hidden Document Streams (2014, background): “We refer to such streams with strict access constraints as " hidden streams " to draw a parallel to the hidden Web research (Raghavan and Garcia-Molina 2000), indicating that the stream is only available through querying.”
AppsPlayground: automatic security analysis of smartphone applications (2013, methodology): “The approach of automatically filling in text fields has also been used for web form completion [11, 23].”
Structured databases on the web: observations and implications (2004, methodology): “Reference [25] introduces an approach for crawling Web databases.”