Open Information Extraction from the Web
By Michele Banko, Michael J. Cafarella, Stephen Soderland, Matthew Broadhead, Oren Etzioni. 2007
2,586 citations recorded by the source corpus.
Traditionally, Information Extraction (IE) has focused on satisfying precise, narrow, pre-specified requests from small homogeneous corpora (e.g., extract the location and time of seminars from a set of announcements). Shifting to a new domain requires the user to name the target relations and to manually create new extraction rules or hand-tag new training examples. This manual labor scales linearly with the number of target relations. This paper introduces Open IE (OIE), a new extraction paradigm where the system makes a single data-driven pass over its corpus and extracts a large set of relational tuples without requiring any human input. The paper also introduces TEXTRUNNER, a fully implemented, highly scalable OIE system where the tuples are assigned a probability and indexed to support efficient extraction and exploration via user queries. We report on experiments over a 9,000,000 Web page corpus that compare TEXTRUNNER with KNOWITALL, a state-of-the-art Web IE system. TEXTRUNNER achieves an error reduction of 33% on a comparable set of extractions. Furthermore, in the amount of time it takes KNOWITALL to perform extraction for a handful of pre-specified relations, TEXTRUNNER extracts a far broader set of facts reflecting orders of magnitude more relations, discovered on the fly. We report statistics on TEXTRUNNER’s 11,000,000 highest probability tuples, and show that they contain over 1,000,000 concrete facts and over 6,500,000more abstract assertions.
Subfields: Artificial Intelligence, Information Systems, Information Retrieval & Search, Natural Language Processing
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Mohit Bansal
- Percy Liang
- Luke S. Zettlemoyer
- Jianfeng Gao
- Yejin Choi
- Hannaneh Hajishirzi
- Christopher D. Manning
- Noah A. Smith
In Information Systems
- Luke S. Zettlemoyer
- Peter Clark
- Jonathan Berant
- Ashish Sabharwal
- Hannaneh Hajishirzi
- Percy Liang
- Tushar Khot
- Christopher D. Manning
In Information Retrieval & Search
- Hannaneh Hajishirzi
- Luke S. Zettlemoyer
- Sebastian Riedel
- Christopher D. Manning
- Daniel S. Weld
- Christopher R'e
- Maosong Sun
- William W. Cohen
In Natural Language Processing
- Mohit Bansal
- Luke S. Zettlemoyer
- Percy Liang
- Jonathan Berant
- Christopher D. Manning
- Hannaneh Hajishirzi
- Yejin Choi
- Graham Neubig
Citations in the corpus
- DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs (2019, background): “digms to represent paragraphs as structured contexts: (1) Stanford dependencies (de Marneffe and Manning,2008, Syn Dep); which capture word-level syntactic relations, (2) Open Information Extraction (Banko et al., 2007, Open IE), a shallow semantic representation which directly links predicates and ”
- Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering (2018, methodology): “TupleInference (Khot et al., 2017), also an ILP-based QA system, uses Open IE tuples (Banko et al., 2007) as its semi-structured representation.”
- Semantic Parsing on Freebase from Question-Answer Pairs (2013, background): “Finally, although Freebase has thousands of properties, open information extraction (Banko et al., 2007; Fader et al., 2011; Masaum et al., 2012) and associated question answering systems (Fader et al., 2013) work over an even larger open-ended set of properties.”
- Reasoning Over Semantic-Level Graph for Fact Checking (2019, background): “ways to construct the graph, such as open information extraction (Banko et al., 2007), named entity recognition plus relation classification, sequenceto-sequence generation which is trained to produce structured tuples (Goodrich et al.”
- How Can We Know What Language Models Know? (2019, background): “In open information extraction systems (Banko et al., 2007), manually defined patterns are often leveraged to filter out noisy relational phrases.”
- On Faithfulness and Factuality in Abstractive Summarization (2020, methodology): “(2019) proposed a modelbased automatic metric to assess the faithfulness of Wikipedia summaries; they trained an end-to-end model to extract a complete set of OpenIE-style (Banko et al., 2007) facts from both the source text and the generated summary.”
- Survey of Hallucination in Natural Language Generation (2022, background): “Other literature attempts to use the whole web as the knowledge source [44, 123].”
- Constructing Datasets for Multi-hop Reading Comprehension Across Documents (2017, methodology): “That is, they work as part of a pipeline, and either rely on output of a previous IE step (Banko et al., 2007), or on direct human annotation (Bollacker et al., 2008) which tends to be costly and biased in coverage.”
- SciTaiL: A Textual Entailment Dataset from Science Question Answering (2018, background): “For example, Open IE (Banko et al. 2007) v4 8 was able to parse”
- Distant supervision for relation extraction without labeled data (2009, background): “An alternative approach, purely unsupervised information extraction, extracts strings of words between entities in large amounts of text, and clusters and simplifies these word strings to produce relation-strings (Shinyama and Sekine, 2006; Banko et al., 2007).”
- Continual Few-shot Relation Learning via Embedding Space Regularization and Data Augmentation (2022, background): “There have been127 some efforts which focus on relation learning with-128 out predefined types, including open RE (Shinyama129 and Sekine, 2006; Etzioni et al., 2008; Cui et al.,130 2018; Gao et al., 2020) and continual relation learn-131 ing (Wang et al., 2019; Obamuyide and Vlachos, 132 2019; Han…”
- Continual Relation Learning via Episodic Memory Activation and Reconsolidation (2020, neutral): “There have been many efforts for open relation learning, including pattern extraction (Banko et al., 2007; Fader et al., 2011; Mausam et al., 2012; Del Corro and Gemulla, 2013; Angeli et al., 2015; Petroni et al., 2015; Stanovsky and Da-gan, 2016; Mausam, 2016; Cui et al., 2018), relation discovery…”
- Explicit Knowledge-based Reasoning for Visual Question Answering (2015, background): “, YAGO [22, 28], OpenIE [3, 14, 15], NELL [9], NEIL [10, 11]).”
- A Survey of Reinforcement Learning Informed by Natural Language (2019, background): “Task-specific corpora like wikis or game manuals could be leveraged by machine reading techniques [Banko et al. , 2007] to inform agents of valuable features and policies [Eisenstein et al. , 2009; Branavan et al. , 2012 ] , or task-specific environmental dynamics and reward structures [ Narasimhan…”
- Question Answering via Integer Programming over Semi-Structured Knowledge (2016, methodology): “In addition, to augment these tables with the broad knowledge present in study guides that doesn’t always fit the manually defined table schemas, we ran an Open IE [Banko et al., 2007] pattern-based subject-verb-object (SVO) extractor from Clark et al.”
- Representing General Relational Knowledge in ConceptNet 5 (2012, methodology): “• Relational statements mined from Wikipedia’s free text using ReVerb (Etzioni et al., 2008), run through a filter we designed to keep only the statements that are going to be most useful to represent in Concept-Net.”