Abstract
The extraction of semantic propositions has proven instrumental in applications like IBM Watson (Ferrucci, 2012) and in Google’s knowledge graph (Singhal, 2012). One of the core components of IBM Watson is the PRISMATIC knowledge base consisting of one billion propositions extracted from the English version of Wikipedia and the New York Times (Fan et al., 2010). However, extracting the propositions from the English version of Wikipedia is a time-consuming process. In practice, this task requires multiple machines and a computation distribution involving a good deal of system technicalities. In this paper, we describe REFRACTIVE, an open-source tool to extract propositions from a parsed corpus based on the Hadoop variant of MapReduce. While the complete process consists of a parsing part and an extraction part, we focus here on the extraction from the parsed corpus and we hope this tool will help computational linguists speed up the development of applications.
Original language | English |
---|---|
Title of host publication | Proceedings of LREC 2014, the 9th edition of the Language Resource and Evaluation Conference |
Publisher | European Language Resources Association |
Pages | 2584-2589 |
ISBN (Electronic) | 978-2-9517408-8-4 |
Publication status | Published - 2014 |
Event | LREC, The 9th edition of the Language Resources and Evaluation Conference - Reykjavik Duration: 2014 May 28 → 2014 May 30 |
Conference
Conference | LREC, The 9th edition of the Language Resources and Evaluation Conference |
---|---|
Period | 2014/05/28 → 2014/05/30 |
Subject classification (UKÄ)
- Computer Science