Named Entity Recognition for Short Text Messages

Tobias Ek, Camilla Kirkegaard, Håkan Jonsson, Pierre Nugues

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceedingpeer-review

Abstract

This paper describes a named entity recognition (NER) system for short text messages (SMS) running on a mobile platform. Most NER systems deal with text that is structured, formal, well written, with a good grammatical structure, and few spelling errors. SMS text messages lack these qualities and have instead a short-handed and mixed language studded with emoticons, which makes NER a challenge on this kind of material. We implemented a system that recognizes named entities from SMSes written in Swedish and that runs on an Android cellular telephone. The entities extracted are locations, names, dates, times, and telephone numbers with the idea that extraction of these entities could be utilized by other applications running on the telephone. We started from a regular expression implementation that we complemented with classifiers using logistic regression. We optimized the recognition so that the incoming text messages could be processed on the telephone with a fast response time. We reached an F-score of 86 for strict matches and 89 for partial matches. (C) 2011 Published by Elsevier Ltd. Selection and/or peer-review under responsibility of PACLING Organizing Committee.
Original languageEnglish
Title of host publicationComputational Linguistics and Related Fields
PublisherElsevier
Pages178-187
Volume27
DOIs
Publication statusPublished - 2011
EventConference of the Pacific-Association-for-Computational-Linguistics (PACLING) - Kuala Lumpur, Malaysia
Duration: 2011 Jul 192011 Jul 21

Publication series

Name
Volume27
ISSN (Print)1877-0428

Conference

ConferenceConference of the Pacific-Association-for-Computational-Linguistics (PACLING)
Country/TerritoryMalaysia
CityKuala Lumpur
Period2011/07/192011/07/21

Subject classification (UKÄ)

  • Computer Science

Keywords

  • Named entity recognition
  • Short text messages
  • SMS
  • Information
  • extraction
  • Ensemble systems

Fingerprint

Dive into the research topics of 'Named Entity Recognition for Short Text Messages'. Together they form a unique fingerprint.

Cite this