Named Entity Recognition for Short Text Messages

Tobias Ek, Camilla Kirkegaard, Håkan Jonsson, Pierre Nugues

Forskningsoutput: Kapitel i bok/rapport/Conference proceedingKonferenspaper i proceedingPeer review


This paper describes a named entity recognition (NER) system for short text messages (SMS) running on a mobile platform. Most NER systems deal with text that is structured, formal, well written, with a good grammatical structure, and few spelling errors. SMS text messages lack these qualities and have instead a short-handed and mixed language studded with emoticons, which makes NER a challenge on this kind of material. We implemented a system that recognizes named entities from SMSes written in Swedish and that runs on an Android cellular telephone. The entities extracted are locations, names, dates, times, and telephone numbers with the idea that extraction of these entities could be utilized by other applications running on the telephone. We started from a regular expression implementation that we complemented with classifiers using logistic regression. We optimized the recognition so that the incoming text messages could be processed on the telephone with a fast response time. We reached an F-score of 86 for strict matches and 89 for partial matches. (C) 2011 Published by Elsevier Ltd. Selection and/or peer-review under responsibility of PACLING Organizing Committee.
Titel på värdpublikationComputational Linguistics and Related Fields
StatusPublished - 2011
EvenemangConference of the Pacific-Association-for-Computational-Linguistics (PACLING) - Kuala Lumpur, Malaysia
Varaktighet: 2011 juli 192011 juli 21


ISSN (tryckt)1877-0428


KonferensConference of the Pacific-Association-for-Computational-Linguistics (PACLING)
OrtKuala Lumpur

Ämnesklassifikation (UKÄ)

  • Datavetenskap (datalogi)


Utforska forskningsämnen för ”Named Entity Recognition for Short Text Messages”. Tillsammans bildar de ett unikt fingeravtryck.

Citera det här