Computer based automatic finger and speech tracking system

Research output: Contribution to journalArticle

Abstract

This article presents the first technology ever for on-line registration and interactive and automatic analysis of
finger movements during tactile reading (Braille and tactile pictures). Interactive software has been developed for registration (with two cameras and a microphone), MPEG-2 video compression and storage on disk or DVD as well
as an Interactive Analysis Program to aid human analysis. An Automatic Finger Tracking System has been implemented which also semi-automatically tracks the reading aloud speech on the syllable level. This set of tools opens the way for large scale studies of blind people reading Braille or tactile images. It has been tested in a pilot project involving congenitally blind subjects reading texts and pictures.

Details

Authors
  • Björn Breidegard
Organisations
Research areas and keywords

Subject classification (UKÄ) – MANDATORY

  • Human Computer Interaction

Keywords

  • Metod- och teoribildning, Synskador och blindhet, certec
Original languageEnglish
Pages (from-to)824-834
JournalBehavior Research Methods
Volume39
Issue number4
Publication statusPublished - 2007
Publication categoryResearch
Peer-reviewedYes