Discriminating and Simulating Actions with the Associative Self-Organizing Map

Research output: Contribution to journalArticle


Abstract in Undetermined
We propose a system able to represent others' actions as well as to internally simulate their likely continuation from a partial observation. The approach presented here is the first step towards a more ambitious goal of endowing an artificial agent with the ability to recognise and predict others' intentions. Our approach is based on the associative self-organising map, a variant of the self-organising map capable of learning to associate its activity with different inputs over time, where inputs are processed observations of others' actions. We have evaluated our system in two different experimental scenarios obtaining promising results: the system demonstrated an ability to learn discriminable representations of actions, to recognise novel input, and to simulate the likely continuation of partially seen actions.


  • Miriam Buonamente
  • Haris Dindo
  • Magnus Johnsson
Research areas and keywords

Subject classification (UKÄ) – MANDATORY

  • Computer Vision and Robotics (Autonomous Systems)


  • associative self-organising map, action recognition, internal, simulation, intention understanding, neural network
Original languageEnglish
Pages (from-to)118-136
JournalConnection Science
Issue number2
Publication statusPublished - 2015
Publication categoryResearch

Related projects

Birger Johansson, Christian Balkenius, Magnus Johnsson, Rasmus Bååth, Stefan Winberg, Zahra Gharaee & Trond Arild Tjøstheim


Project: Research

View all (1)