The browser you are using is not supported by this website. All versions of Internet Explorer are no longer supported, either by us or Microsoft (read more here: https://www.microsoft.com/en-us/microsoft-365/windows/end-of-ie-support).

Please use a modern browser to fully experience our website, such as the newest versions of Edge, Chrome, Firefox or Safari etc.

Online Recognition of Actions Involving Objects

På svenska

Author

Summary, in English

We present an online system for real time recognition of actions involving objects working in online mode. The system merges two streams of information pro- cessing running in parallel. One is carried out by a hierarchical self-organizing map (SOM) system that recognizes the performed actions by analysing the spa- tial trajectories of the agent’s movements. It consists of two layers of SOMs and a custom made supervised neural network. The activation sequences in the first layer SOM represent the sequences of significant postures of the agent during the performance of actions. These activation sequences are subsequently recoded and clustered in the second layer SOM, and then labeled by the ac- tivity in the third layer custom made supervised neural network. The second information processing stream is carried out by a second system that determines which object among several in the agent’s vicinity the action is applied to. This is achieved by applying a proximity measure. The presented method combines the two information processing streams to determine what action the agent per- formed and on what object. The action recognition system has been tested with excellent performance.

Publishing year

2017-10-10

Language

English

Pages

10-19

Publication/Series

Biologically Inspired Cognitive Architectures

Volume

22

Document type

Journal article

Publisher

Elsevier

Topic

  • Computer and Information Science

Keywords

  • Hierarchical models
  • Self-organizing maps
  • Action recognition
  • Object detection

Status

Published

Project

  • Ikaros: An infrastructure for system level modelling of the brain
  • What you say is what you did (WYSIWYD)
  • Thinking in Time: Cognition, Communication and Learning

ISBN/ISSN/Other

  • ISSN: 2212-6848