Energy-Efficient Application-Specific Instruction-Set Processor for Feature Extraction in Smart Vision Systems

Lucas Ferreira, Steffen Malkowsky, Patrik Persson, Sven Karlsson, Karl Astrom, Liang Liu

Forskningsoutput: Kapitel i bok/rapport/Conference proceedingKonferenspaper i proceedingPeer review

Sammanfattning

Smart vision sensor systems enable many computer vision applications such as autonomous drones and wearable devices. These battery-powered gadgets have very stringent power consumption requirements. Close-to-sensor feature extraction compressing the full image into descriptive keypoints, is crucial as it allows for several design optimizations. First, the amount of necessary on-chip memory can be lessened. Second, the volume of data that needs to be exchanged between nodes in Internet of Things (IoT) applications can also be reduced. This work explores the usage of an Application Specific Instruction Set Processor (ASIP) tailored to perform energy-efficient feature extraction in real-time. The ASIP features a Very Long Instruction Word (VLIW) central core comprising one RV32I RISCV and three vector slots. The on-chip memory sub-system implements parallel multi-bank memories with near-memory data shuffling to enable single-cycle multi-pattern vector access. As a case study, Oriented FAST and Rotated BRIEF (ORB) is used to evaluate the proposed architecture. We show that the architecture supports VGA-resolution images at 140 Frames-Per-Second (FPS), for one scale, reducing the number of memory accesses by 2 orders of magnitude comparing to other embedded general-purpose architectures.

Originalspråkengelska
Titel på värdpublikationConference Record - Asilomar Conference on Signals, Systems and Computers
RedaktörerMichael B. Matthews
FörlagIEEE Computer Society
Sidor324-328
Antal sidor5
ISBN (elektroniskt)9781665458283
DOI
StatusPublished - 2021
Evenemang55th Asilomar Conference on Signals, Systems and Computers, ACSSC 2021 - Virtual, Pacific Grove, USA
Varaktighet: 2021 okt. 312021 nov. 3

Publikationsserier

NamnConference Record - Asilomar Conference on Signals, Systems and Computers
Volym2021-October
ISSN (tryckt)1058-6393

Konferens

Konferens55th Asilomar Conference on Signals, Systems and Computers, ACSSC 2021
Land/TerritoriumUSA
OrtVirtual, Pacific Grove
Period2021/10/312021/11/03

Ämnesklassifikation (UKÄ)

  • Datorteknik

Fingeravtryck

Utforska forskningsämnen för ”Energy-Efficient Application-Specific Instruction-Set Processor for Feature Extraction in Smart Vision Systems”. Tillsammans bildar de ett unikt fingeravtryck.

Citera det här