Three and Two Dimensions Data Fusion Based Panoramic Environment Perception for Space Modeling

Forskningsoutput: Kapitel i bok/rapport/Conference proceedingKonferenspaper i proceeding

Abstract

This paper presents a systematic approach for 3-dimensional (3d) scene modeling based on Time-of-Flight (TOF) technology. Firstly the panoramic point cloud of scene model is built. To achieve that, point cloud data captured in different visual angles are transformed and registered into a panoramic 3d coordinate system. Based on the matching characteristics of feature points in various point clouds, these data can be synthesized into a fusion point cloud. Then the synthetic cloud is divided into several groups of point cloud fragments based on the depth scaling parameter. Secondly the 2-dimensional (2d) grayscale images which match the original point cloud data are collected and processed to generate a panoramic 2d image. Through Speeded-Up Robust Features (SURF) method, the similar feature pixels of different images are selected and disposed to fuse panoramic image. A novel 2d fusion image optimization method based on the pixel weighted theory is proposed in this paper. Finally the point cloud fragments segmented in the first step are classified according to different depth scaling values. The specific fragment is projected in 2d pixel space, and be modified as mask pattern. Therefor the objects of interest in the environment can be perceived by applying corresponding mark patterns to process panoramic image. The methodology of this environment perception approach can be the reference to TOF technology related 3d obstacles identification research.

Detaljer

Författare
  • Zilin Zhang
  • Haodong Hong
  • Xian Wang
Externa organisationer
  • Lund University
  • Wuhan University of Technology
Forskningsområden

Ämnesklassifikation (UKÄ) – OBLIGATORISK

  • Datorseende och robotik (autonoma system)

Nyckelord

Originalspråkengelska
Titel på värdpublikationProceedings - 2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2019
RedaktörerQingli Li, Lipo Wang
FörlagInstitute of Electrical and Electronics Engineers Inc.
ISBN (elektroniskt)9781728148526
ISBN (tryckt)978-1-7281-4853-3
StatusPublished - 2020 jan 23
PublikationskategoriForskning
Peer review utfördJa
Externt publiceradJa
Evenemang12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2019 - Huaqiao, Kina
Varaktighet: 2019 okt 192019 okt 21

Konferens

Konferens12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2019
LandKina
OrtHuaqiao
Period2019/10/192019/10/21