Skip navigation
  • Home
  • Browse
    • Communities
      & Collections
    • Browse Items by:
    • Publication Date
    • Author
    • Title
    • Subject
    • Department
  • Sign on to:
    • My MacSphere
    • Receive email
      updates
    • Edit Profile


McMaster University Home Page
  1. MacSphere
  2. Open Access Dissertations and Theses Community
  3. Open Access Dissertations and Theses
Please use this identifier to cite or link to this item: http://hdl.handle.net/11375/29762
Title: Vehicle Perception System Based on Heterogeneous Neural Network Sensor Fusion
Authors: Liu, Chang
Advisor: von Mohrenschildt, Martin
Habibi, Saeid
Department: Computing and Software
Keywords: Deep Learning;ADAS;Vehicle Perception system;CNN;CVNN;Hybrid Neural Network;SVSF;cm-reSVSF;Sensor Calibration;Dataset
Publication Date: 2024
Abstract: Previous research conducted in the CMHT lab at McMaster University led to the successful development of a Light detection and ranging (LiDAR)-based vehicle perception system, notable for its highly accurate detection of highway objects and moderate classification capabilities. This thesis builds upon that foundation, enhancing the existing system by incorporating sensor fusion with Infrared (IR) cameras and standard cameras. The implementation of sensor fusion significantly augments the system’s performance, enabling it to detect and classify objects effectively under adverse weather conditions and in poor lighting. Key contributions of this research include: • The development of a hardware-synchronized sensor system, blending LiDAR, IR cameras, and cameras. • The creation of a comprehensive sensor calibration process and a novel multi-sensor dataset, the first of its kind to include annotations under various lighting and weather conditions. • The development of an innovative ground segmentation technique using the Savitzky-Golay filter and peak detection, significantly improve the speed of ground point elimination. • The introduction of a novel optimizer cm-reSVSF for complex-valued neural networks, demonstrating superior performance compared to traditional algorithms like ADAM and SGD.
URI: http://hdl.handle.net/11375/29762
Appears in Collections:Open Access Dissertations and Theses

Files in This Item:
File Description SizeFormat 
liu_chang_2024-04_phd.pdf
Open Access
28.85 MBAdobe PDFView/Open
Show full item record Statistics


Items in MacSphere are protected by copyright, with all rights reserved, unless otherwise indicated.

Sherman Centre for Digital Scholarship     McMaster University Libraries
©2022 McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4L8 | 905-525-9140 | Contact Us | Terms of Use & Privacy Policy | Feedback

Report Accessibility Issue