In-Sensor Visual Devices for Perception and Inference

Yanan Liu, Hepeng Ni*, Chao Yuwen, Xinyu Yang, Yuhang Ming, Huixin Zhong, Yao Lu, Liang Ran

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingChapterpeer-review

Abstract

The traditional machine vision systems use separate architectures for perception, memory, and processing. This approach may hinder the growing demand for high image processing rates and low power consumption. On the other hand, in-sensor computing performs signal processing at the pixel level, directly utilizing collected analogue signals without sending them to other processors. This means that in-sensor computing may offer a solution for achieving highly efficient and low-power consumption visual signal processing. This can be achieved by integrating sensing, storage, and computation onto focal planes with novel circuit designs or new materials. This chapter aims to describe the proposed image processing algorithms and neural networks of in-sensor computing, as well as their applications in machine vision and robotics. The goal of this chapter is to help developers, researchers, and users of unconventional visual sensors understand their functioning and applications, especially in the context of autonomous driving.

Original languageEnglish
Title of host publicationAdvances in Computer Vision and Pattern Recognition
PublisherSpringer Science and Business Media Deutschland GmbH
Pages1-35
Number of pages35
DOIs
Publication statusPublished - 2023
Externally publishedYes

Publication series

NameAdvances in Computer Vision and Pattern Recognition
VolumePart F1566
ISSN (Print)2191-6586
ISSN (Electronic)2191-6594

Fingerprint

Dive into the research topics of 'In-Sensor Visual Devices for Perception and Inference'. Together they form a unique fingerprint.

Cite this