AI-capable Computational CMOS Image Sensors: from Concept to Trend

Abubakar Abubakar*, Bo Wang, Amine Bermak

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The field of CMOS image sensors is rapidly evolving, driven by advancements in image processing tasks enabled by Convolutional Neural Networks (CNNs). This progress has led to the development of a specialized class of CMOS image sensors, known as Computational CMOS Image Sensors (C2IS), which are specifically designed for CNN acceleration and inference, among other applications. This paper provides an overview of these specialized image sensors, tracing their conceptual development and examining various reported architectures, highlighting their respective advantages and limitations. A central design trade-off between processing flexibility and energy efficiency is discussed, as it shapes the trajectory of innovation in this field. For each architecture, notable works are summarized, emphasizing key characteristics, limitations, and potential drawbacks. While designs are often application-driven, a comparative analysis of works across different architectures is also presented to provide a broader perspective.

Original languageEnglish
Title of host publication2024 International Conference on Microelectronics, ICM 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350379396
DOIs
Publication statusPublished - 17 Dec 2024
Event2024 International Conference on Microelectronics, ICM 2024 - Doha, Qatar
Duration: 14 Dec 202417 Dec 2024

Publication series

NameProceedings of the International Conference on Microelectronics, ICM
ISSN (Print)2332-7014

Conference

Conference2024 International Conference on Microelectronics, ICM 2024
Country/TerritoryQatar
CityDoha
Period14/12/2417/12/24

Keywords

  • analog convolution
  • CMOS image sensor (CIS)
  • Computational CMOS image sensor (C2IS)
  • processing-in-pixel (PIP)
  • processing-in-sensor (PIS)
  • processing-near-sensor (PNS)

Fingerprint

Dive into the research topics of 'AI-capable Computational CMOS Image Sensors: from Concept to Trend'. Together they form a unique fingerprint.

Cite this