TY - GEN
T1 - AI-capable Computational CMOS Image Sensors
T2 - 2024 International Conference on Microelectronics, ICM 2024
AU - Abubakar, Abubakar
AU - Wang, Bo
AU - Bermak, Amine
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024/12/17
Y1 - 2024/12/17
N2 - The field of CMOS image sensors is rapidly evolving, driven by advancements in image processing tasks enabled by Convolutional Neural Networks (CNNs). This progress has led to the development of a specialized class of CMOS image sensors, known as Computational CMOS Image Sensors (C2IS), which are specifically designed for CNN acceleration and inference, among other applications. This paper provides an overview of these specialized image sensors, tracing their conceptual development and examining various reported architectures, highlighting their respective advantages and limitations. A central design trade-off between processing flexibility and energy efficiency is discussed, as it shapes the trajectory of innovation in this field. For each architecture, notable works are summarized, emphasizing key characteristics, limitations, and potential drawbacks. While designs are often application-driven, a comparative analysis of works across different architectures is also presented to provide a broader perspective.
AB - The field of CMOS image sensors is rapidly evolving, driven by advancements in image processing tasks enabled by Convolutional Neural Networks (CNNs). This progress has led to the development of a specialized class of CMOS image sensors, known as Computational CMOS Image Sensors (C2IS), which are specifically designed for CNN acceleration and inference, among other applications. This paper provides an overview of these specialized image sensors, tracing their conceptual development and examining various reported architectures, highlighting their respective advantages and limitations. A central design trade-off between processing flexibility and energy efficiency is discussed, as it shapes the trajectory of innovation in this field. For each architecture, notable works are summarized, emphasizing key characteristics, limitations, and potential drawbacks. While designs are often application-driven, a comparative analysis of works across different architectures is also presented to provide a broader perspective.
KW - analog convolution
KW - CMOS image sensor (CIS)
KW - Computational CMOS image sensor (C2IS)
KW - processing-in-pixel (PIP)
KW - processing-in-sensor (PIS)
KW - processing-near-sensor (PNS)
UR - http://www.scopus.com/inward/record.url?scp=85215930983&partnerID=8YFLogxK
U2 - 10.1109/ICM63406.2024.10815831
DO - 10.1109/ICM63406.2024.10815831
M3 - Conference contribution
AN - SCOPUS:85215930983
T3 - Proceedings of the International Conference on Microelectronics, ICM
BT - 2024 International Conference on Microelectronics, ICM 2024
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 14 December 2024 through 17 December 2024
ER -