Motion-Based Object Location on a Smart Image Sensor Using On-Pixel Memory

dc.contributor.authorValenzuela, Wladimir
dc.contributor.authorSaavedra, Antonio
dc.contributor.authorZarkesh-Ha, Payman
dc.contributor.authorFigueroa, Miguel
dc.date.accessioned2022-10-05T07:27:32Z
dc.date.available2022-10-05T07:27:32Z
dc.date.issued2022-08-30
dc.date.updated2022-09-07T18:32:50Z
dc.description.abstractObject location is a crucial computer vision method often used as a previous stage to object classification. Object-location algorithms require high computational and memory resources, which poses a difficult challenge for portable and low-power devices, even when the algorithm is implemented using dedicated digital hardware. Moving part of the computation to the imager may reduce the memory requirements of the digital post-processor and exploit the parallelism available in the algorithm. This paper presents the architecture of a Smart Imaging Sensor (SIS) that performs object location using pixel-level parallelism. The SIS is based on a custom smart pixel, capable of computing frame differences in the analog domain, and a digital coprocessor that performs morphological operations and connected components to determine the bounding boxes of the detected objects. The smart-pixel array implements on-pixel temporal difference computation using analog memories to detect motion between consecutive frames. Our SIS can operate in two modes: (1) as a conventional image sensor and (2) as a smart sensor which delivers a binary image that highlights the pixels in which movement is detected between consecutive frames and the object bounding boxes. In this paper, we present the design of the smart pixel and evaluate its performance using post-parasitic extraction on a 0.35 µm mixed-signal CMOS process. With a pixel-pitch of 32 µm × 32 µm, we achieved a fill factor of 28%. To evaluate the scalability of the design, we ported the layout to a 0.18 µm process, achieving a fill factor of 74%. On an array of 320×240 smart pixels, the circuit operates at a maximum frame rate of 3846 frames per second. The digital coprocessor was implemented and validated on a Xilinx Artix-7 XC7A35T field-programmable gate array that runs at 125 MHz, locates objects in a video frame in 0.614 µs, and has a power consumption of 58 mW.
dc.identifier.eissn1424-8220
dc.identifier.urihttps://depositonce.tu-berlin.de/handle/11303/17538
dc.identifier.urihttps://doi.org/10.14279/depositonce-16319
dc.language.isoen
dc.rightsLicensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subject.ddc620 Ingenieurwissenschaften und zugeordnete Tätigkeitende
dc.subject.othersmart image sensor
dc.subject.othersmart pixel
dc.subject.othervision chip
dc.subject.otherintelligent sensor
dc.subject.otherobject detection
dc.subject.otherobject location
dc.subject.othermotion-based
dc.subject.otherframe difference
dc.subject.otherfield-programmable gate array
dc.subject.othervery large scale integration
dc.titleMotion-Based Object Location on a Smart Image Sensor Using On-Pixel Memory
dc.typeArticle
dc.type.versionpublishedVersion
dcterms.bibliographicCitation.articlenumber6538
dcterms.bibliographicCitation.doi10.3390/s22176538
dcterms.bibliographicCitation.issue17
dcterms.bibliographicCitation.journaltitleSensors
dcterms.bibliographicCitation.originalpublishernameMDPI
dcterms.bibliographicCitation.originalpublisherplaceBasel
dcterms.bibliographicCitation.volume22
tub.accessrights.dnbfree
tub.affiliationTechnische Universität Berlin::Fak. 4 Elektrotechnik und Informatik::Inst. Technische Informatik und Mikroelektronik::FG Architektur eingebetteter Systeme
tub.publisher.universityorinstitutionTechnische Universität Berlin
Files
Original bundle
Now showing 1 - 1 of 1
Loading…
Thumbnail Image
Name:
sensors-22-06538.pdf
Size:
1.4 MB
Format:
Adobe Portable Document Format
Description:
Collections