| Authors: | Steven Abreu, M. Gouda, A. Lugnan, P. Bienstman | | Title: | Flow cytometry with event-based vision and spiking neuromorphic hardware | | Format: | International Conference Proceedings | | Publication date: | 6/2023 | | Journal/Conference/Book: | IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
| | Location: | Vancouver, Canada | | DOI: | 10.1109/CVPRW59228.2023.00435 | | Citations: | 8 (Dimensions.ai - last update: 17/11/2024)
Look up on Google Scholar
| | Download: |
 (2.7MB) |
Abstract
Imaging flow cytometry systems play a critical role in the identification and characterization of large populations of cells or micro-particles. Such systems typically leverage deep artificial neural networks to classify samples. Here we show that an event-based camera and neuromorphic processor can be used in a flow cytometry setup to solve a binary particle classification task with less memory usage, and promising improvements in latency and energy scaling. To reduce the complexity of the spiking neural network, we combine the event-based camera with a free-space optical setup which acts as a non-linear high-dimensional feature map that is computed at the speed of light before the event-based camera receives the signal. We demonstrate, for the first time, a spiking neural network running on neuromorphic hardware for a fully event-based flow cytometry pipeline with 98.45% testing accuracy. Our best artificial neural network on frames of the same data reaches only 97.51%, establishing a neuromorphic advantage also in classification accuracy. We further show that our system will scale favorably to more complex classification tasks. We pave the way for real-time classification with throughput of up to 1,000 samples per second and open up new possibilities for online and on-chip learning in flow cytometry applications. Related Projects
|
|
