Ziyao Zhang, Maria Sabrina Ma, J. K. Eshraghian, D. Vigolo, Ken-Tye Yong, O. Kavehei
{"title":"正在进行的工作:神经形态细胞术,高通量基于事件的血流成像","authors":"Ziyao Zhang, Maria Sabrina Ma, J. K. Eshraghian, D. Vigolo, Ken-Tye Yong, O. Kavehei","doi":"10.1109/EBCCSP56922.2022.9845595","DOIUrl":null,"url":null,"abstract":"Cell sorting and counting technology has been broadly adopted for medical diagnosis, cell-based therapy, and biological research. Microscopy operates with image capture that is subject to an extremely constrained field-of-view, and even slow-moving targets may undergo motion blur, ghosting, and other movement-induced artifacts, which will ultimately degrade performance in developing machine learning models to perform cell sorting, detection, and tracking. Frame-based sensors are especially susceptible to these issues, and it is highly costly to overcome them with modern but conventional CMOS sensing technologies. We provide an early demonstration of a proof-of-concept system, with the overarching goals of curating a neuromorphic imaging cytometry (NIC) dataset, multimodal analysis techniques, and associated deep-learning models. We are working towards this goal by utilising an event-based camera to perform flow-imaging cytometry to capture cells in motion and train neural networks capable of identifying their morphology (size and shape) and identities. We propose that implementing a neuromorphic sensory system or developing a new class of event-based cameras customised for this purpose with our sorting strategy will unbind the applications from the constraints of framerate and provide a cost-efficient, reproducible and high-throughput imaging mechanism. While we target this early work for cell sorting, this novel idea is the first stepping-stone towards a new type of high-throughput and automated high-content image analysis system and screening instrument.","PeriodicalId":383039,"journal":{"name":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Work in Progress: Neuromorphic Cytometry, High-throughput Event-based flow Flow-Imaging\",\"authors\":\"Ziyao Zhang, Maria Sabrina Ma, J. K. Eshraghian, D. Vigolo, Ken-Tye Yong, O. Kavehei\",\"doi\":\"10.1109/EBCCSP56922.2022.9845595\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Cell sorting and counting technology has been broadly adopted for medical diagnosis, cell-based therapy, and biological research. Microscopy operates with image capture that is subject to an extremely constrained field-of-view, and even slow-moving targets may undergo motion blur, ghosting, and other movement-induced artifacts, which will ultimately degrade performance in developing machine learning models to perform cell sorting, detection, and tracking. Frame-based sensors are especially susceptible to these issues, and it is highly costly to overcome them with modern but conventional CMOS sensing technologies. We provide an early demonstration of a proof-of-concept system, with the overarching goals of curating a neuromorphic imaging cytometry (NIC) dataset, multimodal analysis techniques, and associated deep-learning models. We are working towards this goal by utilising an event-based camera to perform flow-imaging cytometry to capture cells in motion and train neural networks capable of identifying their morphology (size and shape) and identities. We propose that implementing a neuromorphic sensory system or developing a new class of event-based cameras customised for this purpose with our sorting strategy will unbind the applications from the constraints of framerate and provide a cost-efficient, reproducible and high-throughput imaging mechanism. While we target this early work for cell sorting, this novel idea is the first stepping-stone towards a new type of high-throughput and automated high-content image analysis system and screening instrument.\",\"PeriodicalId\":383039,\"journal\":{\"name\":\"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)\",\"volume\":\"5 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-06-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/EBCCSP56922.2022.9845595\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/EBCCSP56922.2022.9845595","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Work in Progress: Neuromorphic Cytometry, High-throughput Event-based flow Flow-Imaging
Cell sorting and counting technology has been broadly adopted for medical diagnosis, cell-based therapy, and biological research. Microscopy operates with image capture that is subject to an extremely constrained field-of-view, and even slow-moving targets may undergo motion blur, ghosting, and other movement-induced artifacts, which will ultimately degrade performance in developing machine learning models to perform cell sorting, detection, and tracking. Frame-based sensors are especially susceptible to these issues, and it is highly costly to overcome them with modern but conventional CMOS sensing technologies. We provide an early demonstration of a proof-of-concept system, with the overarching goals of curating a neuromorphic imaging cytometry (NIC) dataset, multimodal analysis techniques, and associated deep-learning models. We are working towards this goal by utilising an event-based camera to perform flow-imaging cytometry to capture cells in motion and train neural networks capable of identifying their morphology (size and shape) and identities. We propose that implementing a neuromorphic sensory system or developing a new class of event-based cameras customised for this purpose with our sorting strategy will unbind the applications from the constraints of framerate and provide a cost-efficient, reproducible and high-throughput imaging mechanism. While we target this early work for cell sorting, this novel idea is the first stepping-stone towards a new type of high-throughput and automated high-content image analysis system and screening instrument.