Hueihan Jhuang, Estíbaliz Garrote, N. Edelman, T. Poggio, Andrew D. Steele, Thomas Serre
{"title":"Trainable, vision-based automated home cage behavioral phenotyping","authors":"Hueihan Jhuang, Estíbaliz Garrote, N. Edelman, T. Poggio, Andrew D. Steele, Thomas Serre","doi":"10.1145/1931344.1931377","DOIUrl":null,"url":null,"abstract":"We describe a fully trainable computer vision system enabling the automated analysis of complex mouse behaviors. Our system computes a sequence of feature descriptors for each video sequence and a classifier is used to learn a mapping from these features to behaviors of interest. We collected a very large manually annotated video database of mouse behaviors for training and testing the system. Our system performs on par with human scoring, as measured from the ground-truth manual annotations of thousands of clips of freely behaving mice. As a validation of the system, we characterized the home cage behaviors of two standard inbred and two nonstandard mouse strains. From this data, we were able to predict the strain identity of individual mice with high accuracy.","PeriodicalId":92837,"journal":{"name":"Proceedings of Measuring Behavior 2016 : 10th International Conference on Methods and Techniques in Behavioral Research. International Conference on Methods and Techniques in Behavioral Research (10th : 2016 : Dublin, Ireland)","volume":"26 1","pages":"33:1-33:4"},"PeriodicalIF":0.0000,"publicationDate":"2010-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of Measuring Behavior 2016 : 10th International Conference on Methods and Techniques in Behavioral Research. International Conference on Methods and Techniques in Behavioral Research (10th : 2016 : Dublin, Ireland)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/1931344.1931377","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 8
Abstract
We describe a fully trainable computer vision system enabling the automated analysis of complex mouse behaviors. Our system computes a sequence of feature descriptors for each video sequence and a classifier is used to learn a mapping from these features to behaviors of interest. We collected a very large manually annotated video database of mouse behaviors for training and testing the system. Our system performs on par with human scoring, as measured from the ground-truth manual annotations of thousands of clips of freely behaving mice. As a validation of the system, we characterized the home cage behaviors of two standard inbred and two nonstandard mouse strains. From this data, we were able to predict the strain identity of individual mice with high accuracy.