Marc Junyent, Pablo Beltrán, Miquel A. Farre, J. Pont-Tuset, Alexandre Chapiro, A. Smolic
{"title":"Video content and structure description based on keyframes, clusters and storyboards","authors":"Marc Junyent, Pablo Beltrán, Miquel A. Farre, J. Pont-Tuset, Alexandre Chapiro, A. Smolic","doi":"10.1109/MMSP.2015.7340866","DOIUrl":"https://doi.org/10.1109/MMSP.2015.7340866","url":null,"abstract":"In this paper we present a novel system to extract keyframes, shot clusters and structural storyboards for video content description, which can be used for a variety of summarization, visualization, classification, indexing and retrieval applications. The system automatically selects an appealing set of keyframes and creates meaningful clusters of shots. It further identifies sections that appear recurrently, which are called anchors, and typically divide television shows into different parts. This information about anchors can then be used to browse video content in a new fashion. Finally, our system creates a new type of interactive storyboard suitable to visualize and analyze the structure of the video in a novel way.","PeriodicalId":108577,"journal":{"name":"2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134560192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Soft binary segmentation-based backlit image enhancement","authors":"Zhenhao Li, K. Cheng, Xiaolin Wu","doi":"10.1109/MMSP.2015.7340808","DOIUrl":"https://doi.org/10.1109/MMSP.2015.7340808","url":null,"abstract":"This paper is concerned with the enhancement of backlit images by compensating for abnormal illumination conditions. The underexposed (backlit) or/and overexposed regions in a backlit image are identified by a soft binary segmentation process that is driven by a Gaussian mixture model. Optimal tone-mapping is performed on the under- and over-exposed regions separately to improve the visual quality. Experimental results demonstrate the efficacy of the proposed restoration method and its advantages over existing image enhancement algorithms in perceptual quality.","PeriodicalId":108577,"journal":{"name":"2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)","volume":"89 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133297388","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Hybrid hidden Markov model for mixed continuous/continuous and discrete/continuous data modeling","authors":"E. Epaillard, N. Bouguila","doi":"10.1109/MMSP.2015.7340853","DOIUrl":"https://doi.org/10.1109/MMSP.2015.7340853","url":null,"abstract":"We propose a hybrid hidden Markov model (HMM) for mixed continuous/continuous and discrete/continuous outcomes. The Expectation-Maximization (EM) procedure used for the parameters estimation relies on a combination of local and global quantities that relate to outcomes of a specific type and to all outcomes, respectively. The new model is implemented for discrete outcomes and continuous outcomes that follow Gaussian, Dirichlet, and Gamma distributions. Experiments led with synthetic data show same or better modeling accuracy compared to a fully Gaussian HMM, with less parameters and thus a shorter convergence time for high dimensional data. Finally, the approach is validated with real data in a change detection scenario between a pair of images, one of which has been captured by an optic sensor and the other by a synthesis aperture radar (SAR) sensor. Based on the properties of the noises corrupting these images, a hybrid Gamma-Gaussian HMM is trained and the likelihood of the data with respect to the model is used to detect changes. The obtained results are in line with the most recent approaches for this task with the advantage of providing a very compact representation of the data.","PeriodicalId":108577,"journal":{"name":"2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125150618","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Motion blur modelling for hierarchically anchored motion with discontinuities","authors":"Dominic Rüfenacht, R. Mathew, D. Taubman","doi":"10.1109/MMSP.2015.7340817","DOIUrl":"https://doi.org/10.1109/MMSP.2015.7340817","url":null,"abstract":"We have previously proposed a scheme for representing motion with motion discontinuities which has beneficial properties in terms of compactness (efficiency) and scalability. This so-called BIHA scheme has applications in video coding as well as temporal frame interpolation. In both cases, modelling of motion discontinuities has proven to be valuable. In these earlier works, we have ignored effects of motion blur, which can result in artificial sharp transitions of texture information at moving object boundaries. In this paper, we extend the BIHA framework to account for motion blur. Experimental results show significant improvements over the original BIHA scheme in texture blending regions, resulting in more visually pleasing predictions, as well as better rate-distortion performance.","PeriodicalId":108577,"journal":{"name":"2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128489525","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improved downstream rate-distortion performance of SHVC in DASH using sub-layer-selective interlayer prediction","authors":"Xuehui Huang, M. Hannuksela, Houqiang Li","doi":"10.1109/MMSP.2015.7340848","DOIUrl":"https://doi.org/10.1109/MMSP.2015.7340848","url":null,"abstract":"Dynamic Adaptive Streaming over HTTP (DASH) has gained wide acceptance due to its ability of bitrate adaptation in diverse network conditions. In the meanwhile, it is asserted that the Scalable Extension (SHVC) of High Efficiency Video Coding (HEVC) can bring more efficient storage and caching compared with traditional single-layer video coding. However, using of SHVC in DASH raises the downstream bitrate relative to encoding each representation independently. This paper proposes a method to improve the downstream rate-distortion performance of SHVC in DASH. Experimental results show that the proposed method can bring up to 16.9 %-unit downstream bitrate reduction compared with directly use SHVC in DASH, while the efficiency in storage space is maintained.","PeriodicalId":108577,"journal":{"name":"2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133172340","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shen-Chi Chen, Young-Gun Lee, Jenq-Neng Hwang, Y. Hung, Jang-Hee Yoo
{"title":"An ensemble of invariant features for person re-identification","authors":"Shen-Chi Chen, Young-Gun Lee, Jenq-Neng Hwang, Y. Hung, Jang-Hee Yoo","doi":"10.1109/MMSP.2015.7340791","DOIUrl":"https://doi.org/10.1109/MMSP.2015.7340791","url":null,"abstract":"We propose an ensemble of invariant features for person re-identification. The proposed method requires no domain learning and can effectively overcome the issues created by the variations of human poses and viewpoint between a pair of different cameras. Our ensemble model utilizes both holistic and region-based features. To avoid the misalignment problem, the test human object sample is used to generate multiple virtual samples, by applying slight geometric distortion. The holistic features are extracted from a publically available pre-trained deep convolutional neural network. On the other hand, the region-based features are based on our proposed Two-Way Gaussian Mixture Model Fitting and the Completed Local Binary Pattern texture representations. To make better generalization during the matching without additional learning processes for the feature aggregation, the ensemble scheme combines all three feature distances using distances normalization. The proposed framework achieves robustness against partial occlusion, pose and viewpoint changes. In addition, the experimental results show that our method exceeds the state of the art person re-identification performance based on the challenging benchmark 3DPeS.","PeriodicalId":108577,"journal":{"name":"2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125396453","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xiang Chen, Jenq-Neng Hwang, Kuan-Hui Lee, R. Queiroz
{"title":"Quality-of-content (QoC)-driven rate allocation for video analysis in mobile surveillance networks","authors":"Xiang Chen, Jenq-Neng Hwang, Kuan-Hui Lee, R. Queiroz","doi":"10.1109/MMSP.2015.7340838","DOIUrl":"https://doi.org/10.1109/MMSP.2015.7340838","url":null,"abstract":"Nowadays, more and more videos are transmitted for video analytics purposes rather than human perceptions. In mobile surveillance networks, a cloud server collects videos delivered from multiple moving cameras and detects suspicious people in all the camera views. However, all the videos recorded by moving cameras such as phone or dash cameras are uploaded through bandwidth-limited wireless networks. Therefore, videos are required to be encoded with high compression ratio to satisfy the total data rate constraint, which may affect the video analyses (e.g., human detection/tracking and action recognition, etc.) performance due to the degraded video decoding qualities at the server side. In this paper, we propose an effective content-driven video source coding rate allocation scheme, which can improve the human detection success rate in mobile surveillance networks under a total data rate constraint. The proposed scheme allocates appropriate amount of data rate to each moving camera based on the corresponding content information (i.e., human detection results). A model of human detection accuracy based on object area and video quality is provided. The rate allocation problem is formulated as a convex optimization problem and can be solved by standard solvers. Simulations with real video sequences demonstrate the effectiveness of our proposed scheme.","PeriodicalId":108577,"journal":{"name":"2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129591794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xueyan Dong, Jie Xie, M. Towsey, Jinglan Zhang, P. Roe
{"title":"Generalised features for bird vocalisation retrieval in acoustic recordings","authors":"Xueyan Dong, Jie Xie, M. Towsey, Jinglan Zhang, P. Roe","doi":"10.1109/MMSP.2015.7340813","DOIUrl":"https://doi.org/10.1109/MMSP.2015.7340813","url":null,"abstract":"Bioacoustic monitoring has become a significant research topic for species diversity conservation. Due to the development of sensing techniques, acoustic sensors are widely deployed in the field to record animal sounds over a large spatial and temporal scale. With large volumes of collected audio data, it is essential to develop semi-automatic or automatic techniques to analyse the data. This can help ecologists make decisions on how to protect and promote the species diversity. This paper presents generic features to characterize a range of bird species for bird vocalisation retrieval. In the implementation, audio recordings are first converted to spectrograms using short-time Fourier transform, then a ridge detection method is applied to the spectrogram for detecting points of interest. Based on the detected points, a new region representation are explored for describing various bird vocalisations and a local descriptor including temporal entropy, frequency bin entropy and histogram of counts of four ridge directions is calculated for each sub-region. To speed up the retrieval process, indexing is carried out and the retrieved results are ranked according to similarity scores. The experimental results show that our proposed feature set can achieve 0.71 in term of retrieval success rate which outperforms spectral ridge features alone (0.55) and Mel frequency cepstral coefficients (0.36).","PeriodicalId":108577,"journal":{"name":"2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)","volume":"117 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127224346","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A line segments extraction based undirected graph from 2D laser scans","authors":"Xinzhao Li, Yuehu Liu, Zhenning Niu, Zhichao Cui","doi":"10.1109/MMSP.2015.7340851","DOIUrl":"https://doi.org/10.1109/MMSP.2015.7340851","url":null,"abstract":"A novel algorithm to find line segments is proposed from the sequence of points taken by a laser scan, which consists of over segmentation, undirected graph generation and line segments extraction. Firstly, the self-adaptive IEPF method is used to over segment raw points into sub-groups. Secondly, the undirected graph is generated based on merge probability function of sub-groups. Thirdly, according to the main edges, the energy function of undirected graph partition and corresponding minimization method, line segments are extracted. The primary contributions of the work are the main edge, undirected graph and minimization method of energy function, which are more proper to noisy laser scan data. The experimental comparison with 6 state-of-the-art methods, using 2D laser scan data obtained by laser profile sensor and laser range finder, shows better performance and robustness of the new algorithm.","PeriodicalId":108577,"journal":{"name":"2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)","volume":"C-27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126481355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Large-scale human action recognition with spark","authors":"Hanli Wang, Xiaobin Zheng, Bo Xiao","doi":"10.1109/MMSP.2015.7340818","DOIUrl":"https://doi.org/10.1109/MMSP.2015.7340818","url":null,"abstract":"In this paper, Apache Spark, the rising big data processing tool with in-memory computing ability, is explored to address the task of large-scale human action recognition. To achieve this, several advanced key techniques for human action recognition, such as trajectory based feature extraction, Gaussian Mixture Model, Fisher Vector, etc., are realized with parallel distributed computing power on Spark. The theory and implementation details for these distributed applications are presented in this work. The experimental results on the benchmark human action dataset Hollywood-2 show that the proposed Spark based framework which is deployed on a 9-node computer cluster can deal with large-scale video data and can dramatically accelerate the process of human action recognition.","PeriodicalId":108577,"journal":{"name":"2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132555284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}