{"title":"Exploring the nature and variants of relevance feedback","authors":"X.S. Zhou, T.S. Huang","doi":"10.1109/IVL.2001.990862","DOIUrl":"https://doi.org/10.1109/IVL.2001.990862","url":null,"abstract":"We analyze the nature of the relevance feedback problem in a continuous representation space in the context of multimedia information retrieval. Emphasis is put on exploring the uniqueness of the problem and comparing the assumptions, implementations, and merits of various solutions in the literature. An attempt is made to compile a list of critical issues to consider when designing a relevance feedback algorithm. With a state-of-the-art review as the main portion, the paper also offers some novel solutions and perspectives throughout the discussion.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125168891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Constrained utility maximization for generating visual skims","authors":"H. Sundaram, Shih-Fu Chang","doi":"10.1109/IVL.2001.990866","DOIUrl":"https://doi.org/10.1109/IVL.2001.990866","url":null,"abstract":"We present a novel algorithm to generate visual skims that do not contain audio, from computable scenes. Visual skims are useful for browsing digital libraries, and for on-demand summaries in set-top boxes. A computable scene is a chunk of data that exhibits consistencies with respect to chromaticity, lighting and sound. First, we define the visual complexity of a shot to be its Kolmogorov complexity. Then, we conduct experiments that help us map the complexity of a shot into the minimum time required for its comprehension. Second, we analyze the grammar of the film language, since it makes the shot sequence meaningful. We achieve a target skim time by minimizing a sequence utility function. It is subject to shot duration constraints, and penalty functions based on sequence rhythm and information loss. This helps us determine individual shot durations as well as the shots to drop. Our user studies show good results on skims with compression rates up to 80%.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"118 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116209791","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Object-based queries using color points of interest","authors":"V. Gouet, N. Boujemaa","doi":"10.1109/IVL.2001.990853","DOIUrl":"https://doi.org/10.1109/IVL.2001.990853","url":null,"abstract":"Image retrieval systems based on the query-by-example paradigm usually imply a global description of the image. An approach involving points of interest has been developed and comes to light with object/sub-image retrieval tasks which require more local descriptors. However, this solution is not optimal, since it is limited to gray value images. We propose a local image descriptor based on color points of interest, i.e. points extracted and characterized from a color signal at one go. This local characterization is then involved in an image indexing and retrieval approach which is dedicated to object or sub-image retrieval. The entire approach is evaluated on two image databases with various contents and some particular results of object retrieval show the relevance of our approach.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129307995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An interactive framework for boundary delineation for medical CBIR","authors":"C. Pavlopoulou, A. Kak, C. Brodley","doi":"10.1109/IVL.2001.990850","DOIUrl":"https://doi.org/10.1109/IVL.2001.990850","url":null,"abstract":"CBIR systems designed for medical applications often require that a human in the loop demarcate the pathology bearing regions in the image, since fully automatic extraction of such regions is still not possible. In our CBIR system for the domain of HRCT images of the lung, physicians do not find this interaction too onerous since the boundary surrounding a pathology bearing region does not have to be precise. But in our new domain, a liver image database, that is unfortunately not the case. The boundaries supplied by the physician must correspond precisely to the outline of the liver or to the boundary of a pathology bearing region inside the liver. To meet this demand, we have developed a new user interaction framework for semi-automatic boundary extraction. All that a physician has to do is to click on a couple of pixels on the boundary to be extracted. The system then tries its best to extend the boundary as far as possible, sometimes even extracting the entire contour correctly. When errors occur, all that the physician is called upon to do is to click on where a correction to the boundary needs to take place. In this manner, an entire boundary can be specified with very little input from the human, which is a most important consideration with physicians as he/she can hardly be expected to click on every boundary point.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"367 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122843224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Event detection and summarization in sports video","authors":"Baoxin Li, M. Sezan","doi":"10.1109/IVL.2001.990867","DOIUrl":"https://doi.org/10.1109/IVL.2001.990867","url":null,"abstract":"We propose a general framework for event detection and summary generation in broadcast sports video. Under this framework, important events in a class of sports are modeled by \"plays\", defined according to the semantics of the particular sport and the conventional broadcasting patterns. We propose both deterministic and probabilistic approaches for the detection of the plays. The detected plays are concatenated to generate a compact, time compressed summary of the original video. Such a summary is complete in the sense that it contains every meaningful action of the underlying game, and it also servers as a much better starting point for higher-level summarization and/or analysis than the original video does. We provide experimental results on American football, baseball, and sumo wrestling.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130460159","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Content-based image orientation detection with support vector machines","authors":"Yongmei Wang, HongJiang Zhang","doi":"10.1109/IVL.2001.990851","DOIUrl":"https://doi.org/10.1109/IVL.2001.990851","url":null,"abstract":"Accurate and automatic image orientation detection is of great importance in image libraries. We present automatic image orientation detection algorithms by adopting both the illuminance (structural) and chrominance (color) low-level content features. Statistical learning support vector machines (SVMs) are used in our approach as the classifiers. The different sources of the extracted image features, as well as the binary classification nature of SVM, require our system to be able to integrate the outputs from multiple classifiers. Both static combiner (averaging) and trainable combiner (also based on SVMs) are proposed and evaluated. In addition, two rejection options (regular and reinforced ambiguity rejections) are employed to improve orientation detection accuracy by sieving out images with low confidence values during the classification. A number of experiments on a database of more than 14000 images were performed to validate our approaches.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127657379","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Real-time content-based adaptive streaming of sports videos","authors":"Shih-Fu Chang, D. Zhong, R. Kumar","doi":"10.1109/IVL.2001.990868","DOIUrl":"https://doi.org/10.1109/IVL.2001.990868","url":null,"abstract":"We present a real-time software system for filtering live video content and then adoptively streaming the video over resource limited networks or devices. The rate adaptation is content-based and dynamically varied according to the event structure and the video content. The system includes a content analysis module for detecting important segments in the video, a variable-rate encoding module, and a buffer management module for streaming the variable rate video over low bandwidth networks. We have implemented a prototype system, which performs real-time content adaptation for tennis and baseball with promising results.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134549603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Unsupervised and model-free news video segmentation","authors":"Xinbo Gao, Xiaoou Tang","doi":"10.1109/IVL.2001.990857","DOIUrl":"https://doi.org/10.1109/IVL.2001.990857","url":null,"abstract":"Based on a simple temporal structural model of a news program, the paper presents a practical solution to automatic news story segmentation by integrating syntactic and semantic methods. First, a syntactic segmentation method is used to detect the shot boundaries in order to partition video frames into video shots. Then, a semantic segmentation method based on graph-theoretical cluster analysis is developed to classify the video shots into anchorperson shots and news footage shots. Finally, a structural model of news video is used to complete the news-story segmentation. The proposed method obtains a precision of 90.45% and a recall of 95.83% in the segmentation experiment of 168 news stories from two Hong Kong news stations.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115415988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"User-oriented affective video content analysis","authors":"A. Hanjalic, Li-Qun Xu","doi":"10.1109/IVL.2001.990856","DOIUrl":"https://doi.org/10.1109/IVL.2001.990856","url":null,"abstract":"The article looks into a new direction in multimedia content analysis: the extraction and modeling of the affective content of an arbitrary video. The affective content is viewed as the amount of feeling/emotion contained in and mediated by a video toward a viewer. The ability to automatically extract video content of this nature will lead to a high level of personalization in broadcast delivery to private users, as well as considerably broadening the possibilities of efficiently handling and presenting large amounts of audio-visual data stored in emerging video databases. The technique we have developed uses the so-called \"dimensional approach to affect\" concept underlined by psychophysiology studies. Our computational method sets to represent the affective content as feature points in the so-called 2D emotion space. We manage to obtain time curves that represent the two affect dimensions (arousal and valence) for a video, considered respectively, from low-level video characteristics. Combining the two time curves results in the so-called affect curve that is regarded as a reliable representation of transitions from one feeling to another along a video, as perceived by a viewer. We illustrate the success of our technique on excerpts taken from an action movie and a typical soccer game, respectively.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121036670","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
R. Venkatesh Babu, B. Anantharaman, K. Ramakrishnan, S. Srinivasan
{"title":"Compressed domain action classification using HMM","authors":"R. Venkatesh Babu, B. Anantharaman, K. Ramakrishnan, S. Srinivasan","doi":"10.1109/IVL.2001.990855","DOIUrl":"https://doi.org/10.1109/IVL.2001.990855","url":null,"abstract":"The paper proposes three techniques for person independent action classification in compressed MPEG video. The features used are based on motion vectors, obtained by partial decoding of the MPEG video. The features proposed are projected 1D, 2D polar and 2D Cartesian. The feature vectors are fed to a hidden Markov model (HMM) for classification of actions. In total, seven actions were trained with distinct HMM for classification. Recognition results of more than 90% have been achieved. This work is significant in the context of the emerging MPEG-7 standard for video indexing and retrieval.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"35 15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123522876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}