{"title":"A fast image segmentation algorithm for interactive video hotspot retrieval","authors":"Tiecheng Liu, J. Kender, R. Hjelsvold, A. Pizano","doi":"10.1109/IVL.2001.990849","DOIUrl":"https://doi.org/10.1109/IVL.2001.990849","url":null,"abstract":"This paper presents a fast image segmentation algorithm for extracting areas-of-interest (\"hotspots\") from video sequences. Because video hotspots, which are the visual analogues of HTML hyperlinks, highly depend on a user's interest, it is very difficult to automatically extract the exact outlines of objects of interest in videos. Our approach to interactive video hotspot retrieval is to provide candidate hotspots with segmented regions of video frames when requested, and a Web designer using the tool for Web site creation may select the area (or areas) he is interested in as a video hotspot. This segmentation algorithm follows a three step coarse-to-fine scheme. The original image is first divided into blocks and a block-merging process is applied to get a coarse segmentation. Then we represent the pre-segmented image as a graph where the value of edges in this graph are evaluated based on multi features, and by using a minimum spanning tree searching algorithm, we merge the vertices in the graph to generate the segmented regions of the image. Finally, we refine the boundary of segmented regions on the pixel level using an improved K-means clustering algorithm. This segmentation algorithm is fast and efficient and our final segmentation results compare favorably with the results obtained using manual outlining. We also provide a convenient way for the Web page designer to select multiple regions as a video hotspot. Our method allows the designer to click on an image during video playback and to get a segmented image almost instantly. The extracted video hotspots can then be used for video hyperlinks, an extension of the general concept of hyperlink to interactive videos.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"72 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127335782","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Image browsing with PCA-assisted user-interaction","authors":"I. Keller, T. Meiers, T. Ellerbrock, T. Sikora","doi":"10.1109/IVL.2001.990863","DOIUrl":"https://doi.org/10.1109/IVL.2001.990863","url":null,"abstract":"User interfaces for sophisticated search engines must offer users quick and easy access to the objects to be visualized. We present a browsing tool which arranges images with respect to the user search intention in a continuous and intuitive manner in real time. Since the capacity of the visual human system is higher for spatial information, we prefer a virtual 3D space for the visualization. Because our image features are described in terms of very high-dimensional MPEG-7 descriptors, we have to reduce them to only three dimensions for visual presentation. The dimension reduction is realized by an appropriate weighting of the high-dimensional descriptor components corresponding to a modification of the covariance-matrix used for principal component analysis (PCA). In addition, this modification allows us to overcome a problem arising from equally sized eigenvalues and provides varying eigenspaces nearly continuously. The technique introduced is a general approach, which can be combined with other relevance feedback methods.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"362 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122816157","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Mosaic-based clustering of scene locations in videos","authors":"Aya Aner, J. Kender","doi":"10.1109/IVL.2001.990864","DOIUrl":"https://doi.org/10.1109/IVL.2001.990864","url":null,"abstract":"We present an approach for compact video summaries that allows fast and direct access to video data. The video is segmented into shots and scenes using a previously proposed method, then motion analysis is used to select representative shots for each scene. In contrast to approaches to video indexing which are based on key-frames, we use mosaics constructed from the representative shots for an efficient mosaic-based scene representation. We use a novel method for mosaic comparison to spatially cluster scenes and create a highly compact non-temporal representation of video. Our scene-based representation allows accurate comparison of scenes across different video data, and serves as a basis for indexing of whole video sequences.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132787228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Ontological query language for content based image retrieval","authors":"Chris Town, David Sin","doi":"10.1109/IVL.2001.990859","DOIUrl":"https://doi.org/10.1109/IVL.2001.990859","url":null,"abstract":"The paper discusses the design and implementation of the oquel query language for content based image retrieval. The retrieval process takes place entirely within the ontological domain defined by the syntax and semantics of the user query. Since the system does not rely on the pre-annotation of images with sentences in the language, the format of text queries is highly flexible. The language is also extensible to allow for the definition of higher level terms such as \"cars\", \"people\", \"buildings\", etc. on the basis of existing language constructs. Images are retrieved by deriving an abstract syntax tree form of a textual user query and probabilistically evaluating it by analysing the composition and perceptual properties of salient image regions in light of the query. The matching process utilises automatically extracted image segmentation and classification information and can incorporate any other feature extraction mechanisms or contextual knowledge available at processing time.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133271599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Audio-visual event detection using duration dependent input output Markov models","authors":"M. Naphade, A. Garg, T.S. Huang","doi":"10.1109/IVL.2001.990854","DOIUrl":"https://doi.org/10.1109/IVL.2001.990854","url":null,"abstract":"Analysis of audio-visual data and detection of semantic events with spatio-temporal support is a challenging multimedia understanding problem. The difficulty lies in the gap that exists between low level media features and high level semantic concept. We introduce a duration dependent input output Markov model (DDIOMM) to detect events based on multiple modalities. The DDIOMM combines the ability to model non-exponential duration densities with the mapping of input sequences to output sequences. We test the DDIOMM by modelling the audio-visual event explosion. We compare the detection performance of the DDIOMM with the IOMM as well as the HMM. Experiments reveal that modeling of duration improves detection performance.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"90 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116833601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards object-based retrieval for image libraries","authors":"B. Maxwell","doi":"10.1109/IVL.2001.990852","DOIUrl":"https://doi.org/10.1109/IVL.2001.990852","url":null,"abstract":"Object discovery is one of the steps to effective content-based image retrieval. If a vision system has the ability to identify potential objects in an image, it enables the user to phrase queries in terms of objects, and it enables the computer to search the image library for similar objects. The paper describes a physics-based approach to object discovery. The approach grows seed regions to include neighboring regions when they are deemed coherent according to a suite of physics-based and heuristic measures. Using this approach, the computer is able to extract coherent surfaces from an image library and use the resulting object images to execute searches. Initial results indicate higher accuracy and precision for object-based image retrieval when compared to traditional histogram-based retrieval. The object-based method is able to find and retrieve images that are considered poor matches by other methods.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121077365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Detection of important segments in cooking videos","authors":"R. Hamada, S. Satoh, S. Sakai, H. Tanaka","doi":"10.1109/IVL.2001.990865","DOIUrl":"https://doi.org/10.1109/IVL.2001.990865","url":null,"abstract":"The paper presents a method to delineate visually important segments from cooking videos, which is expected to be a core technique for cooking video indexing. Visual information is exceptionally important in cooking videos, since it represents essential technical skills owing to properties of instruction type videos. We reveal that an ordinary shot-based video indexing approach will not work for cooking videos, since visually important segments are absorbed in a shot. Based on the observation of cooking videos, the method detects repetitious motion segments as visually important segments by using relatively simple and robust techniques. The experimental evaluation shows that the method detects more than 80% of manually selected segments, while 84% of detected segments were correct. We also develop a cooking video abstraction system as a sample application of our method and confirm that the proposed method is useful for a real application.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114425613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A hierarchical approach to scene segmentation","authors":"Hang-Bong Kang","doi":"10.1109/IVL.2001.990858","DOIUrl":"https://doi.org/10.1109/IVL.2001.990858","url":null,"abstract":"A scene is an important semantic unit to a user who is accessing video data and is useful in semantic-based video indexing and retrieval. However, scene segmentation from video data is not an easy task. We propose a novel hierarchical scene segmentation method which consists of three steps: initial segmentation, refinement, and adjustment. First, we detect initial scene boundaries using a continuous coherence computing model. As a coherence computing model, we use a short-term memory-based model in which the memory size and attention span size are not fixed. In our model, there are times when the removal of shots from the memory buffer may not follow a First-In-First-Out rule. After detection of initial scene boundaries, we execute the refinement process for each scene using k-means clustering algorithm to find misses not detected in scene boundary detection. The cluster-validity analysis technique is used to find the optimal number of clusters. If a new scene boundary is found within a scene by the analysis of clustering results, the scene is split into two sub-scenes. After that, we execute the adjustment process. We choose two consecutive scenes to detect whether the scene boundary is false or not. For shots of two consecutive scenes, we also perform a k-means clustering algorithm and detect desirable scene boundaries. Finally, accurate scene segmentation results are obtained and experimental results are presented.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"43 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132285828","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploitation of meta knowledge for learning visual concepts","authors":"B. Bhanu, Anlei Dong","doi":"10.1109/IVL.2001.990860","DOIUrl":"https://doi.org/10.1109/IVL.2001.990860","url":null,"abstract":"The paper proposes a content-based image retrieval system which can learn visual concepts and refine them incrementally with increased retrieval experiences captured over time. The approach consists of using fuzzy clustering for learning concepts in conjunction with statistical learning for computing \"relevance\" weights of features used to represent images in the database. As the clusters become relatively stable and correspond to human concept distribution, the system can yield fast retrievals with higher precision. The paper presents a discussion on problems such as the system mistakenly indentifying a concept, a large number of trials to achieve clustering, etc. Experiments on synthetic data and real image database demonstrate the efficacy of this approach.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"223 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133497744","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alan Marchiori, C. Brodley, Jennifer G. Dy, C. Pavlopoulou, A. Kak, L. S. Broderick, A. Aisen
{"title":"CBIR for medical images - an evaluation trial","authors":"Alan Marchiori, C. Brodley, Jennifer G. Dy, C. Pavlopoulou, A. Kak, L. S. Broderick, A. Aisen","doi":"10.1109/IVL.2001.990861","DOIUrl":"https://doi.org/10.1109/IVL.2001.990861","url":null,"abstract":"Content-based image retrieval (CBIR) has the potential to provide medical doctors with a powerful resource to help make accurate diagnoses. To aid in diagnosis, a CBIR system must retrieve similar images from the same (unknown) disease class as the patient. We have implemented a CBIR system that first predicts the disease class of the query image and then retrieves the n images nearest to the query image from the pool of images with the predicted disease class. With the cooperation of residents/radiologists at Indiana University Medical Center and the Department of Radiology at the University of Wisconsin we have recently completed an evaluation of our system. The results show that when using our system, the diagnostic accuracy of the group increased on average by 32% over diagnosis without any reference materials.","PeriodicalId":190569,"journal":{"name":"Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001)","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2001-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126822330","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}