发布求助
文献互助 智能选刊 最新文献

MS最新文献

筛选
英文 中文
Learning ontology rules for semantic video annotation 学习语义视频标注的本体规则
MS Pub Date : 2008-10-31 DOI: 10.1145/1460676.1460678
M. Bertini, A. Bimbo, G. Serra
{"title":"Learning ontology rules for semantic video annotation","authors":"M. Bertini, A. Bimbo, G. Serra","doi":"10.1145/1460676.1460678","DOIUrl":"https://doi.org/10.1145/1460676.1460678","url":null,"abstract":"Semantic video annotation using ontologies has received a large attention from the scientific community in the recent years. Ontologies are being regarded as an appropriate tool to bridge the semantic gap. In this paper we present an overview of the state-of-the-art of approaches and algorithms that exploit ontologies to perform semantic video annotation and present an approach to automatically learn rules describing high-level concepts. This approach exploits the domain knowledge embedded into an ontology to learn a set of rules for semantic video annotation. The proposed technique is an adaptation of the First Order Inductive Learner (FOIL) technique to the Semantic Web Rule Language (SWRL) standard: Experiments have been performed in two different video domains: i) the TRECVID 2005 broadcast news collection, to detect events related to airplanes, such as taxiing, flying, landing and taking off; ii) surveillance videos, to detect if a person enters or exits a specific area. The promising experimental performance demonstrates the effectiveness and flexibility of the proposed framework.","PeriodicalId":82053,"journal":{"name":"MS","volume":"36 1","pages":"1-8"},"PeriodicalIF":0.0,"publicationDate":"2008-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89444627","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 25
Use of weighted visual terms and machine learning techniques for image content recognition relying on mpeg-7 visual descriptors 基于mpeg-7视觉描述符的图像内容识别使用加权视觉术语和机器学习技术
MS Pub Date : 2008-10-31 DOI: 10.1145/1460676.1460689
Giuseppe Amato, P. Savino, V. Magionami
{"title":"Use of weighted visual terms and machine learning techniques for image content recognition relying on mpeg-7 visual descriptors","authors":"Giuseppe Amato, P. Savino, V. Magionami","doi":"10.1145/1460676.1460689","DOIUrl":"https://doi.org/10.1145/1460676.1460689","url":null,"abstract":"We propose a technique for automatic recognition of content in images. Our technique uses machine learning methods to build classifiers which are able to decide about the presence of semantic concepts in images. Our classifiers exploit a representation of images in terms of vectors of visual terms. A visual term represents a set of visually similar regions that can be found in images. Various types of visual terms are used at the same time to take into account various similarity criteria and region representations that are available to compare regions. Specifically, we compare regions using the 5 MPEG-7 visual descriptors. An image is indexed by first using a segmentation algorithm to extract its regions, and then the image is associated with the visual terms that are more similar to the extracted regions. The proposed technique offers very good performance as demonstrated by the experiments that we performed.","PeriodicalId":82053,"journal":{"name":"MS","volume":"31 1","pages":"60-63"},"PeriodicalIF":0.0,"publicationDate":"2008-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75495205","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
An exploratory study on joint analysis of visual classification in narrow domains and the discriminative power of tags 窄域视觉分类与标签辨别力联合分析的探索性研究
MS Pub Date : 2008-10-31 DOI: 10.1145/1460676.1460685
Oge Marques, M. Lux
{"title":"An exploratory study on joint analysis of visual classification in narrow domains and the discriminative power of tags","authors":"Oge Marques, M. Lux","doi":"10.1145/1460676.1460685","DOIUrl":"https://doi.org/10.1145/1460676.1460685","url":null,"abstract":"The popularity of social media sharing sites such as Flickr has driven a significant amount of research on the analysis of information contained in the tags used to annotate images. Many of such tags are not useful to describe the contents of an image and are often labeled as not descriptive or even noisy. In this work we focus on the descriptiveness of a tag in an exploratory way, within a relatively narrow domain, and with the help of a visual classifier. Preliminary experimental results demonstrate the possibility to infer descriptiveness of tags from a joint analysis of tag entropy calculations and the results of an automated visual classifier with a limited number of classes without taking tag content or tag co-occurrence into account. We postulate that these experiments can be extended and improved toward a working solution that might answer the question: Given a semantic category, which tags would you use for searching an image from that category?","PeriodicalId":82053,"journal":{"name":"MS","volume":"39 1","pages":"40-47"},"PeriodicalIF":0.0,"publicationDate":"2008-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83672454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
The semantics of MPEG-21 digital items revisited 重新审视MPEG-21数字项目的语义
MS Pub Date : 2008-10-31 DOI: 10.1145/1460676.1460681
C. Timmerer, M. T. Andrade, Pedro Carvalho, D. Rogai, G. Cordara
{"title":"The semantics of MPEG-21 digital items revisited","authors":"C. Timmerer, M. T. Andrade, Pedro Carvalho, D. Rogai, G. Cordara","doi":"10.1145/1460676.1460681","DOIUrl":"https://doi.org/10.1145/1460676.1460681","url":null,"abstract":"The MPEG-21 standard forms a comprehensive multimedia framework covering the entire multimedia distribution chain. In particular, it provides a flexible approach to represent, process, and transact complex multimedia objects which are referred to as Digital Items (DIs). DIs can be quite generic, independent of the application domain, and can encompass a diversity of media resources and metadata. This flexibility has an impact on the level of interoperability between systems and applications, since not all the functionality needs to be implemented. Furthermore, additional semantic rules may be implemented through the processing of the Digital Item which is possibly driven by proprietary metadata. This jeopardizes interoperability and consequently raises barriers to the successful achievement of augmented and transparent use of multimedia resources. In this context, we have investigated and evaluated the interoperability at the semantic level of Digital Items throughout the automated production, delivery and consumption of complex multimedia resources in heterogeneous environments. This paper describes the studies conducted, the experiments performed, and the conclusions reached towards that goal.","PeriodicalId":82053,"journal":{"name":"MS","volume":"205 1","pages":"17-23"},"PeriodicalIF":0.0,"publicationDate":"2008-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77042694","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Dynamic pictorial ontologies for video digital libraries annotation 用于视频数字图书馆注释的动态图形本体
MS Pub Date : 2007-09-28 DOI: 10.1145/1290067.1290076
M. Bertini, A. Bimbo, C. Torniai, C. Grana, R. Cucchiara
{"title":"Dynamic pictorial ontologies for video digital libraries annotation","authors":"M. Bertini, A. Bimbo, C. Torniai, C. Grana, R. Cucchiara","doi":"10.1145/1290067.1290076","DOIUrl":"https://doi.org/10.1145/1290067.1290076","url":null,"abstract":"In this paper, we present the dynamic pictorial ontology paradigm for video annotation. Ontologies are often used to describe a given domain for different goals, including description of multimedia data. In the case of video annotation, the visual knowledge cannot be described using only abstract concepts but is more effectively represented in a visual form. To this aim, we introduce visual concepts, elicited from the data set as the most representative prototypes that specialize abstract concepts. The ontology created is intrinsically dynamic since it must embrace the perceptual and visual experience during annotation. Thus visual concepts can change, adapting to the multimedia content analyzed. Motivation for this new ontology paradigm are discussed together with a proposal of a framework for ontology creation, maintenance, and automatic annotation of video. The creation and usage of dynamic pictorial ontologies have been tested for soccer domain exploiting low level perceptual features and higher level domain features.","PeriodicalId":82053,"journal":{"name":"MS","volume":"53 1","pages":"47-56"},"PeriodicalIF":0.0,"publicationDate":"2007-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86841339","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
An efficient manual image annotation approach based on tagging and browsing 一种基于标记和浏览的高效手动图像标注方法
MS Pub Date : 2007-09-28 DOI: 10.1145/1290067.1290071
Rong Yan, A. Natsev, Murray Campbell
{"title":"An efficient manual image annotation approach based on tagging and browsing","authors":"Rong Yan, A. Natsev, Murray Campbell","doi":"10.1145/1290067.1290071","DOIUrl":"https://doi.org/10.1145/1290067.1290071","url":null,"abstract":"This paper investigates new approaches to improve the efficiency of manual image annotation and help users to produce better annotation results in a given amount of time. Although important in practice, this issue has rarely been studied in a quantitative way before. To achieve this, we first propose two time models to analyze the annotation process for two popular manual annotation approaches, i.e., tagging and browsing. The complementary properties of these approaches have inspired us to merge them to develop a hybrid annotation algorithms called frequency-based annotation. Our experiments on large-scale multimedia collections have shown that the proposed algorithm can achieve an up to 40% annotation time reduction compared with the baseline methods. In other words, it can produce considerably better results using the same annotation time.","PeriodicalId":82053,"journal":{"name":"MS","volume":"18 1","pages":"13-20"},"PeriodicalIF":0.0,"publicationDate":"2007-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75125380","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 26
Automatic metadata extraction and indexing for reusing e-learning multimedia objects 用于重用电子学习多媒体对象的自动元数据提取和索引
MS Pub Date : 2007-09-28 DOI: 10.1145/1290067.1290072
Paolo Bolettieri, F. Falchi, C. Gennaro, F. Rabitti
{"title":"Automatic metadata extraction and indexing for reusing e-learning multimedia objects","authors":"Paolo Bolettieri, F. Falchi, C. Gennaro, F. Rabitti","doi":"10.1145/1290067.1290072","DOIUrl":"https://doi.org/10.1145/1290067.1290072","url":null,"abstract":"In this paper we present the architecture of a Digital Library for enabling the reusing of audiovisual documents in an e-Learning context. The reuse of Learning Objects is based on automatically extracted descriptors carrying a semantic meaning for the professional that uses these Learning Objects to prepare new interactive multimedia lectures. The presented system is based on MILOS, a general purpose Multimedia Content Management System created to support design and effective implementation of digital library applications. MILOS supports the storage andcontent based retrieval of any multimedia documents whose descriptions are provided by using arbitrary metadata models represented in XML. The objective is to demonstrate the reuse of digital content, as video documents or Power Point presentations, by exploiting existing technologies for automatic extraction of metadata (OCR, speech recognition, cut detection, MPEG-7 visual descriptors, etc.). The search interface assists the user of the system in the retrieval the multimedia objects in the collection, by combining full-text retrieval on text extracted and metadata, and similarity search on the MPEG-7 visual descriptors.","PeriodicalId":82053,"journal":{"name":"MS","volume":"61 1","pages":"21-28"},"PeriodicalIF":0.0,"publicationDate":"2007-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74110832","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 25
Fast unsupervised alignment of video and text for indexing/names and faces 快速无监督对齐视频和文本索引/名称和面孔
MS Pub Date : 2007-09-28 DOI: 10.1145/1290067.1290077
Subhransu Maji, R. Bajcsy
{"title":"Fast unsupervised alignment of video and text for indexing/names and faces","authors":"Subhransu Maji, R. Bajcsy","doi":"10.1145/1290067.1290077","DOIUrl":"https://doi.org/10.1145/1290067.1290077","url":null,"abstract":"We propose a novel way of combining weakly associated video/audio and text steams in an unsupervised manner which is faster than conventional speech recognition. The technique aligns audio/video and text streams which will enable video search using the associated text. Multimedia of this form includes news broadcast with summaries, parliament proceedings and court trials with transcripts, sports telecast with text commentary, etc. We also show how we can annotate the video with the names of the person appearing in the video which will allow name based indexing/search. We test the technique on a 80 minute video segment downloaded from the website of the International Court of the Former Yugoslavia, with the corresponding transcripts. The proposed technique achieves 88.49% accuracy on sentence level alignments and 95.5% accuracy on the task of assigning names to faces.","PeriodicalId":82053,"journal":{"name":"MS","volume":"21 1","pages":"57-64"},"PeriodicalIF":0.0,"publicationDate":"2007-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79103467","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
The use of semantic-based predicates implication to improve horizontal multimedia database fragmentation 使用基于语义的谓词隐含来改善水平多媒体数据库的碎片化
MS Pub Date : 2007-09-28 DOI: 10.1145/1290067.1290073
Fekade Getahun Taddesse, Joe Tekli, Solomon Atnafu, R. Chbeir
{"title":"The use of semantic-based predicates implication to improve horizontal multimedia database fragmentation","authors":"Fekade Getahun Taddesse, Joe Tekli, Solomon Atnafu, R. Chbeir","doi":"10.1145/1290067.1290073","DOIUrl":"https://doi.org/10.1145/1290067.1290073","url":null,"abstract":"Database fragmentation allows reducing irrelevant data accesses by grouping data frequently accessed together in dedicated segments. In this paper, we address multimedia database fragmentation to take into account the rich characteristics of multimedia objects. We particularly discuss multimedia primary horizontal fragmentation and focus on semantic-based textual predicates implication required as a pre-process in current fragmentation algorithms in order to partition multimedia data efficiently. Identifying semantic implication between similar queries (if a user searches for the images containing a car, he would probably mean auto, vehicle, van or sport-car as well) will improve the fragmentation process. Making use of the neighborhood concept in knowledge bases to identify semantic implications constitutes the core of our proposal. A prototype has been implemented to evaluate the performance of our approach.","PeriodicalId":82053,"journal":{"name":"MS","volume":"43 1","pages":"29-38"},"PeriodicalIF":0.0,"publicationDate":"2007-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86667359","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
Learning ontology for personalized video retrieval 个性化视频检索的学习本体
MS Pub Date : 2007-09-28 DOI: 10.1145/1290067.1290075
Hiranmay Ghosh, Pasumarthi Poornachander, Anupama Mallik, S. Chaudhury
{"title":"Learning ontology for personalized video retrieval","authors":"Hiranmay Ghosh, Pasumarthi Poornachander, Anupama Mallik, S. Chaudhury","doi":"10.1145/1290067.1290075","DOIUrl":"https://doi.org/10.1145/1290067.1290075","url":null,"abstract":"This paper proposes a new method for using implicit user feedback from clickthrough data to provide personalized ranking of results in a video retrieval system. The annotation based search is complemented with a feature based ranking in our approach. The ranking algorithm uses belief revision in a Bayesian Network, which is derived from a multimedia ontology that captures the probabilistic association of a concept with expected video features. We have developed a content model for videos using discrete feature states to enable Bayesian reasoning and to alleviate on-line feature processing overheads. We propose a reinforcement learning algorithm for the parameters of the Bayesian Network with the implicit feedback obtained from the clickthrough data.","PeriodicalId":82053,"journal":{"name":"MS","volume":"95 1","pages":"39-46"},"PeriodicalIF":0.0,"publicationDate":"2007-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79658227","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
首页 上一页 下一页 尾页
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整，为了账户安全，请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们：info@booksci.cn Book学术提供免费学术资源搜索服务，方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号：604180095
Book学术官方微信
小红书