Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos最新文献

Learning, Understanding and Interaction in Videos 视频中的学习、理解和互动

Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos Pub Date : 2022-10-10 DOI: 10.1145/3552463.3555837

Manmohan Chandraker

引用次数: 0

Panel Discussion: Emerging Topics on Video Summarization 小组讨论:视频摘要的新兴话题

Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos Pub Date : 2022-10-10 DOI: 10.1145/3552463.3558051

Mohan S. Kankanhalli, Jianquan Liu, Yongkang Wong, Karen Stephen

引用次数: 0

Video Summarization in the Deep Learning Era: Current Landscape and Future Directions

Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos Pub Date : 2022-10-10 DOI: 10.1145/3552463.3554166

I. Patras

引用次数: 0

Narrative Dataset: Towards Goal-Driven Narrative Generation 叙事数据集:朝着目标驱动的叙事生成

Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos Pub Date : 2022-10-10 DOI: 10.1145/3552463.3557021

Karen Stephen, Rishabh Sheoran, Satoshi Yamazaki

{"title":"Narrative Dataset: Towards Goal-Driven Narrative Generation","authors":"Karen Stephen, Rishabh Sheoran, Satoshi Yamazaki","doi":"10.1145/3552463.3557021","DOIUrl":"https://doi.org/10.1145/3552463.3557021","url":null,"abstract":"In this paper, we propose a new dataset called the Narrative dataset, which is a work in progress, towards generating video and text narratives of complex daily events from long videos, captured from multiple cameras. As most of the existing datasets are collected from publicly available videos such as YouTube videos, there are no datasets targeted towards the task of narrative summarization of complex videos which contains multiple narratives. Hence, we create story plots and conduct video shooting with hired actors to create complex video sets where 3 to 4 narratives happen in each video. In the story plot, a narrative composes of multiple events corresponding to video clips of key human activities. On top of the shot video sets and the story plot, the narrative dataset contains dense annotation of actors, objects, and their relationships for each frame as the facts of narratives. Therefore, narrative dataset richly contains holistic and hierarchical structure of facts, events, and narratives. Moreover, Narrative Graph, a collection of scene graphs of narrative events with their causal relationships, is introduced for bridging the gap between the collection of facts and generation of the summary sentences of a narrative. Beyond related subtasks such as scene graph generation, narrative dataset potentially provide challenges of subtasks for bridging human event clips to narratives.","PeriodicalId":293267,"journal":{"name":"Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133931231","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Contrastive Representation Learning for Expression Recognition from Masked Face Images 基于对比表征学习的蒙面人脸表情识别

Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos Pub Date : 2022-10-10 DOI: 10.1145/3552463.3557020

Fanxing Luo, Long Zhao, Yu Wang, Jien Kato

引用次数: 0

Soccer Game Summarization using Audio Commentary, Metadata, and Captions 使用音频解说、元数据和字幕的足球比赛摘要

Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos Pub Date : 2022-10-10 DOI: 10.1145/3552463.3557019

Sushant Gautam, Cise Midoglu, Saeed Shafiee Sabet, Dinesh Baniya Kshatri, P. Halvorsen

{"title":"Soccer Game Summarization using Audio Commentary, Metadata, and Captions","authors":"Sushant Gautam, Cise Midoglu, Saeed Shafiee Sabet, Dinesh Baniya Kshatri, P. Halvorsen","doi":"10.1145/3552463.3557019","DOIUrl":"https://doi.org/10.1145/3552463.3557019","url":null,"abstract":"Soccer is one of the most popular sports globally, and the amount of soccer-related content worldwide, including video footage, audio commentary, team/player statistics, scores, and rankings, is enormous and rapidly growing. Consequently, the generation of multimodal summaries is of tremendous interest for broadcasters and fans alike, as a large percentage of audiences prefer to follow only the main highlights of a game. However, annotating important events and producing summaries often requires expensive equipment and a lot of tedious, cumbersome, manual labour. In this context, recent developments in Artificial Intelligence (AI) have shown great potential. The goal of this work is to create an automated soccer game summarization pipeline using AI. In particular, our focus is on the generation of complete game summaries in continuous text format with length constraints, based on raw game multimedia, as well as readily available game metadata and captions where applicable, using Natural Language Processing (NLP) tools along with heuristics. We curate and extend a number of soccer datasets, implement an end-to-end pipeline for the automatic generation of text summaries, present our preliminary results from the comparative analysis of various summarization methods within this pipeline using different input modalities, and provide a discussion of open challenges in the field of automated game summarization.","PeriodicalId":293267,"journal":{"name":"Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos","volume":"120 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129389724","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos 第一届以用户为中心的长视频叙事总结研讨会论文集

Proceedings of the 1st Workshop on User-centric Narrative Summarization of Long Videos Pub Date : 1900-01-01 DOI: 10.1145/3552463

引用次数: 0