Overview of the Ninth Dialog System Technology Challenge: DSTC9

IF 4.1 2区计算机科学 Q1 ACOUSTICS

IEEE/ACM Transactions on Audio, Speech, and Language Processing Pub Date : 2024-07-11 DOI:10.1109/TASLP.2024.3426331

Chulaka Gunasekara;Seokhwan Kim;Luis Fernando D'Haro;Abhinav Rastogi;Yun-Nung Chen;Mihail Eric;Behnam Hedayatnia;Karthik Gopalakrishnan;Yang Liu;Chao-Wei Huang;Dilek Hakkani-Tür;Jinchao Li;Qi Zhu;Lingxiao Luo;Lars Liden;Kaili Huang;Shahin Shayandeh;Runze Liang;Baolin Peng;Zheng Zhang;Swadheen Shukla;Minlie Huang;Jianfeng Gao;Shikib Mehri;Yulan Feng;Carla Gordon;Seyed Hossein Alavi;David Traum;Maxine Eskenazi;Ahmad Beirami;Eunjoon Cho;Paul A. Crook;Ankita De;Alborz Geramifard;Satwik Kottur;Seungwhan Moon;Shivani Poddar;Rajen Subba

{"title":"Overview of the Ninth Dialog System Technology Challenge: DSTC9","authors":"Chulaka Gunasekara;Seokhwan Kim;Luis Fernando D'Haro;Abhinav Rastogi;Yun-Nung Chen;Mihail Eric;Behnam Hedayatnia;Karthik Gopalakrishnan;Yang Liu;Chao-Wei Huang;Dilek Hakkani-Tür;Jinchao Li;Qi Zhu;Lingxiao Luo;Lars Liden;Kaili Huang;Shahin Shayandeh;Runze Liang;Baolin Peng;Zheng Zhang;Swadheen Shukla;Minlie Huang;Jianfeng Gao;Shikib Mehri;Yulan Feng;Carla Gordon;Seyed Hossein Alavi;David Traum;Maxine Eskenazi;Ahmad Beirami;Eunjoon Cho;Paul A. Crook;Ankita De;Alborz Geramifard;Satwik Kottur;Seungwhan Moon;Shivani Poddar;Rajen Subba","doi":"10.1109/TASLP.2024.3426331","DOIUrl":null,"url":null,"abstract":"This paper introduces the Ninth Dialog System Technology Challenge (DSTC-9). This edition of the DSTC focuses on applying end-to-end dialog technologies for four distinct tasks in dialog systems, namely, 1. Task-oriented dialog Modeling with Unstructured Knowledge Access, 2. Multi-domain task-oriented dialog, 3. Interactive evaluation of dialog and 4. Situated interactive multimodal dialog. This paper describes the task definition, provided datasets, baselines, and evaluation setup for each track. We also summarize the results of the submitted systems to highlight the general trends of the state-of-the-art technologies for the tasks.","PeriodicalId":13332,"journal":{"name":"IEEE/ACM Transactions on Audio, Speech, and Language Processing","volume":"32 ","pages":"4066-4076"},"PeriodicalIF":4.1000,"publicationDate":"2024-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10595468","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE/ACM Transactions on Audio, Speech, and Language Processing","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10595468/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ACOUSTICS","Score":null,"Total":0}

引用次数: 0

Abstract

This paper introduces the Ninth Dialog System Technology Challenge (DSTC-9). This edition of the DSTC focuses on applying end-to-end dialog technologies for four distinct tasks in dialog systems, namely, 1. Task-oriented dialog Modeling with Unstructured Knowledge Access, 2. Multi-domain task-oriented dialog, 3. Interactive evaluation of dialog and 4. Situated interactive multimodal dialog. This paper describes the task definition, provided datasets, baselines, and evaluation setup for each track. We also summarize the results of the submitted systems to highlight the general trends of the state-of-the-art technologies for the tasks.

查看原文本刊更多论文

第九届对话系统技术挑战赛概览：DSTC9

本文介绍第九届对话系统技术挑战赛（DSTC-9）。本期 DSTC 的重点是将端到端对话技术应用于对话系统中的四项不同任务，即：1.非结构化知识访问的任务导向对话建模；2.多领域任务导向对话；3.对话的交互式评估；4.情景交互式多模态对话。情景交互式多模态对话。本文介绍了每个赛道的任务定义、提供的数据集、基线和评估设置。我们还总结了所提交系统的结果，以突出这些任务的最新技术的总体趋势。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

IEEE/ACM Transactions on Audio, Speech, and Language Processing ACOUSTICS-ENGINEERING, ELECTRICAL & ELECTRONIC

CiteScore

11.30

自引率

11.10%

发文量

217

期刊介绍： The IEEE/ACM Transactions on Audio, Speech, and Language Processing covers audio, speech and language processing and the sciences that support them. In audio processing: transducers, room acoustics, active sound control, human audition, analysis/synthesis/coding of music, and consumer audio. In speech processing: areas such as speech analysis, synthesis, coding, speech and speaker recognition, speech production and perception, and speech enhancement. In language processing: speech and text analysis, understanding, generation, dialog management, translation, summarization, question answering and document indexing and retrieval, as well as general language modeling.