{"title":"命令行Web可访问性评估工具的内部可靠性","authors":"Eryn Rachael Kelsey-Adkins, R. Thompson","doi":"10.1145/3517428.3550395","DOIUrl":null,"url":null,"abstract":"This study compares four command-line interface (CLI) web accessibility tools, examining if one CLI tool is sufficient for automated accessibility evaluation. The four tools were: Axe-core/cli, IBM Equal Access NPM Accessibility Checker (Accessibility Checker), Pa11y-ci, and the A11y Machine. Inter-rater reliability was calculated using Gwet’s alpha coefficient 2 (AC2), and the results indicate very poor reliability between tools.","PeriodicalId":384752,"journal":{"name":"Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility","volume":"64 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Inter-rater Reliability of Command-Line Web Accessibility Evaluation Tools\",\"authors\":\"Eryn Rachael Kelsey-Adkins, R. Thompson\",\"doi\":\"10.1145/3517428.3550395\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This study compares four command-line interface (CLI) web accessibility tools, examining if one CLI tool is sufficient for automated accessibility evaluation. The four tools were: Axe-core/cli, IBM Equal Access NPM Accessibility Checker (Accessibility Checker), Pa11y-ci, and the A11y Machine. Inter-rater reliability was calculated using Gwet’s alpha coefficient 2 (AC2), and the results indicate very poor reliability between tools.\",\"PeriodicalId\":384752,\"journal\":{\"name\":\"Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility\",\"volume\":\"64 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3517428.3550395\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3517428.3550395","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Inter-rater Reliability of Command-Line Web Accessibility Evaluation Tools
This study compares four command-line interface (CLI) web accessibility tools, examining if one CLI tool is sufficient for automated accessibility evaluation. The four tools were: Axe-core/cli, IBM Equal Access NPM Accessibility Checker (Accessibility Checker), Pa11y-ci, and the A11y Machine. Inter-rater reliability was calculated using Gwet’s alpha coefficient 2 (AC2), and the results indicate very poor reliability between tools.