Facilitating Monkey Test by Detecting Operable Regions in Rendered GUI of Mobile Game Apps

Chenglong Sun, Zhenyu Zhang, Bo Jiang, William Chan
{"title":"Facilitating Monkey Test by Detecting Operable Regions in Rendered GUI of Mobile Game Apps","authors":"Chenglong Sun, Zhenyu Zhang, Bo Jiang, William Chan","doi":"10.1109/QRS.2016.41","DOIUrl":null,"url":null,"abstract":"Graphical User Interface (GUI) is a component of many software applications. Many mobile game applications in particular have to provide excellent user experiences using graphical engines to render GUI screens. On a rendered GUI screen such as a treasury map, no GUI widget is embodied in it and the operable GUI regions, each of which is a region that triggers actions when certain events acting on these regions, may only be implicitly determinable. Traditional testing tools like monkey test do not effectively generate effective event sequences over such operable GUI regions. Our insight is that operable regions in a rendered GUI screen of many mobile game applications are given with visible hints to catch user attentions. In this paper, we propose Smart Monkey, which uses the fundamental features of a screen, including color, intensity, and texture, as visual signals to detect operable GUI region candidates, and iteratively identifies and confirms the real operable GUI regions by launching GUI events to the region. We have implemented Smart Monkey as a testing tool for Android apps and conducted case studies on real-world applications to compare it with a peer technique. The empirical results show that it effective in identifying such operable regions and thus able to generate functional event sequences more efficiently.","PeriodicalId":412973,"journal":{"name":"2016 IEEE International Conference on Software Quality, Reliability and Security (QRS)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 IEEE International Conference on Software Quality, Reliability and Security (QRS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/QRS.2016.41","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 5

Abstract

Graphical User Interface (GUI) is a component of many software applications. Many mobile game applications in particular have to provide excellent user experiences using graphical engines to render GUI screens. On a rendered GUI screen such as a treasury map, no GUI widget is embodied in it and the operable GUI regions, each of which is a region that triggers actions when certain events acting on these regions, may only be implicitly determinable. Traditional testing tools like monkey test do not effectively generate effective event sequences over such operable GUI regions. Our insight is that operable regions in a rendered GUI screen of many mobile game applications are given with visible hints to catch user attentions. In this paper, we propose Smart Monkey, which uses the fundamental features of a screen, including color, intensity, and texture, as visual signals to detect operable GUI region candidates, and iteratively identifies and confirms the real operable GUI regions by launching GUI events to the region. We have implemented Smart Monkey as a testing tool for Android apps and conducted case studies on real-world applications to compare it with a peer technique. The empirical results show that it effective in identifying such operable regions and thus able to generate functional event sequences more efficiently.
通过检测手机游戏应用渲染GUI中的可操作区域,方便猴子测试
图形用户界面(GUI)是许多软件应用程序的组成部分。特别是许多手机游戏应用必须使用图形引擎来呈现GUI屏幕,从而提供出色的用户体验。在呈现的GUI屏幕(如财库地图)上,没有GUI小部件嵌入其中,并且可操作的GUI区域(每个区域都是在特定事件作用于这些区域时触发操作的区域)可能只是隐式确定的。传统的测试工具,如猴子测试,不能有效地在这些可操作的GUI区域上生成有效的事件序列。我们的见解是,许多手机游戏应用渲染GUI屏幕中的可操作区域都带有可见的提示以吸引用户的注意。在本文中,我们提出了Smart Monkey,它使用屏幕的基本特征,包括颜色,强度和纹理,作为视觉信号来检测可操作的GUI区域候选,并通过向该区域启动GUI事件来迭代识别和确认真正的可操作GUI区域。我们已经实现了Smart Monkey作为Android应用程序的测试工具,并对实际应用程序进行了案例研究,将其与同类技术进行比较。实验结果表明,该方法能够有效地识别出这些可操作区域,从而能够更高效地生成功能事件序列。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信