StepLogger and EvaalScore: The software suite of the IPIN onsite indoor localization competition

IF 2.4 4区计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING

SoftwareX Pub Date : 2025-03-08 DOI:10.1016/j.softx.2025.102115

Michele Girolami, Paolo Baronti, Francesco Potortì, Antonino Crivello, Filippo Palumbo

{"title":"StepLogger and EvaalScore: The software suite of the IPIN onsite indoor localization competition","authors":"Michele Girolami, Paolo Baronti, Francesco Potortì, Antonino Crivello, Filippo Palumbo","doi":"10.1016/j.softx.2025.102115","DOIUrl":null,"url":null,"abstract":"<div><div>This paper illustrates the software suite developed for Track 1 of the IPIN competition, which evaluates smartphone apps for indoor localization. Competitors have one day before the trial day to survey the competition area. On the trial day, an independent “actor” carries the competing system on smartphone and walks a predefined path. Competing systems provide continuous location estimates, which are later compared to a ground truth. We describe the software suite used to gather and present the results: the StepLogger Android application for real-time logging of position estimates and the EvaalScore tool for performance evaluation.</div><div>StepLogger collects location estimating data from competitors with a timestamp, while EvaalScore calculates the accuracy of the competing systems. The competition ranking is based on the third quartile of point localization error. The presented software suite ensures a standardized and fair assessment of competing systems, thus promoting reproducibility and transparency in indoor localization research.</div></div>","PeriodicalId":21905,"journal":{"name":"SoftwareX","volume":"30 ","pages":"Article 102115"},"PeriodicalIF":2.4000,"publicationDate":"2025-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"SoftwareX","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2352711025000822","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}

引用次数: 0

Abstract

This paper illustrates the software suite developed for Track 1 of the IPIN competition, which evaluates smartphone apps for indoor localization. Competitors have one day before the trial day to survey the competition area. On the trial day, an independent “actor” carries the competing system on smartphone and walks a predefined path. Competing systems provide continuous location estimates, which are later compared to a ground truth. We describe the software suite used to gather and present the results: the StepLogger Android application for real-time logging of position estimates and the EvaalScore tool for performance evaluation.

StepLogger collects location estimating data from competitors with a timestamp, while EvaalScore calculates the accuracy of the competing systems. The competition ranking is based on the third quartile of point localization error. The presented software suite ensures a standardized and fair assessment of competing systems, thus promoting reproducibility and transparency in indoor localization research.

查看原文本刊更多论文

求助全文

约1分钟内获得全文求助全文

来源期刊

SoftwareX COMPUTER SCIENCE, SOFTWARE ENGINEERING-

CiteScore

5.50

自引率

2.90%

发文量

184

审稿时长

9 weeks

期刊介绍： SoftwareX aims to acknowledge the impact of software on today''s research practice, and on new scientific discoveries in almost all research domains. SoftwareX also aims to stress the importance of the software developers who are, in part, responsible for this impact. To this end, SoftwareX aims to support publication of research software in such a way that: The software is given a stamp of scientific relevance, and provided with a peer-reviewed recognition of scientific impact; The software developers are given the credits they deserve; The software is citable, allowing traditional metrics of scientific excellence to apply; The academic career paths of software developers are supported rather than hindered; The software is publicly available for inspection, validation, and re-use. Above all, SoftwareX aims to inform researchers about software applications, tools and libraries with a (proven) potential to impact the process of scientific discovery in various domains. The journal is multidisciplinary and accepts submissions from within and across subject domains such as those represented within the broad thematic areas below: Mathematical and Physical Sciences; Environmental Sciences; Medical and Biological Sciences; Humanities, Arts and Social Sciences. Originating from these broad thematic areas, the journal also welcomes submissions of software that works in cross cutting thematic areas, such as citizen science, cybersecurity, digital economy, energy, global resource stewardship, health and wellbeing, etcetera. SoftwareX specifically aims to accept submissions representing domain-independent software that may impact more than one research domain.