{"title":"LevelUp – Automatic Assessment of Block-Based Machine Learning Projects for AI Education","authors":"Tejal Reddy, Randi Williams, C. Breazeal","doi":"10.1109/vl/hcc53370.2022.9833130","DOIUrl":"https://doi.org/10.1109/vl/hcc53370.2022.9833130","url":null,"abstract":"—Although artificial intelligence (AI) is increasingly involved in everyday technologies, AI literacy amongst the general public remains low. Thus many AI education curricula for people without prior AI experience have emerged, often utilizing graphical programming languages for hands-on projects. However, there are no tools that assist educators in evaluating learners’ AI projects or provide learners with contemporaneous feedback on their work. We developed LevelUp, an automatic code analysis tool to support these educators and learners. LevelUp is built into a block-based programming platform and gives users continuous feedback on their text classification projects. We evaluated the tool with a crossover user study where participants completed two text classification projects, once where they could access LevelUp and once when they could not. To measure the tool’s impact on participants’ understanding of text classification, we used pre-post assessments and graded both of their projects against LevelUp’s rubric. We saw a significant improvement in the quality of participants’ projects after they used the tool. We also used questionnaires to solicit participants’ feedback. Overall, participants said that LevelUp was useful and intuitive. Our investigation of this novel automatic assessment tool can inform the design of future code analysis tools for AI education.","PeriodicalId":351709,"journal":{"name":"2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130915990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Tools for Creating UI Automation Macros","authors":"Rebecca Krosnick","doi":"10.1109/vl/hcc53370.2022.9832966","DOIUrl":"https://doi.org/10.1109/vl/hcc53370.2022.9832966","url":null,"abstract":"Automation macros enable users to perform digital tasks programmatically to save time or support hands-free interaction. For example, macros can be used to perform web scraping for a research project (e.g., scraping articles from a news site) or personal task automation via natural language (e.g., ordering food for delivery). Some kinds of automation are built into our devices and are readily available (e.g., via Siri [1] or Alexa [2]), but this set is limited and often will not support a user’s niche or complex needs. Users can create their own custom macros, but traditionally this requires writing program code which involves a significant amount of effort for programmers and is infeasible for non-programmers. In my PhD work, I have studied and designed tools for developers and end-users to more intuitively create user interface (UI) automation macros. First, I studied the challenges and needs of programmers writing web automation scripts [3], both in a traditional text editor and in richer environments, including a prototype IDE I built that provides context about the target UI and feedback on element selection logic. Next, I designed a programming by demonstration (PBD) environment that enables end-users to create custom macros for answering questions on the web without needing to write code [4]. So far my work has focused on helping users create macros that perform a desired web scraping or automation task on a single website. However, it makes sense that users might also want to perform the same kinds of automation on semantically similar websites. For example, a user might want to create an automation macro that can order food not only from the DoorDash website, but also from the GrubHub and Uber Eats websites. Another user might want to create an automation macro that scrapes data from staff directories across different department and university websites. In both cases, the websites’ content will be similar and the macro should perform the same high-level actions, but the websites’ exact visual appearance, widgets, and underlying implementation will vary. Currently users would need to create separate macros from scratch for each website. In my future work, I plan to help users create semantic macros -– macros that are capable of performing a given highlevel semantic task across different websites – without needing to create new automation logic from scratch for each new website. II. DEVELOPER ENVIRONMENTS FOR CREATING MACROS","PeriodicalId":351709,"journal":{"name":"2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134621731","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Programming Assistance and Recommendations","authors":"","doi":"10.1109/vl/hcc53370.2022.9832965","DOIUrl":"https://doi.org/10.1109/vl/hcc53370.2022.9832965","url":null,"abstract":"","PeriodicalId":351709,"journal":{"name":"2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128091626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Information Seeking Behavior for Bugs on GitHub: An Information Foraging Perspective","authors":"Abim Sedhain, S. Kuttal","doi":"10.1109/vl/hcc53370.2022.9833144","DOIUrl":"https://doi.org/10.1109/vl/hcc53370.2022.9833144","url":null,"abstract":"","PeriodicalId":351709,"journal":{"name":"2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126059447","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Feasibility of using YouTube Conversations for Pair Programming Intent Classification","authors":"Jacob Hart, J. AuBuchon, S. Kuttal","doi":"10.1109/vl/hcc53370.2022.9833139","DOIUrl":"https://doi.org/10.1109/vl/hcc53370.2022.9833139","url":null,"abstract":"","PeriodicalId":351709,"journal":{"name":"2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122722823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Quintessence: An Intersectional Reflexivity Tool for Data-Centric Research & Development","authors":"Alicia E. Boyd, Jibiana Jakpor, Brittany Johnson","doi":"10.1109/vl/hcc53370.2022.9833001","DOIUrl":"https://doi.org/10.1109/vl/hcc53370.2022.9833001","url":null,"abstract":"","PeriodicalId":351709,"journal":{"name":"2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115945312","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Block-based Languages and Programming Education","authors":"","doi":"10.1109/vl/hcc53370.2022.9833115","DOIUrl":"https://doi.org/10.1109/vl/hcc53370.2022.9833115","url":null,"abstract":"","PeriodicalId":351709,"journal":{"name":"2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)","volume":"87 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124284036","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dockerlive : A live development environment for Dockerfiles","authors":"David Reis, F. F. Correia","doi":"10.1109/vl/hcc53370.2022.9833145","DOIUrl":"https://doi.org/10.1109/vl/hcc53370.2022.9833145","url":null,"abstract":"","PeriodicalId":351709,"journal":{"name":"2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)","volume":"94 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124733988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Making the Invisible Visible in Computational Notebooks","authors":"M. V. Merino, L. Thomas van Binsbergen, M. Seraj","doi":"10.1109/vl/hcc53370.2022.9833148","DOIUrl":"https://doi.org/10.1109/vl/hcc53370.2022.9833148","url":null,"abstract":"—Notebooks are increasingly popular programming tools adopted by a diverse range of users, including professional and novice users, from various fields not necessarily skilled in software engineering, to experiment with programming and develop software. Notebooks are often used within interactive and exploratory programming settings; however, some of their main use cases are not naturally supported by their design. For example, users can only get insights into the program’s state by executing program fragments and updating one’s mental model. This paper discusses the possibility of defining widgets to improve notebooks by providing direct insights into the program state. The widgets are developed upon previous work in which a novel approach to incremental programming is suggested based on the notion of an exploring interpreter. As example, we present widgets for visualizing execution history and variable assignments, thereby reducing the cognitive load on users.","PeriodicalId":351709,"journal":{"name":"2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132023633","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Till Bieg, Mathias Schmoigl-Tonis, N. Sturm, Chloé Nativel, A. Sackl
{"title":"Enabling Cross-Domain Robot Programming By End-Users: The ROBxTASK Platform","authors":"Till Bieg, Mathias Schmoigl-Tonis, N. Sturm, Chloé Nativel, A. Sackl","doi":"10.1109/vl/hcc53370.2022.9833136","DOIUrl":"https://doi.org/10.1109/vl/hcc53370.2022.9833136","url":null,"abstract":"","PeriodicalId":351709,"journal":{"name":"2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132056099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}