Victor M. G. Jatobá, Jorge S. Farias, Valdinei Freire, André S. Ruela, Karina V. Delgado
{"title":"ALICAT: a customized approach to item selection process in computerized adaptive testing","authors":"Victor M. G. Jatobá, Jorge S. Farias, Valdinei Freire, André S. Ruela, Karina V. Delgado","doi":"10.1186/s13173-020-00098-z","DOIUrl":"https://doi.org/10.1186/s13173-020-00098-z","url":null,"abstract":"Computerized adaptive testing (CAT) based on item response theory allows more accurate assessments with fewer questions than the classic paper and pencil (P&P) test. Nonetheless, the CAT construction involves some key questions that, when done properly, can further improve the accuracy and efficiency in estimating the examinees’ abilities. One of the main questions is in regard to choosing the item selection rule (ISR). The classic CAT makes exclusive use of one ISR. However, these rules have differences depending on the examinees’ ability level and on the CAT stage. Thus, the objective of this work is to reduce the dichotomous test size which is inserted in a classic CAT with no significant loss of accuracy in the estimation of the examinee’s ability level. For this purpose, we analyze the ISR performance and then build a personalized item selection process in CAT considering the use of more than one rule. The case study in Mathematics and its Technologies test of the ENEM 2012 shows that the Kullback-Leibler information with a posterior distribution ( KLP ) has better performance in the examinees’ ability estimation when compared with Fisher information ( F ), Kullback-Leibler information ( KL ), maximum likelihood weighted information ( MLWI ), and maximum posterior weighted information ( MPWI ) rules. Previous results in the literature show that CAT using KLP was able to reduce this test size by 46.6 % from the full size of 45 items with no significant loss of accuracy in estimating the examinees’ ability level. In this work, we observe that the F and the MLWI rules performed better on early CAT stages to estimate examinees’ proficiency level with extreme negative and positive values, respectively. With this information, we were able to reduce the same test by 53.3 % using the personalized item selection process, called ALICAT, which includes the best rules working together.","PeriodicalId":39760,"journal":{"name":"Journal of the Brazilian Computer Society","volume":"10 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138514962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Anna Carolina Finamore, Haydée G. Jiménez, Marco A. Casanova, Bernardo P. Nunes, Ana Moura Santos, António Pacheco Pires
{"title":"A comparative analysis of two computer science degree offerings","authors":"Anna Carolina Finamore, Haydée G. Jiménez, Marco A. Casanova, Bernardo P. Nunes, Ana Moura Santos, António Pacheco Pires","doi":"10.1186/s13173-020-00097-0","DOIUrl":"https://doi.org/10.1186/s13173-020-00097-0","url":null,"abstract":"This article presents an in-depth analysis and comparison of two computer science degree offerings, viz., the Bologna BSc in Information Systems and Computer Engineering, offered by the Instituto Superior Técnico of the University of Lisbon, Portugal, and the BSc in Computer Science offered by the Pontifical Catholic University of Rio de Janeiro, Brazil. The analysis is based on the student transcripts collected from the academic systems of both institutions over circa one decade. The article starts with a description of the degrees and global statistics of the student population considered. Then, it presents a comparative analysis of the curricula, which focuses on how close students follow the recommended curricula, based on data visualization techniques and academic performance indexes. The indexes indicated a mismatch between the semesters that the curricula recommend for the courses and the semesters that students enroll in those courses. Furthermore, a visualization of course advances and delays indicated that a significant fraction of the students failed in the semester that the curricula recommend for the courses. The article moves on to present a comparative analysis of student performance in individual courses, and then applies a technique borrowed from Market Basket Analysis to investigate student performance in multiple courses that are taken in the same semester. The analysis pointed out sets of courses, at both degrees, that students are struggling with, when they take the courses in the same semester. Finally, the article summarizes the lessons learned, which invite academic administrators to reflect on the weaknesses and strengths of each degree analyzed. Specifically, the analysis suggests that the curricula should be reorganized to avoid that students take certain courses together, not because of conceptual reasons, but because students frequently fail if they do so. Some of these patterns are common to both degrees.","PeriodicalId":39760,"journal":{"name":"Journal of the Brazilian Computer Society","volume":"60 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138520099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Review of The Inventor’s Dilemma: The Remarkable Life of H. Joseph Gerber","authors":"R. Kirby","doi":"10.14714/cp95.1617","DOIUrl":"https://doi.org/10.14714/cp95.1617","url":null,"abstract":"","PeriodicalId":39760,"journal":{"name":"Journal of the Brazilian Computer Society","volume":"1 1","pages":"69-70"},"PeriodicalIF":0.0,"publicationDate":"2020-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47975416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ricelli M. S. Ramos, Danielle S. Monteiro, Ivandré Paraboni
{"title":"Personality-dependent content selection in natural language generation systems","authors":"Ricelli M. S. Ramos, Danielle S. Monteiro, Ivandré Paraboni","doi":"10.1186/s13173-020-00096-1","DOIUrl":"https://doi.org/10.1186/s13173-020-00096-1","url":null,"abstract":"This paper focuses on the computer side of human-computer interaction through natural language, which is the domain of natural language generation (NLG) studies. From a given (usually non-linguistic) input, NLG systems will in principle generate the same fixed text as an output and in order to attain more natural or human-like interaction will often resort to a wide range of strategies for stylistic variation. Among these, the use of computational models of human personality has emerged as a popular alternative in the field and will be the focus of the present work as well. More specifically, the present study describes two machine learning experiments to establish possible relations between personality and content selection (as opposed to the more well-documented relation between personality and surface realisation), and it is, to the best of our knowledge, the first of its kind to address this issue at both macro and micro planning levels, which may arguably pave the way for the future development of more robust personality-dependent systems of this kind.","PeriodicalId":39760,"journal":{"name":"Journal of the Brazilian Computer Society","volume":"204 9","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138520134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Review of Object-Oriented Cartography: Maps as Things","authors":"Douglas Robb","doi":"10.14714/cp94.1607","DOIUrl":"https://doi.org/10.14714/cp94.1607","url":null,"abstract":"","PeriodicalId":39760,"journal":{"name":"Journal of the Brazilian Computer Society","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41441177","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Atlas in a Day Challenge: A Global Real-time Collaboration","authors":"D. Jensen","doi":"10.14714/cp94.1605","DOIUrl":"https://doi.org/10.14714/cp94.1605","url":null,"abstract":"","PeriodicalId":39760,"journal":{"name":"Journal of the Brazilian Computer Society","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41954193","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Review of Data Visualization: Charts, Maps, and Interactive Graphics","authors":"Sarah H. Kelly","doi":"10.14714/cp94.1601","DOIUrl":"https://doi.org/10.14714/cp94.1601","url":null,"abstract":"","PeriodicalId":39760,"journal":{"name":"Journal of the Brazilian Computer Society","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42254188","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Geologic Map of the Moon Designed with Open Data","authors":"E. Lutz","doi":"10.14714/cp94.1599","DOIUrl":"https://doi.org/10.14714/cp94.1599","url":null,"abstract":"This article explains my design process for one of the most challenging maps in the project: a geologic map of the Moon. This Moon map was particularly difficult because the geologic data was split into six different datasets. Each dataset had unique labels (and sometimes different data formats) so I spent a lot of time piecing the data together to create a cohesive map. Though it was difficult to make, it was also one of my favorites, because there were so many unique geologic features, such as large impact craters, broad plains, and textured ridges. The Moon has no significant atmosphere, and there is little wind to erode meteorite craters once they have formed. Several huge impacts have created large geologic features still visible today, such as the Orientale basin on the southern far side visualized in bright red on my map.","PeriodicalId":39760,"journal":{"name":"Journal of the Brazilian Computer Society","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44823351","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Review of Green Infrastructure: Map and Plan the Natural World with GIS","authors":"Yanning Wei","doi":"10.14714/cp94.1603","DOIUrl":"https://doi.org/10.14714/cp94.1603","url":null,"abstract":"","PeriodicalId":39760,"journal":{"name":"Journal of the Brazilian Computer Society","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45294153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Designing an Experience: Maps and Signs at the Archaeological Site of Ancient Troy","authors":"Chelsea Nestel","doi":"10.14714/CP94.1504","DOIUrl":"https://doi.org/10.14714/CP94.1504","url":null,"abstract":"Title word 'Designing' is represented by a crossed out De and an italicized sign. \u0000Includes Maps, Figures, Tables, Appendices and Bibliography.","PeriodicalId":39760,"journal":{"name":"Journal of the Brazilian Computer Society","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45440945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}