{"title":"Do you MIND? Reflections on the MIND dataset for research on diversity in news recommendations","authors":"Sanne Vrijenhoek","doi":"10.48550/arXiv.2304.08253","DOIUrl":"https://doi.org/10.48550/arXiv.2304.08253","url":null,"abstract":"The MIND dataset is at the moment of writing the most extensive dataset available for the research and development of news recommender systems. This work analyzes the suitability of the dataset for research on diverse news recommendations. On the one hand we analyze the effect the different steps in the recommendation pipeline have on the distribution of article categories, and on the other hand we check whether the supplied data would be sufficient for more sophisticated diversity analysis. We conclude that while MIND is a great step forward, there is still a lot of room for improvement.","PeriodicalId":165601,"journal":{"name":"International Workshop on Algorithmic Bias in Search and Recommendation","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114738047","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Addressing Biases in the Texts using an End-to-End Pipeline Approach","authors":"S. Raza, S. Bashir, Sneha, Urooj Qamar","doi":"10.48550/arXiv.2303.07024","DOIUrl":"https://doi.org/10.48550/arXiv.2303.07024","url":null,"abstract":"The concept of fairness is gaining popularity in academia and industry. Social media is especially vulnerable to media biases and toxic language and comments. We propose a fair ML pipeline that takes a text as input and determines whether it contains biases and toxic content. Then, based on pre-trained word embeddings, it suggests a set of new words by substituting the bi-ased words, the idea is to lessen the effects of those biases by replacing them with alternative words. We compare our approach to existing fairness models to determine its effectiveness. The results show that our proposed pipeline can de-tect, identify, and mitigate biases in social media data","PeriodicalId":165601,"journal":{"name":"International Workshop on Algorithmic Bias in Search and Recommendation","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127020872","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Study on Accuracy, Miscalibration, and Popularity Bias in Recommendations","authors":"Dominik Kowald, Gregory Mayr, M. Schedl, E. Lex","doi":"10.48550/arXiv.2303.00400","DOIUrl":"https://doi.org/10.48550/arXiv.2303.00400","url":null,"abstract":"Recent research has suggested different metrics to measure the inconsistency of recommendation performance, including the accuracy difference between user groups, miscalibration, and popularity lift. However, a study that relates miscalibration and popularity lift to recommendation accuracy across different user groups is still missing. Additionally, it is unclear if particular genres contribute to the emergence of inconsistency in recommendation performance across user groups. In this paper, we present an analysis of these three aspects of five well-known recommendation algorithms for user groups that differ in their preference for popular content. Additionally, we study how different genres affect the inconsistency of recommendation performance, and how this is aligned with the popularity of the genres. Using data from LastFm, MovieLens, and MyAnimeList, we present two key findings. First, we find that users with little interest in popular content receive the worst recommendation accuracy, and that this is aligned with miscalibration and popularity lift. Second, our experiments show that particular genres contribute to a different extent to the inconsistency of recommendation performance, especially in terms of miscalibration in the case of the MyAnimeList dataset.","PeriodicalId":165601,"journal":{"name":"International Workshop on Algorithmic Bias in Search and Recommendation","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131564632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Popularity Bias in Collaborative Filtering-Based Multimedia Recommender Systems","authors":"Dominik Kowald, Emanuel Lacić","doi":"10.48550/arXiv.2203.00376","DOIUrl":"https://doi.org/10.48550/arXiv.2203.00376","url":null,"abstract":"Multimedia recommender systems suggest media items, e.g., songs, (digital) books and movies, to users by utilizing concepts of traditional recommender systems such as collaborative filtering. In this paper, we investigate a potential issue of such collaborative-filtering based multimedia recommender systems, namely popularity bias that leads to the underrepresentation of unpopular items in the recommendation lists. Therefore, we study four multimedia datasets, i.e., LastFm, MovieLens, BookCrossing and MyAnimeList, that we each split into three user groups differing in their inclination to popularity, i.e., LowPop, MedPop and HighPop. Using these user groups, we evaluate four collaborative filtering-based algorithms with respect to popularity bias on the item and the user level. Our findings are three-fold: firstly, we show that users with little interest into popular items tend to have large user profiles and thus, are important data sources for multimedia recommender systems. Secondly, we find that popular items are recommended more frequently than unpopular ones. Thirdly, we find that users with little interest into popular items receive significantly worse recommendations than users with medium or high interest into popularity.","PeriodicalId":165601,"journal":{"name":"International Workshop on Algorithmic Bias in Search and Recommendation","volume":"264 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123260057","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mohammadmehdi Naghiaei, Hossein A. Rahmani, M. Dehghan
{"title":"The Unfairness of Popularity Bias in Book Recommendation","authors":"Mohammadmehdi Naghiaei, Hossein A. Rahmani, M. Dehghan","doi":"10.1007/978-3-031-09316-6_7","DOIUrl":"https://doi.org/10.1007/978-3-031-09316-6_7","url":null,"abstract":"","PeriodicalId":165601,"journal":{"name":"International Workshop on Algorithmic Bias in Search and Recommendation","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121661605","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hossein A. Rahmani, Yashar Deldjoo, Ali Tourani, Mohammadmehdi Naghiaei
{"title":"The Unfairness of Active Users and Popularity Bias in Point-of-Interest Recommendation","authors":"Hossein A. Rahmani, Yashar Deldjoo, Ali Tourani, Mohammadmehdi Naghiaei","doi":"10.1007/978-3-031-09316-6_6","DOIUrl":"https://doi.org/10.1007/978-3-031-09316-6_6","url":null,"abstract":"","PeriodicalId":165601,"journal":{"name":"International Workshop on Algorithmic Bias in Search and Recommendation","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130444640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
G. Nunzio, Alessandro Fabris, Gianmaria Silvello, Gian Antonio Susto
{"title":"Incentives for Item Duplication Under Fair Ranking Policies","authors":"G. Nunzio, Alessandro Fabris, Gianmaria Silvello, Gian Antonio Susto","doi":"10.1007/978-3-030-78818-6_7","DOIUrl":"https://doi.org/10.1007/978-3-030-78818-6_7","url":null,"abstract":"","PeriodicalId":165601,"journal":{"name":"International Workshop on Algorithmic Bias in Search and Recommendation","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126616313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Detecting race and gender bias in visual representation of AI on web search engines","authors":"M. Makhortykh, Aleksandra Urman, R. Ulloa","doi":"10.1007/978-3-030-78818-6_5","DOIUrl":"https://doi.org/10.1007/978-3-030-78818-6_5","url":null,"abstract":"","PeriodicalId":165601,"journal":{"name":"International Workshop on Algorithmic Bias in Search and Recommendation","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127829652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Users' Perception of Search Engine Biases and Satisfaction","authors":"Bin Han, C. Shah, Daniel Saelid","doi":"10.1007/978-3-030-78818-6_3","DOIUrl":"https://doi.org/10.1007/978-3-030-78818-6_3","url":null,"abstract":"","PeriodicalId":165601,"journal":{"name":"International Workshop on Algorithmic Bias in Search and Recommendation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130827034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Mitigating Gender Bias in Machine Learning Data Sets","authors":"Susan Leavy, G. Meaney, Karen Wade, Derek Greene","doi":"10.1007/978-3-030-52485-2_2","DOIUrl":"https://doi.org/10.1007/978-3-030-52485-2_2","url":null,"abstract":"","PeriodicalId":165601,"journal":{"name":"International Workshop on Algorithmic Bias in Search and Recommendation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-04-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132432364","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}