{"title":"Analyzing Online Migration Forums: An Introduction to Natural Language Processing for International Migration Research","authors":"Nari Yoo, Donghun Kim, Sou Hyun Jang, Eric Fong","doi":"10.1177/01979183261473318","DOIUrl":null,"url":null,"abstract":"In contemporary migration studies, online forums are common spaces where people exchange information and seek advice about international migration. This methods note introduces the Reddit community r/IWantOut as a data source for studying migration aspirations and presents a validated natural language processing (NLP) pipeline for analyzing it. The forum's community rules require posters to encode age, gender, origin, and intended destinations in a fixed title format, so users label their own migration aspirations in a semi-machine-readable form when they post. Using 156,313 submissions from 2009 to 2026 (58,892 after cleaning), we demonstrate three analytical approaches: (1) time-series analysis to identify temporal shifts in discourse volume, (2) dictionary- and rule-based extraction, together with Named Entity Recognition (NER), to recover origin–destination pairs and sociodemographic attributes from the structured titles, and (3) large language model (LLM)-based zero-shot classification, used only for classifying migration motivations. Validation against human-coded labels across three LLMs (GPT-4.1, Claude-3.5-Sonnet, and DeepSeek-V3) showed that GPT-4.1 achieved the highest agreement (mean κ = 0.566), with substantial agreement on push factors, moderate agreement on pull and enabling factors, and fair agreement on constraining factors. Applying this approach to 56,242 international migration posts, we found that enabling factors (individual-level resources) appeared most frequently (77.3%), followed by constraining factors (49.3%), pull factors (37.2%), and push factors (23.6%). For each method, we provide practical guidance on implementation, data access, and validation, and reflect on methodological limitations and ethical considerations.","PeriodicalId":48229,"journal":{"name":"International Migration Review","volume":"279 1","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2026-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Migration Review","FirstCategoryId":"90","ListUrlMain":"https://doi.org/10.1177/01979183261473318","RegionNum":1,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DEMOGRAPHY","Score":null,"Total":0}
引用次数: 0
Abstract
In contemporary migration studies, online forums are common spaces where people exchange information and seek advice about international migration. This methods note introduces the Reddit community r/IWantOut as a data source for studying migration aspirations and presents a validated natural language processing (NLP) pipeline for analyzing it. The forum's community rules require posters to encode age, gender, origin, and intended destinations in a fixed title format, so users label their own migration aspirations in a semi-machine-readable form when they post. Using 156,313 submissions from 2009 to 2026 (58,892 after cleaning), we demonstrate three analytical approaches: (1) time-series analysis to identify temporal shifts in discourse volume, (2) dictionary- and rule-based extraction, together with Named Entity Recognition (NER), to recover origin–destination pairs and sociodemographic attributes from the structured titles, and (3) large language model (LLM)-based zero-shot classification, used only for classifying migration motivations. Validation against human-coded labels across three LLMs (GPT-4.1, Claude-3.5-Sonnet, and DeepSeek-V3) showed that GPT-4.1 achieved the highest agreement (mean κ = 0.566), with substantial agreement on push factors, moderate agreement on pull and enabling factors, and fair agreement on constraining factors. Applying this approach to 56,242 international migration posts, we found that enabling factors (individual-level resources) appeared most frequently (77.3%), followed by constraining factors (49.3%), pull factors (37.2%), and push factors (23.6%). For each method, we provide practical guidance on implementation, data access, and validation, and reflect on methodological limitations and ethical considerations.
期刊介绍:
International Migration Review is an interdisciplinary peer-reviewed journal created to encourage and facilitate the study of all aspects of sociodemographic, historical, economic, political, legislative and international migration. It is internationally regarded as the principal journal in the field facilitating study of international migration, ethnic group relations, and refugee movements. Through an interdisciplinary approach and from an international perspective, IMR provides the single most comprehensive forum devoted exclusively to the analysis and review of international population movements.