TextRegress: A Python package for advanced regression analysis on long-form text data

Abstract

TextRegress is an open-source Python package that leverages state-of-the-art deep learning techniques to perform regression analysis on long-form text data. Departing from conventional text mining tools that are confined to classification, sentiment, or readability metrics, TextRegress provides a unified framework for conducting predictive modeling of continuous outcomes. By integrating advanced encoding methods – including transformer-based embeddings, TF-IDF, and pre-trained Hugging Face models – with a robust PyTorch Lightning backend, TextRegress efficiently processes long texts through automatic chunking and dynamic feature integration. Its flexible architecture and customizable training paradigms empower researchers and practitioners across diverse domains to deploy sophisticated regression models, fostering reproducibility and accelerating innovation in text analytics.