Digital Module 40: Introduction to Machine Learning and Generative AI: From AutoGluon to Amazon Bedrock

Abstract

Machine learning (ML) and generative artificial intelligence (AI) are rapidly transforming the field of educational measurement. This module focuses on illustrating the process of (1) automated machine learning (AutoML) using AutoGluon via an application of detecting aberrant test behavior and (2) AI-based item generation using Amazon Bedrock. To support these demonstrations, two tools are used: AutoGluon, an open-source automated machine learning (AutoML) system, and Amazon Bedrock, a fully managed AWS service for accessing foundation models from leading AI providers. By the end of this module, participants will (1) understand the key concepts and fundamentals underlying these two applications and (2) be able to programmatically train a classification ML model via AutoML using the provided data, as well as conduct AI-based item generation via the LLMs.