How Machines Understand Text: How AI Generates and Retrieves Knowledge

From virtual assistants and chatbots to AI search engines and recommendation systems, large language models (LLMs) seem to be ubiquitous in our daily interactions with technology. But how do these systems actually generate responses, answer questions, and retrieve knowledge? Join ASU Library's Unit for Data Science and Analytics for the second session of this foundational mini-series as we explore the ideas behind modern generative AI systems. In this session, we will build on the foundations of natural language processing (NLP) to explore how large language models learn language patterns and generate human-like responses. We will discuss concepts such as embeddings and transformers and examine how probabilities and context help AI systems predict and generate text. We will also introduce retrieval-augmented generation (RAG), a method that combines language models with external sources of information to improve accuracy, provide context, and retrieve knowledge from documents and databases. Join us as we explore how modern AI systems generate language and retrieve information. As a foundational series, this session is designed for a beginner-to-intermediate audience.