What Is a Large Language Model and How Does It Work?
How large language models work in plain English, from tokens and training to next-word prediction, with a simple diagram and no math.
A type of machine learning in which an agent learns by trial and error, receiving rewards or penalties for its actions.
In reinforcement learning, an agent interacts with an environment, takes actions, and receives feedback in the form of rewards. Over many attempts, it learns a strategy, called a policy, that maximizes total reward over time. No labeled answers are given; the agent discovers what works.
Famous successes include systems that learned to play Atari video games and DeepMind's AlphaGo, which defeated a top professional Go player in 2016. Reinforcement learning is also used in robotics, recommendation systems, and resource management. A variation called reinforcement learning from human feedback is used to make large language models more helpful and safer, with human ratings guiding the reward. Challenges include designing good reward signals and the large number of trials often needed.
A software system that uses an AI model to plan and carry out multi-step tasks, often by calling tools, APIs, or other programs on its own.
Machine LearningA branch of AI in which computers learn patterns from data to make predictions or decisions without being explicitly programmed for each case.
Reinforcement Learning from Human FeedbackA training method, known as RLHF, that improves an AI model by rewarding responses people rate as more helpful, accurate, or safe.
How large language models work in plain English, from tokens and training to next-word prediction, with a simple diagram and no math.
Reasoning models think before they answer, which makes them slower and pricier. Here is how they work, what they cost and when the extra thinking pays off.
A plain-English guide to reinforcement learning: agents, environments, rewards and policies, with game, robotics and chatbot examples and where it fits in business.