Natural Language Processing, explained
Natural language processing (NLP) covers tasks such as translating between languages, summarizing documents, answering questions, detecting sentiment in reviews, extracting names and dates from text, recognizing speech, and powering chatbots.
Early NLP relied on hand-written grammar rules and statistical methods that counted word patterns. Deep learning, and especially the transformer architecture introduced in 2017, transformed the field, leading to large language models that handle many tasks with a single system. Challenges remain, including ambiguity, sarcasm, cultural context, and support for languages with less available training data, such as many regional languages of South Asia. Everyday NLP shows up in email autocomplete, voice assistants, search engines, and spam filters.