FinTech

What is Tokenization?

Quick answer

Replacing sensitive data with non-sensitive substitutes called tokens, or breaking text into tokens that AI models can process.

Tokenization, explained

In payments and security, tokenization swaps a sensitive value, such as a card number, for a random token that is useless if stolen. The real data is stored in a secure vault, and only authorized systems can map the token back. Mobile wallets use tokenization so merchants never see your actual card number.

In AI, tokenization means splitting text into units called tokens, which may be whole words, parts of words, or characters, before a language model processes them. Model limits and pricing are often measured in tokens. In blockchain, tokenization refers to representing real-world assets, such as property or bonds, as digital tokens on a blockchain. The meaning depends heavily on context.

Related terms

Guides that mention Tokenization