Tokenization
Tokenization may refer to:
- Tokenization (lexical analysis) in language processing
- Tokenization in search engine indexing
- Tokenization (data security) in the field of data security
- Word segmentation
- A procedure during the Transformer architecture
See also
- Tokenism of minorities