{"version":"1.0","type":"link","title":"Byte-pair encoding - Newikis","description":"In computing, byte-pair encoding (BPE), or digram coding, is an algorithm, first described in 1994 by Philip Gage, for encoding strings of text into smaller strings by creating and using a translation table. A slightly modified version of the algorithm is used in large language model tokenizers.","provider_name":"Newikis","provider_url":"https://newikis.com","cache_age":86400}