CVE-2026-85670

CVE-2026-85670 affects Hugging Face tokenizers (observed in version 0.23.1 ). The vulnerability is an out-of-bounds buffer access in BpeBuilder::build (tokenizers/src/models/bpe/model.rs). When loading a tokenizer.json via Tokenizer::from_file/from_str, the builder sizes a scratch buffer to the l...

CVE-2026-85670 tokenizers BpeBuilder Buffer Overflow via merge token

tokenizers Hugging Face is affected by an out-of-bounds buffer access in BpeBuilder::build tokenizers/src/models/bpe/model.rs. When loading a tokenizer.json via Tokenizer::fromfile/fromstr, the builder sizes a scratch buffer to the longest vocabulary key, then writes each concatenated merge rule...

CVE-2026-85670 tokenizers BpeBuilder Buffer Overflow via merge token

tokenizers Hugging Face is affected by an out-of-bounds buffer access in BpeBuilder::build tokenizers/src/models/bpe/model.rs. When loading a tokenizer.json via Tokenizer::fromfile/fromstr, the builder sizes a scratch buffer to the longest vocabulary key, then writes each concatenated merge rule...