Skip to content

fix(bpe): apply end_of_word_suffix to single-character words - #2484

Merged
SBrandeis merged 1 commit into
huggingface:mainfrom
MohammadHijjawi97:fix-bpe-single-char-end-of-word-suffix
Nov 19, 2026
Merged

SBrandeis merged 1 commit into
huggingface:mainfrom
MohammadHijjawi97:fix-bpe-single-char-end-of-word-suffix