Skip to content

fix(tokenizer): import KoreanCleaner so the korean_cleaner text cleaner works - #3915

Open
sohailshk wants to merge 1 commit into
modelscope:mainfrom
sohailshk:fix/korean-cleaner-import
Open

sohailshk wants to merge 1 commit into
modelscope:mainfrom
sohailshk:fix/korean-cleaner-import

Commits

  1. Commits on Nov 16, 2026