text tokenizer EncodeToTokens repeat

input text："如果此时在位检测传感器的橙色LED灯熄灭"
Encodes input text to a list of EncodedTokens.  offset value repeat

<img width="1249" height="678" alt="Image" src="https://github.com/user-attachments/assets/042c5280-aff0-457c-a29e-ad11ce808391" />