Validate GGUF special token ids against vocab to prevent OOB panic#2282

EricLBuehler merged 1 commit into

EricLBuehler:masterEricLBuehler/mistral.rs:masterfrom

pjdurden:fix/gguf-tokenizer-oob-2225pjdurden/mistral.rs:fix/gguf-tokenizer-oob-2225Copy head branch name to clipboard