[Bug]: TokenizersBackend fallback returns tokenizer without max_chars_per_token
#11222
Annotations
10 notices
|
add-labels
Processing label: cpu
|
|
add-labels
No matching terms found for label "rocm".
|
|
add-labels
Reason: No matching terms found
|
|
add-labels
Final decision: DO NOT ADD LABEL
|
|
add-labels
Searching in body (8578 characters)
|
|
add-labels
Searching in title: "[Bug]: TokenizersBackend fallback returns tokenizer without `max_chars_per_token`"
|
|
add-labels
Searching with 5 keywords, 12 substrings, and 1 regex patterns
|
|
add-labels
Issue Body length: 8578 characters
|
|
add-labels
Issue Title: "[Bug]: TokenizersBackend fallback returns tokenizer without `max_chars_per_token`"
|
|
add-labels
Processing label: rocm
|