Using a word like limón on the prompt makes llama.cpp crash

[FiveTechSoft]

If you use any word like limón or similar, llama.cpp crashes

is this a bug ? How to solve it ?

many thanks

[mkesper]

I think you need to provide more information about your setup and starting parameters.

Cannot confirm:

User: What's a limón?

Bot: A limón (also known as a lime) is a small citrus fruit that has a bright yellow skin and juicy white flesh. It's often used for its tangy flavor in cooking, baking, and drinks like margaritas. Would you like more information on limons or anything else?

With mistralai_mistral-7b-instruct-v0.1 on GNU/Linux.

[FiveTechSoft]

Where to download mistralai_mistral-7b-instruct-v0.1 from ? Is it a GGUF file ?

We have tested it with phi-2_Q4_K_M.gguf, also with Orca gguf. Both crashes when using "limón"

many thanks

[mkesper]

Indeed it's a GGUF from https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF I run it like this:
./server -c 4096 --mlock --model mistral-7b-instruct-v0.1.Q4_K_M.gguf

[FiveTechSoft]

Dear Michael,

You are right, that one does not crash.

Using phi-2_Q4_K_M.gguf it crashes, also with orca-2-7b.Q2_K.gguf

many thanks

[LoganDark]

Are you sure that this is an issue with llama.cpp? Where does it crash - during tokenization or during inferencing? What UI are you using? UTF-8 issues are very widespread (especially when decoding the model's output), so it's entirely likely that it's not actually llama.cpp's fault.

[Ar57m]

I have phi2 3km and phi1.5 6k, both works fine with the word limón

[Ar57m]

#4618 maybe it's related

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.