[FEATURE] llama.cpp adds vision support

[bi4key]

llama.cpp adds vision support

https://github.com/ggml-org/llama.cpp/blob/master/docs/multimodal.md

[shubham0204]

Sure, vision support from llama.cpp should make its way in SmolChat.
Curious, which app is being used in the screenshot above?

[bi4key]

I try search, grok give me this answer:

https://x.com/i/grok/share/yTh0fAPgUhJqyoMQr8ogGFnIe

Maybe this is compiled server running via browser

[bi4key]

OK I find this thread:

https://twitter.com/ngxson/status/1921086843023401338

And here direct post, and yes this via browser:

https://simonwillison.net/2025/May/10/llama-cpp-vision/

[bi4key]

ggml-org/llama.cpp#12898

https://www.reddit.com/r/LocalLLaMA/s/QpoR8nvq2m

[Dimimalinov999]

are there any llms that are small enough to run on a phone yet have the ability to view images?

[bi4key]

are there any llms that are small enough to run on a phone yet have the ability to view images?

Yes, example this:

App MNN
https://github.com/alibaba/MNN/blob/master/apps%2FAndroid%2FMnnLlmChat%2FREADME.md