bug: can't connect to local ollama server

[clicktodev]

Version: 0.6.9

Describe the Bug

I'm having issues connecting to my local ollama server.
all credentials should be right, open webui works flawlessly

also tried /v1/

Steps to Reproduce

1. start ollama
2. set the same values from the screenshot

Screenshots / Logs

Operating System

• MacOS
• Windows
• Linux

[lugnicca]

It doesn't work without the / at the end of the URL too ?

[clicktodev]

Nope

[LazyYuuki]

Hi @clicktodev, we actually have fixed this for 0.6.9, but it seems that the latest version of Ollama did something again, and it is now not compatible, once again...

We will look into this to see what can be done and will update you as we move along.

[clicktodev]

I'm using oLLAMA 0.11.8 btw, can you confirm the same issue when you update?

[LazyYuuki]

Hi @clicktodev, I have updated and confirmed that it is broken
We are looking into it, but it is kinda funny 🤣 we just fixed it and then it is broken immediately again

[clicktodev]

What exactly is Ollama changing to break this. i thought the api was standard across all providers

[LazyYuuki]

@clicktodev we don't know yet, but they are not actually the same across all providers sometime they will include certain headers and authentication step that may or may not be standard, and we have to handle that on the client side.

Because we didn't change anything on our side either as you can see above, and it works with all OpenAI compatible endpoint but just not them, so it is hard to say.

[Carsonthemonkey]

This seems to be due to the fact that Jan sends Origin: null in the http headers when making a request to the Ollama server. This results in Ollama returning 403: Forbidden (You can verify this behaviour by running curl -H "Origin: null" http://127.0.0.1:11434/v1/models -v).

There is a thread discussing this issue here

[datanerdie]

Indeed. I updated the zshrc file by adding OLLAMA_ORIGINS=*, and that resolved the issue.