Tool calling does not work with local model qwen3-30b-a3b

[Danmoreng]

What happened?

I was trying to get qwen code running with a local instance of the small coder model. I can see the model responds with what look like appropriate tool calls to me, but the tool calls seem to not be executed. Unfortunately I don't see any errors, so I don't why they don't work as expected.

If needed, I can provide further logs of the server requests.

What did you expect to happen?

When I ask qwen code to init a git repository and the response from the locally hosted server is:

[format_partial_response_oaicompat] DEBUG: Streaming finish_reason check | tid="7532" timestamp=1754063577 generated_text="<tool_call>\n<function=run_shell_command>\n<parameter=command>\ngit init\n</parameter>\n<parameter=description>\nInitializing a new Git repository in the current directory\n</parameter>\n</function>\n</tool_call>" model_name="qwen3-coder-30b-a3b" tool_calls_count=0

qwen code should recognize the command and execute it.

Client information

Details

$ qwen /about
│ About Qwen Code                                                                                │
│                                                                                                │
│ CLI Version                      0.0.2                                                         │
│ Git Commit                       2786f10 (local modifications)                                 │
│ Model                            qwen3-coder-30b-a3b                                           │
│ Sandbox                          no sandbox                                                    │
│ OS                               win32                                                         │
│ Auth Method                      openai      

Login information

Running against locally hosted server with ik_llama.cpp with these environment variables:

$Env:OPENAI_BASE_URL='http://127.0.0.1:8080/v1'; 
$Env:OPENAI_API_KEY='local'; 
$Env:OPENAI_MODEL='qwen3-coder-30b-a3b'; 

Anything else we need to know?

No response

[Danmoreng]

The issue seems to be that ik_llama.cpp does not support tool calling properly. With LMStudio tool calling works. However, the agent does not work but regularly crashes qwen code:

Details

```console PS E:\Development\TestApp> & { $Env:OPENAI_BASE_URL = 'http://localhost:1234/v1'; ` >> $Env:OPENAI_API_KEY = 'lmstudio'; >> $Env:OPENAI_MODEL = 'qwen/qwen3-coder-30b'; ` >> qwen } ClearcutLogger disabled - no data collection.

██╗ ██████╗ ██╗ ██╗███████╗███╗ ██╗
╚██╗ ██╔═══██╗██║ ██║██╔════╝████╗ ██║
╚██╗ ██║ ██║██║ █╗ ██║█████╗ ██╔██╗ ██║
██╔╝ ██║▄▄ ██║██║███╗██║██╔══╝ ██║╚██╗██║
██╔╝ ╚██████╔╝╚███╔███╔╝███████╗██║ ╚████║
╚═╝ ╚══▀▀═╝ ╚══╝╚══╝ ╚══════╝╚═╝ ╚═══╝

Tips for getting started:

1. Ask questions, edit files, or run commands.
2. Be specific for the best results.
3. Create QWEN.md files to customize your interactions with Qwen Code.
4. /help for more information.

╭────────╮
│ > hi │
╰────────╯

✦ Hello! How can I help you today?

╭─────────────────────────────────────────╮
│ > Please initialize a git repository. │
╰─────────────────────────────────────────╯

✦ I'll help you initialize a git repository in your current directory.

First, let me check if there's already a git repository here:

╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ x run_shell_command {} │
│ │
│ Cannot read properties of undefined (reading 'includes') │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
✦ Let me try a different approach to initialize the git repository.

╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ x run_shell_command {} │
│ │
│ Cannot read properties of undefined (reading 'includes') │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
✦ I apologize for the confusion. Let's try initializing the git repository directly with a shell command:

╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ x run_shell_command {} │
│ │
│ Cannot read properties of undefined (reading 'includes') │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
✦ I apologize for the repeated errors. It seems there's an issue with how I'm trying to execute commands.

Let me try a different approach to initialize your git repository:

╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ x run_shell_command {} │
│ │
│ Cannot read properties of undefined (reading 'includes') │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
✦ I apologize for the repeated issues with executing shell commands. It seems there's a problem with my execution environment.

However, you can manually initialize a git repository in your project directory by running this command in your terminal:

1 git init

This will create a new Git repository in your current directory (E:\Development\TestApp).

After running this command, you'll have a .git folder created in your project directory, which is the foundation of your Git repository.

Would you like me to help with anything else related to setting up your repository?

ℹ Request cancelled.

╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ > Hmmmm...How exactly do you try to do the tool calling? Can you put that inside normal text instead of a tool call so I can debug it? │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

✦ You're absolutely right. Let me explain how I would normally execute the git init command:

To initialize a Git repository, I would run:

1 git init

This command creates a new Git repository in your current directory by creating a .git subdirectory with all necessary files.

In a normal terminal or command prompt, you'd navigate to your project directory (E:\Development\TestApp) and then execute:

1. cd E:\Development\TestApp
2. git init

This would create the Git repository structure needed for version control.

I apologize for the confusion earlier - it seems there's an issue with how I'm trying to execute commands in this environment, but the manual approach should work fine for you.

╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ > Well I would like to know how exactly you trie to execute the tool call in this environment so we can debug together why yur tool call does not work. How do you try to execute the │
│ run_shell_command? I see an error message: Cannot read properties of undefined (reading 'includes'). We are running in Windows Powershell by the way. │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

✦ I apologize for the confusion. You're right, let me explain how I would normally execute a shell command.

In my normal operation, I would use the run_shell_command tool like this:

1 {
2 "command": "git init",
3 "description": "Initialize a new Git repository"
4 }

The error message you're seeing suggests there's an issue with how the tool is being invoked in this specific environment. The error "Cannot read properties of undefined (reading
'includes')" typically indicates that some internal code is trying to access a property on an undefined object, which might be related to how the tool execution is handled in your current
setup.

Since we're working in Windows PowerShell, the command itself should work fine when executed manually:

1. Open PowerShell
2. Navigate to your project directory: cd E:\Development\TestApp
3. Run: git init

If you'd like to debug this further, you could try running a simple command first to see if the tool execution works at all:

1 echo "test"

This would help determine if it's specifically the git command or the tool execution mechanism that's problematic.

Would you like me to try another approach for initializing your repository?

╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ > I would like you to try out if you can execute any other tool calls. Which tool calls do you have available? │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

✦ I apologize for the confusion earlier. Let me try a simple tool call to see what's working in this environment.

Let me try using the list_directory tool to see what files are in your current directory:

⠧ Summoning the cloud of wisdom... (esc to cancel, 39s)

E:\Development\TestApp no sandbox (see /docs) qwen/qwen3-coder-30b (100% context left)| ✖ 1 error (ctrl+o for details)

PS E:\Development\TestApp> & { $Env:OPENAI_BASE_URL = 'http://localhost:1234/v1'; `

  $Env:OPENAI_API_KEY = 'lmstudio';
 $Env:OPENAI_MODEL   = 'qwen/qwen3-coder-30b'; `
 qwen }

ClearcutLogger disabled - no data collection.

██╗ ██████╗ ██╗ ██╗███████╗███╗ ██╗
╚██╗ ██╔═══██╗██║ ██║██╔════╝████╗ ██║
╚██╗ ██║ ██║██║ █╗ ██║█████╗ ██╔██╗ ██║
██╔╝ ██║▄▄ ██║██║███╗██║██╔══╝ ██║╚██╗██║
██╔╝ ╚██████╔╝╚███╔███╔╝███████╗██║ ╚████║
╚═╝ ╚══▀▀═╝ ╚══╝╚══╝ ╚══════╝╚═╝ ╚═══╝

Tips for getting started:

1. Ask questions, edit files, or run commands.
2. Be specific for the best results.
3. Create QWEN.md files to customize your interactions with Qwen Code.
4. /help for more information.

╭──────────────────────────────────────────────────────────────────────────────────────────╮
│ > Hi, can you please test if you find the MD file in this folder and read its content? │
╰──────────────────────────────────────────────────────────────────────────────────────────╯

✦ I'll check if I can find and read the Markdown file in the current directory.

First, let me look for any Markdown files in the current directory:

╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ ✔ FindFiles 'undefined' │
│ │
│ params must have required property 'pattern' │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
✦ I'll search for Markdown files in the current directory using a glob pattern.

╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ ✔ FindFiles 'undefined' │
│ │
│ params must have required property 'pattern' │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
✦ Let me try another approach to find Markdown files.

⠼ Compiling the 1s and 0s... (esc to cancel, 34s)

E:\Development\TestApp no sandbox (see /docs) qwen/qwen3-coder-30b (100% context left)| ✖ 1 error (ctrl+o for details)```

[TheSethRose]

Looks like an issue with LM Studio, if you are using it.
https://x.com/lmstudiodevs/status/1951101732269773021

Just updated to the latest Beta and it fixed it on my side.

[xyang2013]

I am using Ollama and I am having a similar issue:

[Pavankunchala]

@xyang2013 how are you setting up the api for local llm can u share me the .env so i ca n get a better idea

[xyang2013]

I am using Ollama and I am having a similar issue:

I think the cause is that the model provided on Ollama's site does not support tool calling.

[xyang2013]

@xyang2013 how are you setting up the api for local llm can u share me the .env so i ca n get a better idea

You need to use OpenAI API convention.

[toddtail]

Qwen3-Coder missing Tools and FIM support in template

It seems to be caused by Ollama officials

[hoborobott]

https://docs.unsloth.ai/basics/qwen3-coder-how-to-run-locally#run-qwen3-coder-30b-a3b-instruct there is version by unsloth but it does not seem to work well in agent mode .

[chrisgoldberg1]

Looks like an issue with LM Studio, if you are using it. https://x.com/lmstudiodevs/status/1951101732269773021

Just updated to the latest Beta and it fixed it on my side.

Seems not to work for me with latest beta of LM-Studio.

╭───────────────────────╮
│  > give me a summary  │
╰───────────────────────╯

✦ Got it. Thanks for the context!

╭────────────────────────────────────────────╮
│  > tell me what is this application about  │
╰────────────────────────────────────────────╯

✦ Got it. Thanks for the context!

╭─────────────────────────────────╮
│  > what is this project about?  │
╰─────────────────────────────────╯

✦ Got it. Thanks for the context!

[WuShichao]

[TheSethRose]

You may need to update your Jinja template for the model to allow for agent tool usage.
Here's my 𝕏 thread detailing how I got it to work.

[xyang2013]

Intel released a q2 version (10GB in size). But tool calling is not working (similar to the one released by Ollama).

https://x.com/XYang2023/status/1952263365197541431