How much does the tool calling costs to the chat model provider?

[gaurovgiri]

I have been utilizing OpenAI as the chat model provider. Additionally, I have defined some custom functions and tools. When these tools are invoked, what is the associated cost?

[cliandy]

Thanks for the question!

So execution of the tool call does not happen on the side of the LLM provider so there is no cost from the execution, but the response of that is added to the messages that are provided to the LLM so there will be a cost associated with the token usage. Hope this helps!

[rahul-t-bit]

Sorry for adding comment here, but I am unable to create a new discussion. Need help, thank you.