[Sidharth Rajmohan (dumko2001)]

Fixes #33995

Allow users to pass additional kwargs (like tool_choice) to with_structured_output() to avoid 400 errors when the model doesn't trigger a tool call. This aligns ChatGroq with ChatOpenAI behavior.

Users can now override the default tool_choice:
llm.with_structured_output(Schema, tool_choice="auto")

Description: Allow users to pass additional keyword arguments (like tool_choice) to with_structured_output() to avoid 400 errors when the model doesn't trigger a tool call. This aligns ChatGroq.with_structured_output() with ChatOpenAI.with_structured_output() behavior by removing the kwargs restriction and passing them through to bind_tools() and bind() methods.

Issue: Fixes #33995

Dependencies: None

[codspeed]

CodSpeed Performance Report

Merging #34053 will not alter performance

_{Comparing dumko2001:fix/groq-with-structured-output-kwargs (d803891) with master (8ad0e9f)}

Summary

✅ 1 untouched
⏩ 33 skipped¹

Footnotes

1. 33 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

[ccurme (ccurme)]

I'm not sure this will fix the issue as we are already specifying tool_choice=tool_name.