feat(container): update image ghcr.io/berriai/litellm-database ( v1.106.7 → v1.109.1 ) - #1826

• Added per-deployment workload identity on non-chat routes, realtime and the moderation guardrail (#​39966)
• Added the 12-hour cache write rate for gpt-5.6-cyber (#​48246)
• Added OpenAI gpt-6.1-terra with pricing (#​48429)
• Added Batch and Ultrafast 12-hour cache write rates for OpenAI models (#​48433)
• Added gpt-6-rosalind to the model cost map with its published prices (#​49268)
• Added gpt-6-astra-law with pricing from the OpenAI pricing page (#​49444)
• Fixed 400 errors and $0 spend logs on gpt-transcribe calls without response_format (#​44021)
• Fixed nonstreaming aiohttp_openai responses dropping service_tier (#​47263)
• Fixed prompt_cache_retention such as 24h being silently dropped instead of sent upstream (#​47480)
• Fixed /health marking OpenAI and Azure audio chat models unhealthy (#​47730)
• Fixed OpenAI context_length_exceeded errors raising BadRequestError instead of ContextWindowExceededError (#​47954)
• Fixed 12-hour prompt cache writes on openai/gpt-5.6 and newer billing at the 30-minute rate (#​48088)
• Fixed uncatalogued ChatGPT models hitting an unsupported Chat Completions endpoint (#​48244)
• Fixed the whole reasoning_effort dict not being sent when chat is bridged to Responses (#​48807)
• Fixed 400 invalid_beta on Agents API calls through the OpenAI passthrough (#​49009)
• Fixed empty e.response.text on OpenAI and Azure errors so the upstream error body is readable (#​49079)
• Changed OpenAI 401 and 404 invalid_request_error to raise matching exceptions, not BadRequestError (#​32537)
• Changed the ChatGPT session id to derive from prompt_cache_key for stable cache affinity (#​42014)
• Changed gpt-6-luna Decisions cache rates to the standard cached and write rates (#​48066)

• Added Entra ID auth, including keyless auth, for Azure Decisions on /v1/decisions and /v1/systemone (#​46539, #​48529)
• Added access to Foundry agents through the project Responses API for azure_ai/agents/<name> (#​47717)
• Added azure_ai/MAI-Code-1.1-Flash (#​47779)
• Added max_input_tokens of 32768 for azure_ai/Microsoft-Decision-1 (#​48434)
• Added outputContentFormat=markdown support on /ocr for Azure Document Intelligence (#​48926)
• Fixed Foundry chat requests losing OpenAI prompt cache breakpoints (#​45299)
• Fixed /v1/responses 404 on dated api_version deployments and azure_ai Grok reasoning token billing (#​46377)
• Fixed under-billed Grok reasoning tokens on azure_ai when the deployment name lacks "grok" (#​46969)
• Fixed Azure realtime over WebRTC failing with a 404 on client_secrets and an invalid token on the SDP exchange (#​47316)
• Fixed 400 from Foundry when tool results contain tool_reference parts on chat (#​48032)
• Fixed 400 on azure_ai/claude-* when using thinking.block_binding (#​48033)
• Fixed Responses API calls that use an explicit v1 Azure base URL (#​48118)
• Fixed 404 on Azure vector store retrieve, update and delete (#​48224)
• Fixed null audio capability metadata on two Azure audio snapshot models (#​48475)
• Fixed Azure context_length_exceeded raising BadRequestError so context_window_fallbacks never ran (#​48616)
• Fixed batch calls on unversioned azure/ o3, o4-mini, o3-mini, gpt-4o and gpt-4o-mini billing at the standard rate (#​49182)
• Changed max_input_tokens to 128000 for gpt-chat-latest on Azure (#​48252)
• Improved Entra auth by reusing credentials and tokens across requests and refreshing them off the event loop (#​46421, #​47348, #​48769)

• Fixed a fake [System: ...] message being added to tool-call-only assistant turns sent to Anthropic (#​34822)
• Fixed PDFs sent as chat image_url being rejected with 400 by sending them as document blocks (#​46984)
• Fixed Claude json_schema answers losing keys listed only in required and escaping non-ASCII characters (#​47478)
• Fixed replayed redacted_thinking blocks being dropped, and Bedrock Converse 400s when sent twice (#​47489)
• Fixed clear_tool_uses input_tokens trigger ignoring the system prompt, which delayed clearing (#​47857)
• Fixed native Anthropic responses omitting a null stop_sequence (#​47987)
• Fixed streamed responses leaving native web search fees out of the reconstructed usage cost (#​48528)
• Fixed drop_params not dropping speed on claude-opus-4-7, which Anthropic rejects with 400 (#​48764)
• Fixed 400 from beta-gated body fields when drop_params: true, including Claude Code and Codex traffic (#​48793)
• Fixed model_context_window_exceeded being reported as stop instead of length (#​48874)
• Fixed 400 on /v1/messages with many strict tools under drop_params by retrying without strict (#​49102)
• Fixed Claude pause_turn reported as finished and refusal explanations dropped on chat and Responses (#​49192)
• Fixed 500 on a non-string role or tool call id, now a 400 that names the field (#​49237)
• Fixed metadata.user_id being dropped on Anthropic /v1/messages pass-through routes (#​49333)
• Changed the default max_tokens for unmapped Anthropic models from 4096 to 128000 (#​48502)
• Changed the opening prompt usage estimate in the Chat Completions adapter to be off by default (#​48633)

• Added context and output token limits for the Nova Sonic models (#​48247)
• Added pricing for native guardrailConfig trace usage to spend and x-litellm-response-cost (#​48278)
• Added global.openai.gpt-6.1-terra and us.openai.gpt-6.1-terra Bedrock models with pricing (#​48441)
• Added token counting for three Mantle-native Bedrock Claude models (#​48682)
• Added published Priority, Batch and Flex prices to 46 Bedrock regional rows (#​49113)
• Fixed Bedrock Voxtral transcription returning 400, logging $0 spend and ignoring language (#​41565)
• Fixed Unknown provider=None 404 for Bedrock models missing from the cost map (#​43290)
• Fixed 400 errors on Bedrock Kimi K3 Converse calls with max_tokens below 16 (#​43875)
• Fixed 400 invalid beta flag on Claude Code auto mode requests that carry no safeguards (#​44471)
• Fixed a malformed Bedrock batch JSONL line failing the upload with a 500 instead of a 400 (#​45992)
• Fixed post_call guardrails not scanning Claude output on invoke-with-response-stream passthrough (#​46524)
• Fixed Claude json_schema streams dropping reasoning and thinking blocks and ending on tool_calls with no tool calls (#​46863)
• Fixed JSON schema requests failing on Fable 5 and Sonnet 4.6 and losing adaptive thinking on Haiku 5.5 (#​46870)
• Fixed bedrock_request_metadata_fields being ignored on the /bedrock pass-through routes (#​47040)
• Fixed Bedrock Opus 4.8 and Sonnet 5 dropping reasoning on json_schema requests by trying native output first (#​47100)
• Fixed Bedrock batch jobs ignoring a configured control-plane endpoint (#​47260)
• Fixed AWS region lookups through Vault blocking the event loop and stalling other requests on the worker (#​47331)
• Fixed $0 spend and ModelNotMappedError for bedrock/claude_platform/<id> calls (#​48150)
• Fixed max_input_tokens to 922000 on Bedrock GPT models and added Mantle token counting for claude-opus-5-5 (#​48479)
• Fixed Bedrock rejecting strict tool schemas by retrying without strict under drop_params (#​48733)
• Fixed 400 on Bedrock when Codex repeats its tool list across turns (#​49006)
• Fixed region-prefixed Bedrock embedding models not routing to their region or billing its price (#​49072)
• Fixed bedrock_mantle/openai.gpt-5.6-cyber token limits and endpoints to match its model card (#​49350)
• Fixed max_output_tokens for Bedrock GovCloud West Llama 3 models, now 8192 (#​49543)
• Changed converse-stream pass-through to stream frames through post_call guardrails instead of buffering the reply (#​46307)
• Changed /bedrock pass-through routes to apply a model's guardrailConfig, returning 400 if Bedrock cannot use it (#​47429)
• Changed Bedrock pass-through to use request metadata as the session id, fixing 400s with missing_session_id: reject (#​49193)
• Changed Bedrock Invoke and Mantle Claude to use the model's own default max_tokens (#​49724)

• Added Gemini 3.1 Flash TTS support, including multi-speaker voices and mp3, opus, alaw and mulaw output (#​31915)
• Added a setting to drop chosen anthropic-beta values on the Vertex AI pass-through routes (#​47185)
• Added LITELLM_GEMINI_DEFAULT_MAX_OUTPUT_TOKENS to set the output limit for requests that set none (#​47542)
• Added thought_signature_in_tool_call_id to keep Gemini tool call ids short for clients that cap them (#​47692)
• Added a 2026-06-30 deprecation date to vertex_ai/veo-2.0-generate-001 (#​47847)
• Added Batch rates for two Llama 4 MaaS models so Vertex batch jobs no longer bill at on-demand rates (#​48085)
• Added Vertex batch prices above 200k tokens and image output prices for Gemini models (#​48945)
• Fixed the Gemini 3 sampling deprecation warning logging on every request, now once per model per worker (#​40868)
• Fixed vertex_ai/* keys not listing partner, Veo and embedding models and dropping publisher prefixes (#​41959)
• Fixed Gemini TTS /v1/audio/speech calling Google twice and logging 0 tokens in spend (#​44551)
• Fixed 400 from compaction, thinking display and tool change betas on Claude via Vertex AI and Azure AI (#​44747)
• Fixed context caching on Vertex AI failing when a custom api_base is set (#​44783)
• Fixed streamed Vertex AI pass-through calls missing the regional 10% uplift and custom deployment prices (#​44795)
• Fixed Gemini not receiving integer enum values in tool parameters (#​44908)
• Fixed Vertex Claude batches returning 404 at create (#​45715)
• Fixed cache-marked requests listing all cachedContents on every call and creating duplicate caches (#​46857)
• Fixed Vertex AI rate limit errors returned as 403 when the error text contains 403 (#​47134)
• Fixed Gemini audio input and cached audio billed at the Standard rate on flex, priority and batch tiers (#​48086)
• Fixed gemini-2.5-flash-native-audio video input billed at the text rate instead of the audio/video rate (#​48248)
• Fixed Gemini 2.5 rejecting tool results with images and the history replay that follows (#​48428)
• Fixed Vertex AI shared credential cache growing without bound across credential and project pairs (#​48442)
• Fixed Vertex AI image sizes outside the old lookup table silently producing square output (#​48463)
• Fixed slow Google credential requests blocking the proxy worker on Claude /v1/messages (#​48523)
• Fixed explicit Gemini and Vertex embedding timeouts silently becoming 300 seconds (#​48690)
• Fixed Gemini grounding keeping only the first web source for a passage (#​48745)
• Fixed labels on vertex_ai/claude-* returning 400 by sending them as X-Vertex-AI-Labels (#​48753)
• Fixed 400 on countTokens and generateContent when repeated fields are a single object or null (#​48771)
• Fixed Vertex Claude /v1/messages returning 400 when the SDK sends anthropic-version as a header (#​48814)
• Fixed Claude web search billing per request on Vertex AI deployments priced in model_info (#​49160)
• Fixed batch image output billed at the Standard rate on gemini-nano-banana-2.1 and gemini-3.1-flash-lite-image (#​49317, #​49358)
• Changed Gemini 3.6 Flash, 3.5 Flash-Lite and newer to refuse temperature, top_p and top_k without drop_params (#​47645)
• Improved rerank latency by reusing cached Google credentials on every request (#​48430)
• Improved failure logs for Gemini and Vertex pass-through calls by adding the URL model and declared provider (#​49075)
• Removed the floor deprecation_date from gemini-3.1-flash-lite-image (#​48587)

• Added 11 new providers: ai&, BigModel, CLF AI Gateway, Hostinger Router, Kyma API, Nace, OpenCode Go, OpenInfer, Refuseless, StreamLake and ZeroGPU (#​38958, #​39324, #​41006, #​41034, #​43874, #​44863, #​46523, #​48140, #​48497, #​48563, #​48756)
• Added models, endpoints and options for smaller providers (31 PRs) (#​41021, #​41522, #​46156, #​46875, #​47401, #​47473, #​47610, #​47690, #​47785, #​47812, #​48158, #​48251, #​48335, #​48448, #​48450, #​48453, #​48498, #​48621, #​48651, #​48676, #​48677, #​48735, #​48871, #​48998, #​49252, #​49280, #​49281, #​49282, #​49287, #​49297, #​49542)
• Fixed issues and updated behavior on smaller providers (41 PRs) (#​38736, #​40152, #​43390, #​44723, #​45092, #​45567, #​46091, #​46861, #​46945, #​46959, #​47091, #​47423, #​47424, #​47432, #​47495, #​47784, #​47794, #​48121, #​48254, #​48265, #​48268, #​48270, #​48455, #​48522, #​48527, #​48668, #​48684, #​48706, #​48707, #​48778, #​48820, #​48837, #​49068, #​49158, #​49278, #​49344, #​49458, #​49462, #​49498, #​49502, #​49616)

• Fixed streams with logprobs ending in a 500 error frame before the finish chunk (#​33549)
• Fixed 500 errors when a prompt template omits initial_prompt_value or final_prompt_value (#​39762)
• Fixed rebuilt streamed text completions returning null finish_reason and zero prompt_tokens (#​44349)
• Fixed Foundry deployments and Claude fallbacks getting the wrong cache options, which caused 400s (#​45295)
• Fixed non-streaming chat dropping upstream response headers on bedrock_mantle/ and other OpenAI-like providers (#​46928)
• Fixed chat streams failing with a proxy error when progress chunks have no choice index (#​46947)
• Fixed the overhead header under-reporting on chat requests when guardrails add litellm_metadata (#​47790)
• Fixed streamed chunks containing [DONE] being read as end of stream and dropped (#​47832)
• Fixed completions streams including usage when it was not requested (#​48052)
• Fixed an upstream abort on streamed chat completions returning a clean HTTP 200 instead of a server error (#​48328)
• Fixed unbalanced think tags in merged streams and SSE lines splitting on characters other than CR/LF (#​48755)
• Fixed 400 on system-first models like Qwen3.5 when a later developer message appears (#​48897)
• Fixed streamed chat completions with n>1 rebuilding each choice (#​49002)
• Fixed streaming clients missing tool execution when OpenAI-compatible providers end tool calls with stop (#​49388)
• Changed the include_usage stream chunk to send an empty choices array like OpenAI (#​47109)
• Changed stalled stream reads to raise a 408 litellm.Timeout on chat, messages and responses (#​47198)
• Changed streams that end without a finish reason to fail as errors instead of reporting a normal completion (#​47665)

• Added max_agentic_loops support to raise the streamed MCP auto-execute round cap above 5 (#​47688)
• Added resuming background response streams with stream and starting_after on retrieve (#​48819)
• Added Codex client tool_search support on Anthropic and other bridged providers, cutting input tokens (#​48972)
• Fixed Responses API logging tasks being dropped by garbage collection and cut off at shutdown (#​31074)
• Fixed non-stream MCP auto-execute on /v1/responses logging and billing only one of its two model calls (#​43667)
• Fixed 400 from malformed prompt_cache_breakpoint on /v1/responses with drop_params: true (#​45330)
• Fixed later turns on an open Responses WebSocket skipping deployment checks and not counting toward budgets (#​45727)
• Fixed streamed /v1/responses events showing the backend deployment name in nested response.model (#​46662)
• Fixed /v1/responses on Claude dropping returned and replayed compaction items (#​46754)
• Fixed Responses WebSocket running pre_call guardrails on turn one only and rebilling that cost every turn (#​47013)
• Fixed OpenAI pass-through GET /responses/{id} being billed again on every call (#​47171)
• Fixed background spend not counting toward the key's project or per-model budgets (#​47504)
• Fixed the billed cost of background responses not reaching key and team loggers (#​47506)
• Fixed failed Responses streams billing 0 tokens and bridged /v1/messages stream failures not being reported (#​47537)
• Fixed clear_tool_uses_20250919 being silently dropped for openai/ models on the Responses API (#​47861)
• Fixed per-call input_cost_per_token and output_cost_per_token being ignored by responses() (#​48119)
• Fixed 500 when replaying web_search_call input items that have no action (#​48417)
• Fixed audio, PDF and image tool results and history media being dropped in Responses and Gemini conversions (#​48484)
• Fixed retries from previous_response_id returning 400 on Bedrock after a failed turn (#​48647)
• Fixed Responses params the chat bridge cannot translate causing 400s like max_tool_calls on Bedrock Claude (#​48655)
• Fixed typed streaming text access breaking on /v1/responses when logprobs is omitted (#​48686)
• Fixed moderation on /v1/responses being dropped before the OpenAI call (#​48708)
• Fixed later citation batches and pending citations being dropped when streaming Responses (#​48747)
• Fixed replayed Responses output items being rejected by OpenAI because of a null created_by (#​48783)
• Fixed an empty function_call_output reaching models as serialized JSON instead of an empty tool result (#​48845)
• Fixed Responses compaction by dropping params it rejects and sending Azure compaction to the v1 route (#​48876)
• Fixed Responses item order, phase and boundaries not being replayed on the next chat turn (#​48912)
• Fixed bridged Responses requests losing the requested text verbosity when sent to chat completions (#​49049)
• Fixed deployment itpm and otpm limits not being checked or counted on later Responses WebSocket turns (#​49069)
• Fixed litellm.responses() through litellm_proxy/ leaving e.body, e.code and e.type empty on errors (#​49073)
• Fixed dict reasoning_effort losing mode and context on Azure, ChatGPT, Perplexity, xAI, Fireworks and Copilot (#​49082)
• Fixed repeated Codex tools being merged for all callers, now only merged when drop_params is on (#​49112)
• Fixed native /v1/responses WebSocket turns not counting toward key and tag tpm_limit (#​49257)
• Changed a lone Responses built-in tool on Claude to return 400 before token counting (#​48798)

• Fixed web-search-only requests coming back without native search blocks on streamed replies (#​40967)
• Fixed retried /v1/messages attempts mixing up usage and spend logs, and exhausted retries billing only the last (#​45194)
• Fixed safeguard_results and stop_details missing from streamed /v1/messages message_delta events (#​46096)
• Fixed the clear_tool_uses polyfill ignoring clear_at_least, exclude_tools and clear_tool_inputs (#​47123)
• Fixed /v1/messages PDF documents being sent to Azure OpenAI models as images instead of file parts (#​47166)
• Fixed 500 on /v1/messages and count_tokens for null or numeric tool_result text, now a 400 (#​47347)
• Fixed 400 Tool reference not found for tool names over 64 chars when a guardrail rewrites /v1/messages (#​47434)
• Fixed canceled /v1/messages streams not closing the upstream request (#​48220)
• Fixed stop_sequences being ignored for OpenAI models on /v1/messages (#​48534)
• Fixed the client's anthropic-beta replacing the deployment's on /v1/messages (#​48594)
• Fixed /v1/messages streams reporting zero input_tokens in message_start when bridged to Chat Completions (#​48618)
• Fixed Anthropic-format tool_choice crashing input token counting and causing false budget refusals (#​48624)
• Fixed 400 on /v1/messages caused by a non-spec custom object in tool definitions (#​48893)
• Fixed Mistral thinking text being lost on streaming /v1/messages (#​49059)

• Added Soniox realtime speech-to-text on /v1/realtime with stt-rt-v5 (#​44822)
• Fixed Gemini Live ignoring session.update instructions and tools, and answering text clients with audio (#​39864)
• Fixed /health reporting OpenAI realtime deployments with a missing or invalid key as healthy (#​41233)
• Fixed sessions going silent when a transcript guardrail sent turn_detection with no type to OpenAI (#​44939)

• Added a per-request input batch limit on /v1/embeddings to cap how many inputs one call can send (#​44574)
• Fixed video status and content polling failing with per-model keys by keeping model_id in video ids (#​44614)
• Fixed aws_polly/standard, long-form and generative being sent with the neural engine (#​47963)
• Fixed image generation ignoring max_retries and Router retries multiplying upstream attempts (#​48705)
• Fixed async image edits with no image returning HTTP 500 instead of 400 (#​48872)
• Fixed key and team router_settings being ignored on /v1/images/generations (#​49286)
• Changed unsupported transcription providers to return 400 naming the provider and model instead of 500 (#​47971)
• Removed dall-e-2 and dall-e-3 support, and image generation without a model now returns 400 (#​48703)

• Added routing of POST /v1/batches to batch deployments and supported_endpoints on /model_group/info (#​47376)
• Fixed 400 on GET /files/{id}/content with raw gs:// file ids from the unmanaged Vertex batch flow (#​40621)
• Fixed fine-tuning jobs failing with 400 for files uploaded with target_model_names (#​46552)
• Fixed completed batches skipping success callbacks and losing usage under redaction (#​47192)
• Fixed file lists showing every file on the shared key and ignoring limit and after with require_managed_files (#​47682)
• Fixed batch retrieve showing zero prompt and completion tokens (#​47740)
• Fixed unbillable batches blocking file deletes and new-batch polling (#​48752)
• Fixed unmanaged gs:// Vertex batches being costed through the wrong deployment and reading zero spend (#​49301)

• Added OpenSearch k-NN search as a vector store provider (#​47759)
• Fixed /rag/ingest and /rag/query ignoring team provider credentials and denying viewers and team JWTs (#​45497)
• Fixed team key vector store search failing when the team's first model is from a different provider (#​46894)
• Fixed team and key Allowed Vector Stores being ignored on /v1/responses file_search without a registry (#​48915)
• Improved Vertex AI Search vector store searches by reusing HTTP/2 connections and OAuth tokens (#​40631)

• Added one log line per token count call with its id, model and count (#​47657)
• Fixed /v1/messages/count_tokens and /utils/token_counter failing on histories with a compaction block (#​44784)
• Fixed DeepSeek V4 token counts missing Azure's billed tokens by using DeepSeek's own tokenizer (#​47173, #​47353)
• Fixed count_tokens overcounting PDFs about 12x for OpenAI and Azure models (#​47554)
• Fixed token counts retrying a failed HuggingFace tokenizer download and adding about 23s per request (#​47586)
• Fixed HTTP 500 when counting tokens for Anthropic search results and unsupported blocks (#​48699)
• Fixed token counts for OpenAI models newer than the tiktoken table by using o200k_base (#​48728)
• Fixed a loaded Hugging Face tokenizer being hidden when a later download fails ([#

[!IMPORTANT]
✂ PR body was truncated to here.