🚀 [firebase_ai] Still lacking thinking features and Context cache explicit and implicit (reporting in metadata)

[yvrez]

Support thinking budget and caching through the firebase AI SDK

These two are critical for apps that must manage user experience &. token budget per user.
Thinking takes time and not always required (or in limited token-budget)

Context-caching (implicit and explicit) can help projects that relies on big context with multiple calls/chains to reduce the cost without sacrifying output-token quality/precision.
No metadata returned that confirms implicit caching is used (like in genai sdk) and no API to use explicit caching with TTL.

Thanks !

[wxctemre]

we really need this If it will be added, when will it be added? We need an answer to this. It is important for our application that it is added as soon as possible

[jacobsimionato]

Plus one - without control over the thinking budget, it is very difficult to use the new Gemini models effectively. This is a core parameter of these new models.

[yvrez]

any update ? Thanks !