Skip to content

Conversation

@jenshu
Copy link
Contributor

@jenshu jenshu commented Sep 26, 2025

Description

Add deprecation notices in API and log deprecation messages for the following:

  • envoy-based AI gateway
  • envoy-based inference extension
  • inference extension auto-provisioning

Fixes #12372
Fixes #10878

Change Type

/kind deprecation

Changelog

Deprecated Envoy-based AI Gateway, Envoy-based Inference Extension, and Inference Extension auto-provisioning.

Additional Notes

Signed-off-by: Jenny Shu <[email protected]>
Stats *HelmStatsConfig `json:"stats,omitempty"`

// AI extension values
// TODO: envoy-based AI gateway is deprecated in v2.1. We can remove this in v2.2.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe rephrase "we can"? "we will"? "this will be removed"?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah i thought this api was still internal, looks like it's exported now so i'll change it to a more user-facing comment

Signed-off-by: Jenny Shu <[email protected]>
# -- Configure the integration with the Gateway API Inference Extension project, which lets you use kgateway to route to AI inference workloads like LLMs that run locally in your Kubernetes cluster. Documentation for Inference Extension can be found here: https://kgateway.dev/docs/integrations/inference-extension/
inferenceExtension:
# -- Enable Inference Extension.
# -- Enable Inference Extension. If enabled, agentgateway.enabled should also be set to true. Enabling inference extension without agentgateway is deprecated in v2.1 and will not be supported in v2.2.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the future, is this something we can enforce with a schema definition for the values?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm maybe, would need to look into it

backendIr := pCtx.Backend.ObjIr.(*BackendIr)
switch backend.Spec.Type {
case v1alpha1.BackendTypeAI:

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: remove newline.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 can add into my next PR

@jenshu jenshu enabled auto-merge September 26, 2025 21:28
@jenshu jenshu added this pull request to the merge queue Sep 26, 2025
Merged via the queue into kgateway-dev:main with commit 6d73107 Sep 26, 2025
27 checks passed
@jenshu jenshu deleted the deprecate-envoy-ai-gw branch September 26, 2025 23:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Deprecation Notices for Envoy-based AI Gateway and Inference Extension Deployer: Evaluate Inference Extension Support

4 participants