Follow-up to https://github.com/kgateway-dev/kgateway/issues/12372 We have deprecated envoy-based inference extension in v2.1 and should remove the associated code in v2.2
