-
-
Notifications
You must be signed in to change notification settings - Fork 44
Closed
Labels
featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.help wantedExtra attention is neededExtra attention is neededneeds-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.
Milestone
Description
What would you like to be added:
TGI is also a popular inference backend that we should support. More importantly, we should set this as an example once people would like to support another backend in the future.
Why is this needed:
Adopte more backends and make this a reference.
Completion requirements:
This enhancement requires the following artifacts:
- Design doc
- API change
- Docs update
The artifacts should be linked in subsequent comments.
Metadata
Metadata
Assignees
Labels
featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.help wantedExtra attention is neededExtra attention is neededneeds-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.