Skip to content

Conversation

@kerthcet
Copy link
Member

@kerthcet kerthcet commented Jan 13, 2025

What this PR does / why we need it

People can configure multi-host inference in Playground.

Which issue(s) this PR fixes

Fixes #61

Special notes for your reviewer

Does this PR introduce a user-facing change?

Support multi-host configuration in Playground

@InftyAI-Agent InftyAI-Agent added needs-triage Indicates an issue or PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. do-not-merge/needs-kind Indicates a PR lacks a label and requires one. labels Jan 13, 2025
@kerthcet kerthcet force-pushed the feat/fungibility branch 3 times, most recently from 5aede46 to 1eb7727 Compare January 16, 2025 09:43
@kerthcet
Copy link
Member Author

/kind feature

@InftyAI-Agent InftyAI-Agent added feature Categorizes issue or PR as related to a new feature. and removed do-not-merge/needs-kind Indicates a PR lacks a label and requires one. labels Jan 16, 2025
@kerthcet
Copy link
Member Author

/lgtm
/approve

@InftyAI-Agent InftyAI-Agent added lgtm Looks good to me, indicates that a PR is ready to be merged. approved Indicates a PR has been approved by an approver from all required OWNERS files. labels Jan 16, 2025
@InftyAI-Agent InftyAI-Agent merged commit de9e535 into InftyAI:main Jan 16, 2025
18 of 19 checks passed
@kerthcet kerthcet changed the title Support multi-host in inference Playground Support multi-host inference with Playground Jan 16, 2025
@kerthcet kerthcet deleted the feat/fungibility branch January 16, 2025 10:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. feature Categorizes issue or PR as related to a new feature. lgtm Looks good to me, indicates that a PR is ready to be merged. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

An an example for multi-host inference with Service

2 participants