Skip to content

feat(vllm): support generation-prefix cuts with multiple HTTP frontends - #5261

Open
macandro96 wants to merge 1 commit into
mainfrom
amahishi/multi-frontend-prefix-cuts
Open

macandro96 wants to merge 1 commit into
mainfrom
amahishi/multi-frontend-prefix-cuts