Async scheduling is not compatible with prefix caching for Mamba models and will be disabled. #578

Open

opened

VLLM 启动模型时无法使用异步调度

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests