Server: when no slot is available, defer the task instead of returning "slot unavailable"#5018
Merged
ggerganov merged 2 commits intoggml-org:masterfrom Jan 18, 2024
Merged
Commits
Commits on Jan 18, 2024
- committedXuan Son Nguyen
- committedXuan Son Nguyen