From 4ac71356342eaa8a9e2d3f8f722a20947ddbc671 Mon Sep 17 00:00:00 2001 From: Yuval Luria Date: Mon, 22 Jun 2026 21:36:52 +0300 Subject: [PATCH] Add Phi-3.5-mini-instruct to batch invariance tested models - Validated batch invariance with 5/5 successful trials - Tested on 4x NVIDIA A10G GPUs with tensor parallelism - Model: microsoft/Phi-3.5-mini-instruct (3.8B) - All trials produced deterministic outputs at temperature=0.0 Closes part of #27433 Co-Authored-By: Claude Sonnet 4.5 Signed-off-by: Yuval Luria --- docs/features/batch_invariance.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/features/batch_invariance.md b/docs/features/batch_invariance.md index 37a9a7399908..5a1fe71a1eab 100644 --- a/docs/features/batch_invariance.md +++ b/docs/features/batch_invariance.md @@ -107,6 +107,7 @@ Batch invariance has been tested and verified on the following models: - **Llama 3**: Llama3.1 and 3.2 series, `meta-llama/Llama-3.2-3B-Instruct` for example - **GPT-OSS**: `openai/gpt-oss-20b`, `openai/gpt-oss-120b` - **Mistral**: `mistralai/Mistral-7B-v0.3` +- **Phi series**: `microsoft/Phi-3.5-mini-instruct` Other models may also work, but these have been explicitly validated. If you encounter issues with a specific model, please report them on the [GitHub issue tracker](https://github.com/vllm-project/vllm/issues/new/choose).