Skip to content

Commit 81ebebe

Browse files
authored
Update the default resolved value of sampling parameter (#2644)
1 parent d6147c7 commit 81ebebe

1 file changed

Lines changed: 14 additions & 14 deletions

File tree

multimodal/qwen3-vl/README.md

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -137,13 +137,13 @@ Each example benchmark config includes an accuracy test that queries the same se
137137
- Total number of samples: `8000`.
138138
- **Guided decoding:** not used.
139139
- **Sampling parameters:**
140-
- Frequency penalty: `None` (mathematically equivalent to `0.0`).
141-
- Presence penalty: `None` (mathematically equivalent to `0.0`).
142-
- Temperature: `None` (mathematically equivalent to `1.0`).
143-
- Top-P: `None` (mathematically equivalent to `1.0`).
144-
- Top-K: `None` (mathematically equivalent to `0`).
145-
- Min-P: `None` (mathematically equivalent to `0.0`).
146-
- Repetition penalty: `None` (mathematically equivalent to `1.0`).
140+
- Frequency penalty: None resolves to 0.0 because vLLM applies its neutral fallback; Q3VL’s generation config does not override it.
141+
- Presence penalty: None resolves to 0.0 because vLLM applies its neutral fallback; Q3VL’s generation config does not override it.
142+
- Temperature: None resolves to 0.7 from Q3VL’s generation_config.json.
143+
- Top-P: None resolves to 0.8 from Q3VL’s generation_config.json.
144+
- Top-K: None resolves to 20 from Q3VL’s generation_config.json.
145+
- Min-P: None resolves to 0.0 because Q3VL’s generation config does not define it, so vLLM uses its neutral fallback.
146+
- Repetition penalty: None resolves to 1.0 from Q3VL’s generation_config.json.
147147
- **Constraints:**
148148
- **Model quality:**
149149
- **Offline/Server scenario:**
@@ -483,13 +483,13 @@ are allowed. This means that, in:
483483
- Total number of samples: `48289`.
484484
- Guided decoding is not used.
485485
- Sampling parameters:
486-
- Frequency penalty: `None` (mathematically equivalent to `0.0`).
487-
- Presence penalty: `None` (mathematically equivalent to `0.0`).
488-
- Temperature: `None` (mathematically equivalent to `1.0`).
489-
- Top-P: `None` (mathematically equivalent to `1.0`).
490-
- Top-K: `None` (mathematically equivalent to `0`).
491-
- Min-P: `None` (mathematically equivalent to `0.0`).
492-
- Repetition penalty: `None` (mathematically equivalent to `1.0`).
486+
- Frequency penalty: None resolves to 0.0 because vLLM applies its neutral fallback; Q3VL’s generation config does not override it.
487+
- Presence penalty: None resolves to 0.0 because vLLM applies its neutral fallback; Q3VL’s generation config does not override it.
488+
- Temperature: None resolves to 0.7 from Q3VL’s generation_config.json.
489+
- Top-P: None resolves to 0.8 from Q3VL’s generation_config.json.
490+
- Top-K: None resolves to 20 from Q3VL’s generation_config.json.
491+
- Min-P: None resolves to 0.0 because Q3VL’s generation config does not define it, so vLLM uses its neutral fallback.
492+
- Repetition penalty: None resolves to 1.0 from Q3VL’s generation_config.json.
493493
- Constraints:
494494
- Model quality:
495495
- Category Hierarchical F1 Score >= `0.7824`. This is the 99% recovery of

0 commit comments

Comments
 (0)