@@ -137,13 +137,13 @@ Each example benchmark config includes an accuracy test that queries the same se
137137 - Total number of samples: ` 8000 ` .
138138- ** Guided decoding:** not used.
139139- ** Sampling parameters:**
140- - Frequency penalty: ` None ` (mathematically equivalent to ` 0.0 ` ) .
141- - Presence penalty: ` None ` (mathematically equivalent to ` 0.0 ` ) .
142- - Temperature: ` None ` (mathematically equivalent to ` 1.0 ` ) .
143- - Top-P: ` None ` (mathematically equivalent to ` 1.0 ` ) .
144- - Top-K: ` None ` (mathematically equivalent to ` 0 ` ) .
145- - Min-P: ` None ` (mathematically equivalent to ` 0.0 ` ) .
146- - Repetition penalty: ` None ` (mathematically equivalent to ` 1.0 ` ) .
140+ - Frequency penalty: None resolves to 0.0 because vLLM applies its neutral fallback; Q3VL’s generation config does not override it .
141+ - Presence penalty: None resolves to 0.0 because vLLM applies its neutral fallback; Q3VL’s generation config does not override it .
142+ - Temperature: None resolves to 0.7 from Q3VL’s generation_config.json .
143+ - Top-P: None resolves to 0.8 from Q3VL’s generation_config.json .
144+ - Top-K: None resolves to 20 from Q3VL’s generation_config.json .
145+ - Min-P: None resolves to 0.0 because Q3VL’s generation config does not define it, so vLLM uses its neutral fallback .
146+ - Repetition penalty: None resolves to 1.0 from Q3VL’s generation_config.json .
147147- ** Constraints:**
148148 - ** Model quality:**
149149 - ** Offline/Server scenario:**
@@ -483,13 +483,13 @@ are allowed. This means that, in:
483483 - Total number of samples: ` 48289 ` .
484484 - Guided decoding is not used.
485485 - Sampling parameters:
486- - Frequency penalty: ` None ` (mathematically equivalent to ` 0.0 ` ) .
487- - Presence penalty: ` None ` (mathematically equivalent to ` 0.0 ` ) .
488- - Temperature: ` None ` (mathematically equivalent to ` 1.0 ` ) .
489- - Top-P: ` None ` (mathematically equivalent to ` 1.0 ` ) .
490- - Top-K: ` None ` (mathematically equivalent to ` 0 ` ) .
491- - Min-P: ` None ` (mathematically equivalent to ` 0.0 ` ) .
492- - Repetition penalty: ` None ` (mathematically equivalent to ` 1.0 ` ) .
486+ - Frequency penalty: None resolves to 0.0 because vLLM applies its neutral fallback; Q3VL’s generation config does not override it .
487+ - Presence penalty: None resolves to 0.0 because vLLM applies its neutral fallback; Q3VL’s generation config does not override it .
488+ - Temperature: None resolves to 0.7 from Q3VL’s generation_config.json .
489+ - Top-P: None resolves to 0.8 from Q3VL’s generation_config.json .
490+ - Top-K: None resolves to 20 from Q3VL’s generation_config.json .
491+ - Min-P: None resolves to 0.0 because Q3VL’s generation config does not define it, so vLLM uses its neutral fallback .
492+ - Repetition penalty: None resolves to 1.0 from Q3VL’s generation_config.json .
493493 - Constraints:
494494 - Model quality:
495495 - Category Hierarchical F1 Score >= ` 0.7824 ` . This is the 99% recovery of
0 commit comments