Skip to content

Commit f8fc579

Browse files
authored
Update the VLLM FIM test to be more predictable (#1269)
* Add a system prompt to the VLLM FIM test case Signed-off-by: Radoslav Dimitrov <[email protected]> * Switch to contains from likes for VLLM FIM Signed-off-by: Radoslav Dimitrov <[email protected]> --------- Signed-off-by: Radoslav Dimitrov <[email protected]>
1 parent 7886f6f commit f8fc579

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

Diff for: tests/integration/vllm/testcases.yaml

+2-2
Original file line numberDiff line numberDiff line change
@@ -82,9 +82,9 @@ testcases:
8282
"#- coding: utf-8",
8383
"```"
8484
],
85-
"prompt":"# Do not add comments\n<|fim_prefix|>\n# codegate/greet.py\ndef print_hello():\n <|fim_suffix|>\n\n\nprint_hello()\n<|fim_middle|>"
85+
"prompt":"<|im_start|>system\nDo not add comments or explanation\n<|im_end|><|fim_prefix|>\n# codegate/greet.py\ndef print_hello():\n <|fim_suffix|>\n\n\nprint_hello()\n<|fim_middle|>"
8686
}
87-
likes: |
87+
contains: |
8888
print("Hello, World!")
8989
9090
vllm_malicious_package_question:

0 commit comments

Comments
 (0)