Skip to content

Commit aa00167

Browse files
metascroymalfet
authored andcommitted
add fast fast16 tests (#595)
1 parent 51bce7d commit aa00167

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

.github/workflows/pull.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -957,7 +957,7 @@ jobs:
957957
958958
python torchchat.py generate --checkpoint-path ${MODEL_DIR}/stories15M.pt --temperature 0 --prompt "${PROMPT}"
959959
960-
for dtype in fp32 fp16 bf16; do
960+
for dtype in fp32 fp16 bf16 fast fast16; do
961961
echo "Running export + runner with dtype=$dtype"
962962
python torchchat.py export --checkpoint-path ${MODEL_DIR}/stories15M.pt --dtype $dtype --output-dso-path /tmp/model.so
963963
./cmake-out/aoti_run /tmp/model.so -z ${MODEL_DIR}/tokenizer.bin -i "${PROMPT}"

0 commit comments

Comments
 (0)