refact cuda ut to facilitate automation #559
Conversation
Signed-off-by: n1ck-guo <[email protected]>
for more information, see https://pre-commit.ci
Signed-off-by: n1ck-guo <[email protected]>
Signed-off-by: n1ck-guo <[email protected]>
Signed-off-by: Sun, Xuehao <[email protected]>
Signed-off-by: n1ck-guo <[email protected]>
Signed-off-by: n1ck-guo <[email protected]>
test/test_cuda/requirements.txt
Outdated
| pandas | ||
| pillow | ||
| py-cpuinfo | ||
| torch<2.7.0 |
There was a problem hiding this comment.
We shouldn't restrict the PyTorch version, as it may prevent us from identifying issues introduced in the latest release. For ITREX test, we can use a specific test to ensure compatibility.
test/test_cuda/requirements_vlm.txt
Outdated
| datasets | ||
| einops | ||
| flash-attn==2.6.1 | ||
| intel-extension-for-pytorch==2.3.0 |
test/test_cuda/requirements_vlm.txt
Outdated
| bitsandbytes==0.44.0 | ||
| datasets | ||
| einops | ||
| flash-attn==2.6.1 |
test/test_cuda/requirements_vlm.txt
Outdated
| datasets | ||
| einops | ||
| flash-attn==2.6.1 | ||
| intel-extension-for-pytorch==2.3.0 |
There was a problem hiding this comment.
remove intel-extension-for-pytorch
| @@ -0,0 +1,21 @@ | |||
| # git+https://github.com/haotian-liu/[email protected] | |||
| # pip install git+https://github.com/deepseek-ai/DeepSeek-VL2.git | |||
There was a problem hiding this comment.
pip install -v git+https://github.com/casper-hansen/[email protected] --no-build-isolation
test/test_cuda/requirements_vlm.txt
Outdated
| bitsandbytes==0.44.0 | ||
| datasets | ||
| einops | ||
| flash-attn==2.6.1 |
There was a problem hiding this comment.
missing protobuf==3.20.1
test/test_cuda/requirements.txt
Outdated
| auto-gptq | ||
| datasets | ||
| einops | ||
| gptqmodel>=2.0 |
There was a problem hiding this comment.
pip install -v git+https://github.com/ModelCloud/[email protected] --no-build-isolation
test/test_cuda/requirements.txt
Outdated
| @@ -0,0 +1,18 @@ | |||
| accelerate | |||
| autoawq | |||
There was a problem hiding this comment.
pip install -v git+https://github.com/casper-hansen/AutoAWQ.git --no-build-isolation
Signed-off-by: n1ck-guo <[email protected]>
No description provided.