-
Notifications
You must be signed in to change notification settings - Fork 300
Adding files to deploy CodeTrans application on ROCm vLLM #1545
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding files to deploy CodeTrans application on ROCm vLLM #1545
Conversation
Dependency Review✅ No vulnerabilities or license issues found.Scanned Files |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please refer to my comments in review.
…ated model table in LLM microservice (opea-project#1501) Signed-off-by: Tsai, Louie <[email protected]> Co-authored-by: Wang, Kai Lawrence <[email protected]> Co-authored-by: xiguiw <[email protected]> Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
66b3d46
to
470d88b
Compare
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
@chensuyue, can you please tell me why this check fails - https://github.com/opea-project/GenAIExamples/actions/runs/13698991369/job/38307896179?pr=1545? |
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
for more information, see https://pre-commit.ci
Signed-off-by: Chingis Yundunov <[email protected]>
for more information, see https://pre-commit.ci
Signed-off-by: Chingis Yundunov <[email protected]>
…ture/Codetrans_vLLM
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
for more information, see https://pre-commit.ci
Signed-off-by: Chingis Yundunov <[email protected]>
…ture/Codetrans_vLLM
for more information, see https://pre-commit.ci
Hi @chyundunovDatamonsters , I'm working on merging |
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
for more information, see https://pre-commit.ci
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, the example merge of CodeTrans & Translation is pending for now
…ct#1545) Signed-off-by: Tsai, Louie <[email protected]> Signed-off-by: Chingis Yundunov <[email protected]>
…ct#1545) Signed-off-by: Tsai, Louie <[email protected]> Signed-off-by: Chingis Yundunov <[email protected]>
…ct#1545) Signed-off-by: Tsai, Louie <[email protected]> Signed-off-by: Chingis Yundunov <[email protected]> Signed-off-by: Chingis Yundunov <[email protected]>
Description
Adding files to deploy CodeTrans application on ROCm vLLM.
Issues
It is required to provide the ability to deploy the CodeTrans application on ROCm vLLM
Type of change
List the type of change like below. Please delete options that are not relevant.
Dependencies
Tests
Testing was performed manually and by running a script CodeTrans/tests/test_compose_vllm_on_rocm.sh This script is similar to the script that runs CodeTrans testing on an Intel CPU.