Skip to content

Adding files to deploy CodeTrans application on ROCm vLLM #1545

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

chyundunovDatamonsters
Copy link
Contributor

Description

Adding files to deploy CodeTrans application on ROCm vLLM.

Issues

It is required to provide the ability to deploy the CodeTrans application on ROCm vLLM

Type of change

List the type of change like below. Please delete options that are not relevant.

  • [*] New feature (non-breaking change which adds new functionality)

Dependencies

Tests

Testing was performed manually and by running a script CodeTrans/tests/test_compose_vllm_on_rocm.sh This script is similar to the script that runs CodeTrans testing on an Intel CPU.

Copy link

github-actions bot commented Feb 13, 2025

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Files

Copy link

@AlexHe99 AlexHe99 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please refer to my comments in review.

louie-tsai and others added 10 commits February 17, 2025 11:06
…ated model table in LLM microservice (opea-project#1501)

Signed-off-by: Tsai, Louie <[email protected]>
Co-authored-by: Wang, Kai Lawrence <[email protected]>
Co-authored-by: xiguiw <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Chingis Yundunov added 2 commits February 17, 2025 11:13
@chyundunovDatamonsters
Copy link
Contributor Author

@joshuayao joshuayao added this to the v1.3 milestone Mar 7, 2025
@letonghan
Copy link
Collaborator

Hi @chyundunovDatamonsters , I'm working on merging CodeTrans and Translation example in this PR. I wonder if you can apply your changes in Translation example, so that we can merge your PR with mine automatically?

Copy link
Collaborator

@letonghan letonghan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, the example merge of CodeTrans & Translation is pending for now

@chensuyue chensuyue merged commit a04463d into opea-project:main Mar 24, 2025
20 checks passed
chyundunovDatamonsters added a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Apr 1, 2025
chyundunovDatamonsters added a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Apr 1, 2025
chyundunovDatamonsters added a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request May 16, 2025
…ct#1545)

Signed-off-by: Tsai, Louie <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants