Repository navigation

vllm-rocm

Public

forked from ROCm/vllm

About

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm.readthedocs.io

Code of conduct

Security policy

0 stars

0 watching

Report repository

Name		Name	Last commit message	Last commit date
.buildkite		.buildkite
.gemini		.gemini
.github		.github
benchmarks		benchmarks
cmake		cmake
csrc		csrc
docker		docker
docs		docs
examples		examples
requirements		requirements
tests		tests
tools		tools
vllm		vllm
.clang-format		.clang-format
.dockerignore		.dockerignore
.gitignore		.gitignore
.markdownlint.yaml		.markdownlint.yaml
.pre-commit-config.yaml		.pre-commit-config.yaml
.readthedocs.yaml		.readthedocs.yaml
.shellcheckrc		.shellcheckrc
.yapfignore		.yapfignore
CMakeLists.txt		CMakeLists.txt
CODE_OF_CONDUCT.md		CODE_OF_CONDUCT.md
CONTRIBUTING.md		CONTRIBUTING.md
DCO		DCO
LICENSE		LICENSE
MANIFEST.in		MANIFEST.in
README.md		README.md
RELEASE.md		RELEASE.md
SECURITY.md		SECURITY.md
find_cuda_init.py		find_cuda_init.py
format.sh		format.sh
mkdocs.yaml		mkdocs.yaml
pyproject.toml		pyproject.toml
setup.py		setup.py
use_existing_torch.py		use_existing_torch.py

Repository files navigation

Easy, fast, and cheap LLM serving for everyone

| Documentation | Blog | Paper | Twitter/X | User Forum | Developer Slack |

Deprecation warning

Caution

The ROCm/vllm repository is retired, please use the upstream repository

About

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm.readthedocs.io

Code of conduct

Security policy

0 stars

0 watching

Report repository

Releases

Packages

Contributors

Languages