Skip to content

Commit c63fd04

Browse files
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
1 parent abbc794 commit c63fd04

File tree

2 files changed

+4
-1
lines changed

2 files changed

+4
-1
lines changed

ChatQnA/docker_compose/amd/gpu/rocm/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -211,7 +211,7 @@ Change the `xxx_MODEL_ID` below for your needs.
211211
export http_proxy="Your_HTTP_Proxy"
212212
export https_proxy="Your_HTTPs_Proxy"
213213
```
214-
214+
215215
3. Note: In order to limit access to a subset of GPUs, please pass each device individually using one or more -device /dev/dri/rendered<node>, where <node> is the card index, starting from 128. (https://rocm.docs.amd.com/projects/install-on-linux/en/latest/how-to/docker.html#docker-restrict-gpus) into tgi-service in compose.yaml file
216216

217217
Example for set isolation for 1 GPU

ChatQnA/docker_compose/amd/gpu/rocm/compose.yaml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,6 @@
1+
# Copyright (C) 2024 Intel Corporation
2+
# SPDX-License-Identifier: Apache-2.0
3+
14
#
25
# SPDX-License-Identifier: Apache-2.0
36

0 commit comments

Comments
 (0)