Skip to content

Commit 99eb6a6

Browse files
[ChatQnA] Add correct ip to no_proxy list, and add no_proxy env for embedding and reranking containers (#271)
* Update README.md Signed-off-by: ctao456 <[email protected]> * Update docker_compose.yaml Signed-off-by: ctao456 <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: ctao456 <[email protected]> * Add no_proxy to all services Signed-off-by: Chun Tao <[email protected]> * Update readme to include UI demo Signed-off-by: Chun Tao <[email protected]> --------- Signed-off-by: ctao456 <[email protected]> Signed-off-by: Chun Tao <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
1 parent 5715e97 commit 99eb6a6

File tree

2 files changed

+21
-0
lines changed

2 files changed

+21
-0
lines changed

ChatQnA/docker/xeon/README.md

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -150,7 +150,14 @@ export host_ip="External_Public_IP"
150150
export your_hf_api_token="Your_Huggingface_API_Token"
151151
```
152152

153+
**Append the value of the public IP address to the no_proxy list**
154+
155+
```
156+
export your_no_proxy=${your_no_proxy},"External_Public_IP"
157+
```
158+
153159
```bash
160+
export no_proxy=${your_no_proxy}
154161
export http_proxy=${your_http_proxy}
155162
export https_proxy=${your_http_proxy}
156163
export EMBEDDING_MODEL_ID="BAAI/bge-base-en-v1.5"
@@ -320,3 +327,7 @@ To access the frontend, open the following URL in your browser: http://{host_ip}
320327
```
321328
322329
![project-screenshot](../../assets/img/chat_ui_init.png)
330+
331+
Here is an example of running ChatQnA:
332+
333+
![project-screenshot](../../assets/img/chat_ui_response.png)

ChatQnA/docker/xeon/docker_compose.yaml

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,7 @@ services:
1919
ports:
2020
- "6007:6007"
2121
environment:
22+
no_proxy: ${no_proxy}
2223
http_proxy: ${http_proxy}
2324
https_proxy: ${https_proxy}
2425
REDIS_URL: ${REDIS_URL}
@@ -32,6 +33,7 @@ services:
3233
- "./data:/data"
3334
shm_size: 1g
3435
environment:
36+
no_proxy: ${no_proxy}
3537
http_proxy: ${http_proxy}
3638
https_proxy: ${https_proxy}
3739
command: --model-id ${EMBEDDING_MODEL_ID}
@@ -44,6 +46,7 @@ services:
4446
- "6000:6000"
4547
ipc: host
4648
environment:
49+
no_proxy: ${no_proxy}
4750
http_proxy: ${http_proxy}
4851
https_proxy: ${https_proxy}
4952
TEI_EMBEDDING_ENDPOINT: ${TEI_EMBEDDING_ENDPOINT}
@@ -60,6 +63,7 @@ services:
6063
- "7000:7000"
6164
ipc: host
6265
environment:
66+
no_proxy: ${no_proxy}
6367
http_proxy: ${http_proxy}
6468
https_proxy: ${https_proxy}
6569
REDIS_URL: ${REDIS_URL}
@@ -78,6 +82,7 @@ services:
7882
- "./data:/data"
7983
shm_size: 1g
8084
environment:
85+
no_proxy: ${no_proxy}
8186
http_proxy: ${http_proxy}
8287
https_proxy: ${https_proxy}
8388
command: --model-id ${RERANK_MODEL_ID}
@@ -90,6 +95,7 @@ services:
9095
- "8000:8000"
9196
ipc: host
9297
environment:
98+
no_proxy: ${no_proxy}
9399
http_proxy: ${http_proxy}
94100
https_proxy: ${https_proxy}
95101
TEI_RERANKING_ENDPOINT: ${TEI_RERANKING_ENDPOINT}
@@ -107,6 +113,7 @@ services:
107113
- "./data:/data"
108114
shm_size: 1g
109115
environment:
116+
no_proxy: ${no_proxy}
110117
http_proxy: ${http_proxy}
111118
https_proxy: ${https_proxy}
112119
HF_TOKEN: ${HUGGINGFACEHUB_API_TOKEN}
@@ -120,6 +127,7 @@ services:
120127
- "9000:9000"
121128
ipc: host
122129
environment:
130+
no_proxy: ${no_proxy}
123131
http_proxy: ${http_proxy}
124132
https_proxy: ${https_proxy}
125133
TGI_LLM_ENDPOINT: ${TGI_LLM_ENDPOINT}
@@ -143,6 +151,7 @@ services:
143151
ports:
144152
- "8888:8888"
145153
environment:
154+
- no_proxy=${no_proxy}
146155
- https_proxy=${https_proxy}
147156
- http_proxy=${http_proxy}
148157
- MEGA_SERVICE_HOST_IP=${MEGA_SERVICE_HOST_IP}
@@ -160,6 +169,7 @@ services:
160169
ports:
161170
- "5173:5173"
162171
environment:
172+
- no_proxy=${no_proxy}
163173
- https_proxy=${https_proxy}
164174
- http_proxy=${http_proxy}
165175
- CHAT_BASE_URL=${BACKEND_SERVICE_ENDPOINT}

0 commit comments

Comments
 (0)