Skip to content

Commit 4468ed2

Browse files
Rename embedding microservice and fix typos (#224)
* add preload env in run.sh Signed-off-by: lvliang-intel <[email protected]> * make tei ms generic for both cpu and hpu Signed-off-by: lvliang-intel <[email protected]> --------- Signed-off-by: lvliang-intel <[email protected]>
1 parent 4c0afd0 commit 4468ed2

File tree

5 files changed

+9
-9
lines changed

5 files changed

+9
-9
lines changed

comps/embeddings/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ export TEI_EMBEDDING_MODEL_NAME="BAAI/bge-large-en-v1.5"
6969
export LANGCHAIN_TRACING_V2=true
7070
export LANGCHAIN_API_KEY=${your_langchain_api_key}
7171
export LANGCHAIN_PROJECT="opea/gen-ai-comps:embeddings"
72-
python embedding_tei_gaudi.py
72+
python embedding_tei.py
7373
```
7474

7575
### Start Embedding Service with Local Model

comps/embeddings/langchain/docker/Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,5 +24,5 @@ ENV PYTHONPATH=$PYTHONPATH:/home/user
2424

2525
WORKDIR /home/user/comps/embeddings/langchain
2626

27-
ENTRYPOINT ["python", "embedding_tei_gaudi.py"]
27+
ENTRYPOINT ["python", "embedding_tei.py"]
2828

comps/embeddings/langchain/embedding_tei_gaudi.py renamed to comps/embeddings/langchain/embedding_tei.py

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@
1919

2020

2121
@register_microservice(
22-
name="opea_service@embedding_tgi_gaudi",
22+
name="opea_service@embedding_tei_langchain",
2323
service_type=ServiceType.EMBEDDING,
2424
endpoint="/v1/embeddings",
2525
host="0.0.0.0",
@@ -28,18 +28,18 @@
2828
output_datatype=EmbedDoc768,
2929
)
3030
@traceable(run_type="embedding")
31-
@register_statistics(names=["opea_service@embedding_tgi_gaudi"])
31+
@register_statistics(names=["opea_service@embedding_tei_langchain"])
3232
def embedding(input: TextDoc) -> EmbedDoc768:
3333
start = time.time()
3434
embed_vector = embeddings.embed_query(input.text)
3535
embed_vector = embed_vector[:768] # Keep only the first 768 elements
3636
res = EmbedDoc768(text=input.text, embedding=embed_vector)
37-
statistics_dict["opea_service@embedding_tgi_gaudi"].append_latency(time.time() - start, None)
37+
statistics_dict["opea_service@embedding_tei_langchain"].append_latency(time.time() - start, None)
3838
return res
3939

4040

4141
if __name__ == "__main__":
4242
tei_embedding_endpoint = os.getenv("TEI_EMBEDDING_ENDPOINT", "http://localhost:8080")
4343
embeddings = HuggingFaceHubEmbeddings(model=tei_embedding_endpoint)
4444
print("TEI Gaudi Embedding initialized.")
45-
opea_microservices["opea_service@embedding_tgi_gaudi"].start()
45+
opea_microservices["opea_service@embedding_tei_langchain"].start()

comps/embeddings/llama_index/docker/Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,5 +26,5 @@ ENV PYTHONPATH=$PYTHONPATH:/home/user
2626

2727
WORKDIR /home/user/comps/embeddings/llama_index
2828

29-
ENTRYPOINT ["python3", "embedding_tei_gaudi.py"]
29+
ENTRYPOINT ["python3", "embedding_tei.py"]
3030

comps/embeddings/llama_index/embedding_tei_gaudi.py renamed to comps/embeddings/llama_index/embedding_tei.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010

1111

1212
@register_microservice(
13-
name="opea_service@embedding_tgi_gaudi",
13+
name="opea_service@embedding_tei_llamaindex",
1414
service_type=ServiceType.EMBEDDING,
1515
endpoint="/v1/embeddings",
1616
host="0.0.0.0",
@@ -31,4 +31,4 @@ def embedding(input: TextDoc) -> EmbedDoc768:
3131
tei_embedding_endpoint = os.getenv("TEI_EMBEDDING_ENDPOINT", "http://localhost:8090")
3232
embeddings = TextEmbeddingsInference(model_name=tei_embedding_model_name, base_url=tei_embedding_endpoint)
3333
print("TEI Gaudi Embedding initialized.")
34-
opea_microservices["opea_service@embedding_tgi_gaudi"].start()
34+
opea_microservices["opea_service@embedding_tei_llamaindex"].start()

0 commit comments

Comments
 (0)