[Bug] ChatQnA cannot support configuring llm protocol

[Yugar-1]

Priority

P2-High

OS type

Ubuntu

Hardware type

Xeon-GNR

Installation method

• Pull docker images from hub.docker.com
• Build docker images from source
• Other

Deploy method

• Docker
• Docker Compose
• Kubernetes Helm Charts
• Kubernetes GMC
• Other

Running nodes

Single Node

What's the version?

latest

Description

When ChatQnA uses the authorized LLM service endpoint, the protocol may be https. The current LLM service protocol defaults to http, which does not support configuration.

 llm = MicroService(
        name="llm",
        host=LLM_SERVER_HOST_IP,
        port=LLM_SERVER_PORT,
        endpoint="/v1/chat/completions",
        use_remote_service=True,
        service_type=ServiceType.LLM,
    )

Reproduce steps

n/a

Raw log

Attachments

No response

[xiguiw]

@Yugar-1
https is not enabled in OPEA because we cannot issue an encrypted certificate.

[yinghu5]

Hi @Yugar-1 thank you a lot for the request , we will remind reviewer to review the related PR. thanks

Let ChatQnA support authorized LLM service. opea-project/GenAIComps#1273

remote endpoint support opea-project/GenAIComps#1399

[yinghu5]

Hi @Yugar-1 both #1273 and #1399 should fix the issue. thank you for ask and provide solution. I close the issue, please feel free to reopen if needs.