Skip to content

bug: connection 504 gateway timeout #123

@Zheaoli

Description

@Zheaoli

I follow the step in the documentation Create your first OpenAI compatible API server

Here's the list info detail

╰─ mdz list
 NAME      ENDPOINT                                                    STATUS   INVOCATIONS  REPLICAS
 jupyter   http://jupyter-2j8g8a2w664nwlsu.192.168.0.239.modelz.live   Scaling            5  0/1
           http://localhost:80/inference/jupyter.default
 jupyter1  http://jupyter1-s37e8r27fc0bt7ap.192.168.0.239.modelz.live  Ready            187  1/1
           http://localhost:80/inference/jupyter1.default

Then when I access the deployment by using endpoint, the error message has been raised

{"message":"no addresses for \"mdz-jupyter.default\"","request":"GET /inference/jupyter.default/","op":"inference-proxy","error":{}}

I guess this is related to the scaling status, but I can't find the root cause by using the command mdz logs jupyter

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions