You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have launched sglang backend on runpod, and when I open /get_model_info endpoint in browser it works, but when I try it locally it throws following error
Traceback (most recent call last):
File "/Users/gur/Documents/feb27/main.py", line 58, in <module>
set_default_backend(RuntimeEndpoint(os.getenv("SGLANG_URL")))
File "/Users/gur/miniconda3/envs/feb27/lib/python3.10/site-packages/sglang/backend/runtime_endpoint.py", line 22, in __init__
res = http_request(
File "/Users/gur/miniconda3/envs/feb27/lib/python3.10/site-packages/sglang/utils.py", line 110, in http_request
resp = urllib.request.urlopen(req, data=data)
File "/Users/gur/miniconda3/envs/feb27/lib/python3.10/urllib/request.py", line 216, in urlopen
return opener.open(url, data, timeout)
File "/Users/gur/miniconda3/envs/feb27/lib/python3.10/urllib/request.py", line 525, in open
response = meth(req, response)
File "/Users/gur/miniconda3/envs/feb27/lib/python3.10/urllib/request.py", line 634, in http_response
response = self.parent.error(
File "/Users/gur/miniconda3/envs/feb27/lib/python3.10/urllib/request.py", line 563, in error
return self._call_chain(*args)
File "/Users/gur/miniconda3/envs/feb27/lib/python3.10/urllib/request.py", line 496, in _call_chain
result = func(*args)
File "/Users/gur/miniconda3/envs/feb27/lib/python3.10/urllib/request.py", line 643, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden
Upd: it neither works on server when I use its full url with "https", but again it works if I use "http://localhost"
Activity
github-actions commentedon Jul 25, 2024
This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.
support tie word embeddings (sgl-project#255)
[gpu_battery] s17: bar1-vs-NCCL x INT8-vs-FP8, measured eager, 8 arms (…
Merge fix/sm120-w8a8-configs-370: capture-cost root cause measured — …