huggingface Inference API Endpoint zephyr-7b-beta #598
Closed
quantumalchemy
announced in
Integrations
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Any integration plan for using the huggingface Inference API Endpoint for zephyr-7b-beta ?
ie: api-inference.huggingface.co/models/HuggingFaceH4/zephyr-7b-beta
or did I miss something?
maybe using openai wrapper like: litellm
https://github.com/BerriAI/litellm
I guess it would depend on the api returning the function calling requirements Any insight?
Beta Was this translation helpful? Give feedback.
All reactions