openai compatible api #316
Description
@dongxiaolong are you referring to being able to pass `"role"` and `"content"` as the input? Could you please open an issue and add the `Enhancement` label? Thanks!
Originally posted by @mrwyattii in #270 (comment)