Add support for chatbot #160
Description
What would you like to be added:
Once we launched a model, we can simply co-launch a webui for interaction.
We can add integration with projects like open-webui or lobe-chat, or create a lightweight one like gradio.
The problem with exist projects is they support API service like OpenAI, or ollama, but lack the support with customized models, in llmaz, the openModel.
The chatUI should be located at repo: https://github.com/InftyAI/llmchat.
Why is this needed:
For better UX.
Completion requirements:
This enhancement requires the following artifacts:
- Design doc
- API change
- Docs update
The artifacts should be linked in subsequent comments.