LLM module structure

General

LLM module operates in two modes, chat and assistant.

Chat allows to have a conversation with bot, keeping message history. It is activated when you type something in the chat with the bot.
Assistant mode is activated with /ask command and it uses model's prompt format, optimal for instruct-tuned models.

Character files