Skip to content

--interactive, --Interactive-start, and other launch options. #68

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Pasajeromoronmoreno opened this issue Mar 19, 2023 · 5 comments
Open

Comments

@Pasajeromoronmoreno
Copy link

I was playing with several of these options, but they seem to do nothing, or I don't know how to use them.
--interactive
--Interactive-start
--reverse-prompt PROMPT
--prompt PROMPT
--file FNAME

I was hoping to make it work in chat mode with some of these options, or to give it a fixed prompt that reads as context before giving a response, but nothing I tried seems to have any effect. If anyone knows how to use them, could you please explain it here, so it can be used as a reference? Thank you!!

@linonetwo
Copy link

Seems these options are broken, it become interactive by default, and ignore the prompt

@Alexmakes
Copy link

ive found the new -f option doesn't seam to work and without a verbose option when loading the model i can not confirm whether or not it is working
command used
./chat -m ggml-alpaca-13b-q4.bin -t 39 --color -c 10400 -n 4096 --repeat_last_n 10400 -f cake

@GrahamboJangles
Copy link

Yeah I don't think any of these launch options are doing anything

@vicfic18
Copy link

Yeah, --reverse-prompt is not doing anything for me either.
It would've been great to chat with something like Bob from llama.cpp with a customised personality.

@Sidefix
Copy link

Sidefix commented Mar 23, 2023

-f seems to work in the sense that it reads the prompts written in the file, but it immediately ends the conversation after providing a single line of text with the '[end of text]' message. I'm not sure if I'm doing something wrong or not

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants