[FEATURE] Changing model's parameters midchat.

#567
by SimaDude - opened

Can we have a feature to change model's parameters in the middle of the chat? I'm starting to get these repetitive responses, and I think if I could increase the repetition penalty specifically for this message (and not to a large amount like 1.1, but something like 1.02-1.05) it would be pretty good.
image.png

SimaDude changed discussion title from [REQUEST] Changing model's parameters midchat. to [FEATURE] Changing model's parameters midchat.
Hugging Chat org

Would you be comfortable with sharing this chat or another example? Don't think this should be happening in the first place

Of course, here's even worse example where I'm just trying to begin the story, but the model just repeats itself over and over again: https://hf.co/chat/r/2Z5pgjX?leafId=648773a3-fea7-487d-9fce-e71c60afacb9

And here's an example with using a system prompt without Assistant: https://hf.co/chat/r/dMgrZ37?leafId=787c1510-14ef-4a7b-8088-647c53b1da3a

+context too! That'd be really helpful.. we don't need to test each time with altering system prompt & starting a new chat. Would be able test instantly in the same session! Great idea.

Sign up or log in to comment