Structure and Vicuna Usage

[ghost]

Hi, <3 llama.cpp

A solution is currently being worked on to resolve EOS behavior in interactive: EOSFix

Related: #2507, #2646 (comment), #2598, #2417

Thank you.

[ossirytk]

I have tested this model today, and it seems to run just fine.I have had no issues with other models either. This might be an issue with your params or prompt.

[ghost]

Hi, thanks for your message, but others also experience the issue: wtarreau bisected and determinedin-prefix-bos to be a real regression.

ggerganov identified the problem: so we'll likely see a fix soon.