Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[Llama2] newline handling problem #34

Closed
h-lunah opened this issue Feb 15, 2024 · 3 comments
Closed

[Llama2] newline handling problem #34

h-lunah opened this issue Feb 15, 2024 · 3 comments

Comments

@h-lunah
Copy link

h-lunah commented Feb 15, 2024

newlines are incorrectly handled by this library with llama2 provider.

if stream is off: no newlines will ever appear.
if stream is on: the ai response will repeat itself a bunch of times in random places, causing issues with character limits

this could be fixed.

@Simatwa
Copy link
Owner

Simatwa commented Feb 15, 2024

Thank you for this. As of latest version, I'm only experiencing issues with the new line in non-stream. A fix is on the way.

@h-lunah
Copy link
Author

h-lunah commented Feb 16, 2024

as it stands right now, the latest version (0.5.1) does not contain this hotfix as it was released a few commits before this hotfix was pushed out. you might want to re-release 0.5.1 or make a new release 0.5.2 to fix that issue properly.

@Simatwa
Copy link
Owner

Simatwa commented Feb 16, 2024

Okay.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants