Skip to content
This repository has been archived by the owner on Dec 6, 2024. It is now read-only.

Why does TextStreamer hold on punctuation? #71

Open
Wovchena opened this issue Jan 8, 2024 · 0 comments
Open

Why does TextStreamer hold on punctuation? #71

Wovchena opened this issue Jan 8, 2024 · 0 comments

Comments

@Wovchena
Copy link

Wovchena commented Jan 8, 2024

qwen.cpp/qwen.cpp

Line 115 in 86547f1

// last symbol is a punctuation, hold on

TextStreamer waits for the next token before printing punctuation. What's the harm to print it as the last char?
# for free to subscribe to this conversation on GitHub. Already have an account? #.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Wovchena