New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Add text streaming to CLI and WebUI #4

Open

carolinebridge opened this issue Nov 13, 2024 · 1 comment

Collaborator

carolinebridge commented Nov 13, 2024

Add text streaming to CLI and WebUI to improve UX when asking the bot a question. Some stipulations:

bot responses typically come back formatted with Markdown, ensure printing the generated response in chunks accommodates for this
properly stream chunks of data through the API endpoint and back to the WebUI

carolinebridge mentioned this issue

WIP: adds text streaming to console, not working for API front end #3

Draft

Collaborator Author

carolinebridge commented Nov 14, 2024

https://github.com/langchain-ai/weblangchain
☝️ LangChain's exemplar repo for using LangChain with a web interface -- utilizes LangServe, so might require refactoring from LangGraph (or some workarounds)

# for free to join this conversation on GitHub. Already have an account? # to comment