Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Include usage object in openai streaming response by default #691

Open
narengogi opened this issue Oct 21, 2024 · 1 comment
Open

Include usage object in openai streaming response by default #691

narengogi opened this issue Oct 21, 2024 · 1 comment
Labels
bug Something isn't working triage

Comments

@narengogi
Copy link
Collaborator

What Happened?

To get the usage object, the user has to pass streaming_options: { include_usage: true}
This can be default behaviour

What Should Have Happened?

No response

Relevant Code Snippet

No response

Your Twitter/LinkedIn

No response
@narengogi narengogi added the bug Something isn't working label Oct 21, 2024
This was referenced Oct 21, 2024
Closed
Closed
@narengogi
Copy link
Collaborator Author

tested this for all chat models of openai

# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
bug Something isn't working triage
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@narengogi