Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Print token costs after each message #249

Closed
materemias opened this issue Nov 6, 2024 · 9 comments
Closed

Print token costs after each message #249

materemias opened this issue Nov 6, 2024 · 9 comments
Labels
enhancement New feature or request

Comments

@materemias
Copy link

eg aider prints after each answer:

Tokens: 4.0k sent, 264 received.
Cost: $0.02 message, $0.05 session.

something like this would be beneficial for gptme as well
@ErikBjare
Copy link
Owner

We have the /tokens command which prints the input costs for the session.

Will consider adding a feature to include the output cost too.

@ErikBjare ErikBjare added the enhancement New feature or request label Nov 6, 2024
@ErikBjare ErikBjare changed the title FR: please consider adding estimated cost to the output Print token costs after each message Nov 6, 2024
@Kamalesh-Seervi
Copy link

can I work on this

@ErikBjare
Copy link
Owner

@Kamalesh-Seervi Sure, give it a shot! :)

@Kamalesh-Seervi

This comment was marked as off-topic.

# to view
@Kamalesh-Seervi

This comment was marked as off-topic.

# to view
@ErikBjare
Copy link
Owner

tokenizer isn't supported in Python 3.13: #198

But it seems to have finally been merged 5 days ago: huggingface/tokenizers#1639 (comment)

Use Python 3.10-3.12

@Kamalesh-Seervi
Copy link

yeh fine I will downgrade and work around cool thanks for quick response

@ErikBjare ErikBjare mentioned this issue Nov 15, 2024
Open
3 tasks
@ErikBjare
Copy link
Owner

I implemented something basic here: #293

@ErikBjare
Copy link
Owner

Fixed in #293

# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@materemias @ErikBjare @Kamalesh-Seervi