Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Together AI vendor support. #346

Closed
enricoros opened this issue Jan 15, 2024 · 6 comments
Closed

Together AI vendor support. #346

enricoros opened this issue Jan 15, 2024 · 6 comments
Labels
feature-cool Distinctive features new-vendor
Milestone
1.11.0

Comments

@enricoros
Copy link
Owner

Add support for Together models; for instance, the new Nous Mixtral is released there first.
@enricoros enricoros self-assigned this Jan 15, 2024
@enricoros enricoros added this to the 1.11.0 milestone Jan 15, 2024
@enricoros
Copy link
Owner Author

Implemented full support, included description (context window) of the latest models, and rate limiting for the free tier.

1.11.0.-.Together.AI.support.-.2024-01-15.150641.mp4

@enricoros enricoros changed the title Support Together.ai Together AI vendor support. Jan 16, 2024
@enricoros
Copy link
Owner Author

Very fast performance!

1.11.0.-.Together.AI.support2.-.2024-01-15.162652.mp4

@enricoros enricoros mentioned this issue Jan 16, 2024
Closed
23 tasks
@enricoros enricoros removed their assignment Jan 16, 2024
@enricoros enricoros moved this from Ready to To Promote in big-AGI build-in-public roadmap Jan 16, 2024
@enricoros enricoros added the feature-cool Distinctive features label Jan 16, 2024
@qdrop17
Copy link

qdrop17 commented Jan 30, 2024

Awesome project indeed; unfortunately this feature seems to be broken atm; or there's an incompatibility with the API:

image

Unexpected token 'A', "An error o"... is not valid JSON

@enricoros
Copy link
Owner Author

@qdrop17 I just tried it now and it works perfectly here.

Screenshot_20240130_113543_Chrome.jpg

Did you self-deploy or used the hosted version?

Anything special related to your API key? (lmk if you are able to provide a temp key for me to try, to check under the same conditions)

@qdrop17
Copy link

qdrop17 commented Feb 6, 2024

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

@enricoros
Copy link
Owner Author

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

Thanks, very possible.

# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
feature-cool Distinctive features new-vendor
Projects
big-AGI build-in-public roadmap
Status: To Promote
Milestone
1.11.0
Development

No branches or pull requests
2 participants
@enricoros @qdrop17