Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Added Groq as an provider #438

Merged
merged 2 commits into from
Mar 1, 2024
Merged

Conversation

Penagwin
Copy link
Contributor

@Penagwin Penagwin commented Feb 29, 2024

Adds support for Groq.com

Addresses #427

The logo is a little janky, and heads up that they keep changing their rate limits.
Currently it's

The rate limit is set to 20 requests per minute and 20 requests per 10 minutes, operating simultaneously. Whichever limit is reached first triggers the rate limit:

Copy link

vercel bot commented Feb 29, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Updated (UTC)
big-agi-open ✅ Ready (Inspect) Visit Preview Mar 1, 2024 6:25pm

@enricoros
Copy link
Owner

Nice! From a quick read it seems you hit all the places to modify to add support - good job.
Will need my laptop to test and merge, will do that soon.

@Penagwin
Copy link
Contributor Author

Penagwin commented Mar 1, 2024

I discovered Groq does support fetching the models although it's not documented.

So I added support for that

@enricoros enricoros merged commit 17cc31f into enricoros:main Mar 1, 2024
1 check passed
@enricoros
Copy link
Owner

Thanks @Penagwin - great quality contribution. Reviewed and updated the icon.
Groq is really fast, I can consider new use cases with it.
Also good job to find the undocumented model list endpoint - very useful as it reduced ongoing maintenance cost, and shows models as soon as they're released!

@enricoros enricoros mentioned this pull request Mar 1, 2024
23 tasks
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants