Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Support Gemini (Google Generative AI) Platform #275

Closed
8 tasks done
enricoros opened this issue Dec 13, 2023 · 5 comments
Closed
8 tasks done

Support Gemini (Google Generative AI) Platform #275

enricoros opened this issue Dec 13, 2023 · 5 comments
Labels
feature-cool Distinctive features new-vendor
Milestone
1.8.0

Comments

@enricoros
Copy link
Owner

enricoros commented Dec 13, 2023 •
edited
Loading

Support the Google generative AI platform and the Gemini models, as documented here:

  • docs: ..
  • login: ...

Requirements:

  • Add Gemini Vendor
  • Add Gemini vector icon
  • Implement Setup and (transport) Access
  • Implement Transport
  • Implement Model List mapping (tokens, name, description, etc)
  • Implement Streaming endpoint
  • Test
  • Ship 🚀
@david-strejc
Copy link

Support the Google generative AI platform and the Gemini models, as documented here:

  • docs: ..
  • login: ...

Requirements:

  • Add Gemini Vendor
  • Add Gemini vector icon
  • Implement Setup and (transport) Access
  • Implement Transport
  • Implement Model List mapping (tokens, name, description, etc)
  • Implement Streaming endpoint
  • Test
  • Ship 🚀

When will be first version ready?

@enricoros
Copy link
Owner Author

@david-strejc This week, ideally tomorrow, at least with the basic features.

@enricoros enricoros added this to the 1.8.0 milestone Dec 18, 2023
@david-strejc
Copy link

@david-strejc This week, ideally tomorrow, at least with the basic features.

Many MANY thanks. We are curious what we can do with Gemini.

@enricoros
Copy link
Owner Author

enricoros commented Dec 19, 2023 •
edited
Loading

Support almost complete. Will finish tomorrow.

  • list models; ✅
  • immediate generation: ✅
  • streaming generation: will be done next
  • image/multi-part input: not ready yet, needs to change all LLM providers - prob preview late this week
  • function calling: very experimental, nowhere near OpenAI

Note that Gemini models:

  • does not support system prompts well (they do not have the concept of system prompts)
  • ... more quirks? ...

image

@github-project-automation github-project-automation bot moved this from In Progress to Ready in big-AGI build-in-public roadmap Dec 20, 2023
@enricoros
Copy link
Owner Author

Code landed for a very good implementation of Gemini.

  • includes streaming, non-streaming, list models
  • includes changeable safety settings
  • includes multipart text conversation building

Next up:

@enricoros enricoros mentioned this issue Dec 20, 2023
Closed
20 tasks
@enricoros enricoros moved this from Ready to To Promote in big-AGI build-in-public roadmap Dec 20, 2023
@enricoros enricoros added the feature-cool Distinctive features label Dec 28, 2023
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
feature-cool Distinctive features new-vendor
Projects
big-AGI build-in-public roadmap
Status: To Promote
Milestone
1.8.0
Development

No branches or pull requests
2 participants
@enricoros @david-strejc