Skip to content

Implement reranking for Voyage Models #10521

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

Conversation

S1LV3RJ1NX
Copy link
Collaborator

Title

Implement reranking for Voyage Models

Relevant issues

#9823

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

  • [👍 ] I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
  • [ 👍 ] I have added a screenshot of my new test passing locally
    image
  • [👍 ] My PR passes all unit tests on make test-unit
  • [ 👍 ] My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🆕 New Feature

Changes

  • Introduced VoyageRerankConfig class for handling rerank requests to the Voyage API.
  • Added VoyageError class for error handling specific to Voyage operations.
  • Updated ProviderConfigManager to include support for the Voyage provider.
  • Refactored existing code to utilize the new VoyageError class.
  • Created tests for Voyage rerank functionality to ensure proper request and response handling.
  • Updated rerank API to support Voyage as a custom LLM provider.

- Introduced VoyageRerankConfig class for handling rerank requests to the Voyage API.
- Added VoyageError class for error handling specific to Voyage operations.
- Updated ProviderConfigManager to include support for the Voyage provider.
- Refactored existing code to utilize the new VoyageError class.
- Created tests for Voyage rerank functionality to ensure proper request and response handling.
- Updated rerank API to support Voyage as a custom LLM provider.
Copy link

vercel bot commented May 3, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback May 7, 2025 5:42am

@krrishdholakia
Copy link
Contributor

@S1LV3RJ1NX your tests are failing - can you please fix them, before requesting a review
Screenshot 2025-05-06 at 9 51 01 PM

@krrishdholakia krrishdholakia marked this pull request as draft May 7, 2025 04:51
@S1LV3RJ1NX S1LV3RJ1NX marked this pull request as ready for review May 7, 2025 05:50
@S1LV3RJ1NX S1LV3RJ1NX marked this pull request as draft May 7, 2025 05:50
@S1LV3RJ1NX S1LV3RJ1NX marked this pull request as ready for review May 7, 2025 06:19
@S1LV3RJ1NX S1LV3RJ1NX marked this pull request as draft May 7, 2025 18:02
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants