Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Updates planned capabilities #460

Merged
merged 1 commit into from
Dec 5, 2024
Merged

Updates planned capabilities #460

merged 1 commit into from
Dec 5, 2024

Conversation

skrawcz
Copy link
Contributor

@skrawcz skrawcz commented Dec 5, 2024

This was stale and behind.

Changes

How I tested this

Notes

Checklist

  • PR has an informative and human-readable title (this will be pulled into the release notes)
  • Changes are limited to a single goal (no scope creep)
  • Code passed the pre-commit check & code is left cleaner/nicer than when first encountered.
  • Any change in functionality is tested
  • New functions are documented (with a description, list of inputs, and expected output)
  • Placeholder code is flagged / future TODOs are captured in comments
  • Project documentation has been updated if adding/changing functionality.

Important

Updates planned-capabilities.rst to reflect current and future evaluation, annotation, and integration capabilities.

  • Evaluation & Annotation:
    • Updated section to include plans for metrics and custom callbacks/LLM as judge capabilities.
    • Added SDK functionality for programmatic annotation, evaluation, export, and search.
  • Integrations:
    • Updated to reflect current support for Haystack, Hamilton, and LangChain.
  • Misc:
    • Renamed section from "UI-based annotations" to "Evaluation & Annotation integrations".

This description was created by Ellipsis for deac7e7. It will automatically update as commits are pushed.

This was stale and behind.
@skrawcz skrawcz merged commit 8c573e9 into main Dec 5, 2024
4 checks passed
@skrawcz skrawcz deleted the fix_docs branch December 5, 2024 19:23
Copy link

@ellipsis-dev ellipsis-dev bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Looks good to me! Reviewed everything up to deac7e7 in 12 seconds

More details
  • Looked at 31 lines of code in 1 files
  • Skipped 0 files when reviewing.
  • Skipped posting 1 drafted comments based on config settings.
1. docs/concepts/planned-capabilities.rst:16
  • Draft comment:
    Consider rephrasing for clarity:
1. Integrate metrics and custom callbacks/LLM as judge capabilities to evaluate captured and annotated data.
  • Reason this comment was not posted:
    Confidence changes required: 50%
    The sentence on line 16 is unclear and could be rephrased for better readability.

Workflow ID: wflow_b2u36DLxuEeYEnla


You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

Copy link

github-actions bot commented Dec 5, 2024

A preview of is uploaded and can be seen here:

https://burr.dagworks.io/pull/460

Changes may take a few minutes to propagate. Since this is a preview of production, content with draft: true will not be rendered. The source is here: https://github.com/DAGWorks-Inc/burr/tree/gh-pages/pull/460/

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant