Skip to content

Add OpenAI Function Agents & logging capabilities using aimstack #18

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

srmsoumya
Copy link
Member

  • Add support for open-ai function agents that better handle parameter passing to tools
  • Log experiments using aimstack - easy to compare runs by different agents
  • Handle exceptions gracefully

@srmsoumya srmsoumya requested a review from sunu August 3, 2023 08:07
@srmsoumya
Copy link
Member Author

@sunu aimstack stores the log in the root of cwd as .aim/.

We can check the logs in a dashboard by aim up that runs on port 43800 by default. Should we have this running as well to check logs periodically?

@sunu
Copy link
Member

sunu commented Aug 3, 2023

Just some initial thoughts:

  • If we're going to run aimstack as a service and monitor multiple experiments, we should see if it supports storing/loading data from something more cloud native - like a GCS bucket for example
  • If we are ok with running aimstack coupled to this particular streamlit app only, then I guess we can try to run it as a sidecar that will share a storage volume with the streamlit app. In theory, it should work, but may require some figuring out.

@srmsoumya
Copy link
Member Author

If we're going to run aimstack as a service and monitor multiple experiments, we should see if supports storing/loading data from something more cloud native - like a GCS bucket for example

I don't foresee us using aimstack for monitoring other experiments, so we can run this as a one-off for now, we can switch to LangSmith once it is out of public beta.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants