Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

See if we can get the GitHub agent or an agent that uses GitHub for certain kinds of code reasoning to take the entire code into its context window using a utility similar to what the humans use with appropriate filters that are set dynamically. This would be an alternative to using ASTs #261

Closed
jkbrooks opened this issue Jan 15, 2025 · 2 comments

Comments

@jkbrooks
Copy link

Not sure we should actually do this, just considering it as an alternative. Probably we should prioritize ASTs first. I imagine we will actually get some smooth stuff, but we are definitely benefited by trying it out just to see the pros and cons. If we got downtime or someone else like external can try it out just so we know what would happen.

@jkbrooks
Copy link
Author

This would require dynamically generating the filters for a utility like the ones here #75. Maybe even standardizing them and sharing them?

It would also involve dealing with the fact that Gemini does not have structured outputs the way OpenAI does. Right now, we enforce structured outputs on JSON that we send back and forth in the Eliza ecosystem. Without that, there is a chance you can get arbitrary failures. Gemini does not support this at all, which is why we haven't actually tried to use Gemini. Essentially, it's a non-starter to OpenAI. You have an Eliza agent use Gemini without addressing this issue one way or another.

Copy link

This issue has been automatically marked as stale due to 30 days of inactivity.
If no further activity occurs within 7 days, it will be closed automatically. Please take action if this issue is still relevant.

# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

No branches or pull requests

1 participant