Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[EPIC] Maintain context/session state between runs #273

Open
logan-markewich opened this issue Sep 26, 2024 · 1 comment
Open

[EPIC] Maintain context/session state between runs #273

logan-markewich opened this issue Sep 26, 2024 · 1 comment
Assignees

Comments

@logan-markewich
Copy link
Collaborator

Currently, the code that was supposed to maintain context/state between runs is all commented out.

We need to bring back this feature, by figuring out how to serialize the context. That means, we need to serialize

  • the globals dict
  • the queues
  • etc.

In this case, I don't think it's enough to maintain just the global dict. We need it all, especially to support future use-cases where runs of a workflow can be stepwise, take days, have undo/rewind, etc.

This will require figuring out how to do this in llama-index itself first of course

@logan-markewich logan-markewich moved this to Todo in Framework Sep 26, 2024
@logan-markewich logan-markewich self-assigned this Oct 4, 2024
@logan-markewich logan-markewich changed the title Maintain context/session state between runs [EPIC] Maintain context/session state between runs Oct 4, 2024
@jonpspri
Copy link
Contributor

jonpspri commented Oct 6, 2024

I'm looking first to a simple case of managing a session-level context in the WorkflowService. I see a framework is in place but not yet implemented. The basic idea is easy, create a context for each session and persist it (in-memory initially, eventually on storage).

The simple approach is to wire that in to the existing Workflow Service or a subclass, but I wondering if the notion of a separate ContextManager class is appropriate? I'll probably hold that in store as a refactoring.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
Status: ActiveEpics
Development

No branches or pull requests

2 participants