Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Implement Incremental Update of Indices #1442

Closed
alexanderkiel opened this issue Jan 26, 2024 · 0 comments
Closed

Implement Incremental Update of Indices #1442

alexanderkiel opened this issue Jan 26, 2024 · 0 comments
Assignees
Labels
Milestone

Comments

@alexanderkiel
Copy link
Member

alexanderkiel commented Jan 26, 2024

Requirements

The admin of Blaze should be able to update all indices relevant for a search parameter.

  • a job will be created for that update
  • the job state will be persisted regularly so that it will continue it's work after restarts until it either finishes successfully or errors
  • the jobs should be manageable in the admin UI
    • an admin should be able to create jobs
    • an admin should be able to see all jobs by status
    • an admin should be able to cancel a job
  • the solution has to work for the distributed storage variant (postponed to Make Index Updates Available in Distributed Storage Variant #1605)

Solution

  • the jobs are implemented via FHIR Task resources
  • a second database node will be used to store admin related resources like the job task resources
  • a subscription mechanism on the admin database node will be used to retrieve the jobs on each node also in distributed storage variant
  • received jobs will be executed via a multi method
@alexanderkiel alexanderkiel self-assigned this Jan 26, 2024
alexanderkiel added a commit that referenced this issue Jan 26, 2024
The search will only work for newly created or updated resources until
#1442 is available.

Closes: #1418
@alexanderkiel alexanderkiel added this to the v0.26 milestone Apr 15, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant