Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[FEATURE] Helper function for searching that utilises Point In Time #429

Open
Jakob3xD opened this issue Nov 20, 2023 · 1 comment
Open
Labels
enhancement New feature or request

Comments

@Jakob3xD
Copy link
Collaborator

Is your feature request related to a problem?

OpenSearch _search is limited to max 10_000 docs per request. Users need to do pagination with scroll or point in time.

What solution would you like?

We could add a helper function to the opensearchutil lib that allows users to search for documents but without the limitation of search returning max 10_000 documents by using Point In Time and search_after.
Exact implementation could be discussed.

Are such helper function wanted inside the lib?

What alternatives have you considered?

None

Do you have any additional context?

None

@Jakob3xD Jakob3xD added enhancement New feature or request untriaged labels Nov 20, 2023
@dblock
Copy link
Member

dblock commented Nov 20, 2023

+1, it would be great to have a way to paginate through records in all paginated APIs in some consistent way without having to maintain a counter or a scroll position

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants