Skip to content

Initial changes for different snapshot behaviours in distRDF #18422

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

Aditya-138-12
Copy link
Contributor

This Pull request:

Allows different snapshot behaviours in dist RDF

Changes or fixes:

  1. Made 3 new functions within the class, _get_base_filename, _merge_snapshot_files, _cleanup_partial_files
  2. added a default option for merging the files -> MERGE_OUTPUT

Checklist:

  • tested changes locally
  • updated the docs (if necessary)

This PR fixes #17136

1. Made 3 new functions within the class, `_get_base_filename`, `_merge_snapshot_files`, `_cleanup_partial_files`
2. added a default option for merging the files -> `MERGE_OUTPUT`
@Aditya-138-12 Aditya-138-12 marked this pull request as draft April 16, 2025 13:29
Copy link

Test Results

    17 files      17 suites   4d 0h 36m 17s ⏱️
 2 739 tests  2 737 ✅ 0 💤  2 ❌
45 169 runs  45 137 ✅ 0 💤 32 ❌

For more details on these failures, see this check.

Results for commit 4da07ce.

# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Allow different Snapshot behaviours in distributed RDataFrame
4 participants