Skip to content

Track peak memory usage in SortExec #16042

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom
Open
Tracked by #16065
2010YOUY01 opened this issue May 13, 2025 · 2 comments
Open
Tracked by #16065

Track peak memory usage in SortExec #16042

2010YOUY01 opened this issue May 13, 2025 · 2 comments
Assignees
@ding-young
Labels
enhancement New feature or request

Comments

@2010YOUY01
Copy link
Contributor

Is your feature request related to a problem or challenge?

Profiling the peak memory usage of blocking operators can be helpful.Aggregation and SortMergeJoin has already implemented it:

datafusion/datafusion/physical-plan/src/aggregates/row_hash.rs

Line 113 in 7a3d020

peak_mem_used: metrics::Gauge,

Describe the solution you'd like

Track peak memory usage in SortExec

Describe alternatives you've considered

No response

Additional context

No response
@2010YOUY01 2010YOUY01 added the enhancement New feature or request label May 13, 2025
@2010YOUY01
Copy link
Contributor Author

@ding-young

@ding-young
Copy link
Contributor

take

@ding-young ding-young mentioned this issue May 16, 2025
Open
10 tasks
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees

@ding-young ding-young

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@2010YOUY01 @ding-young