Skip to content

Consolidate Examples: memtable.rs and parquet_multiple_files.rs #13912

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Closed
Tracked by #11172
alamb opened this issue Dec 26, 2024 · 0 comments · Fixed by #13913
Closed
Tracked by #11172

Consolidate Examples: memtable.rs and parquet_multiple_files.rs #13912

alamb opened this issue Dec 26, 2024 · 0 comments · Fixed by #13913
Assignees
Labels
enhancement New feature or request

Comments

@alamb
Copy link
Contributor

alamb commented Dec 26, 2024

Is your feature request related to a problem or challenge?

The large number of small examples in DataFusion leads to multiple problems:

  • Makes it harder to find the relevant examples
  • Unnecessarily large amounts of disk space on a full build (each example binary takes 100+ MB)
  • Larger cargo t time (each binary must be linked / created)

Thus I think the fewer examples we have the

  1. easier it will be to find the relevant examples
  2. faster our dev experience will be

Describe the solution you'd like

I would like a single file with common SQL based examples where we can consolidate other files (like to_date.rs, etc)

Then update the readme page:

Describe alternatives you've considered

No response

Additional context

I think this is a good first issue as the task is straightforward and doesn't require deep understanding of the DataFusion codebase

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant