Skip to content

[EPIC] Tracking issue of support substrait logical plan #8149

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Open
15 of 36 tasks
waynexia opened this issue Nov 13, 2023 · 2 comments
Open
15 of 36 tasks

[EPIC] Tracking issue of support substrait logical plan #8149

waynexia opened this issue Nov 13, 2023 · 2 comments
Labels
development-process Related to development process of DataFusion enhancement New feature or request substrait Changes to the substrait crate

Comments

@waynexia
Copy link
Member

waynexia commented Nov 13, 2023

Is your feature request related to a problem or challenge?

Tracks substrait support progress

The rough goal of this ticket is:

  • Support all basic operations that datafusion supports. I.e., reach the same coverage and functionalities as datafusion-proto
  • Can co-operate with one or two external systems, like spark-substrait.

Describe the solution you'd like

LogicalPlan

The following logical plans I think we don't need to support:

  • Statement
  • Analyze
  • Explain
  • Prepare
  • Dml
  • Ddl
  • Copy
  • DescribeTable

Expression

The following exprs I think we don't need to support:

  • OuterReferenceColumn
  • Placeholder

Types and scalar

Meet the spec

Test

Others

Things that need further verification:

  • Case-sensitivity for both consumer and producer

Describe alternatives you've considered

No response

Additional context

Substrait to DataFusion's physical plan is tracked at #5173

@waynexia waynexia added enhancement New feature or request development-process Related to development process of DataFusion substrait Changes to the substrait crate labels Nov 13, 2023
@alamb alamb changed the title tracking issue of supporting substrait logical plan [EPIC] Tracking issue of supporting substrait logical plan Nov 13, 2023
@alamb alamb changed the title [EPIC] Tracking issue of supporting substrait logical plan [EPIC] Tracking issue of support substrait logical plan Nov 13, 2023
@Blizzara
Copy link
Contributor

Values (and EmptyTable) is supported as of #10531 :)

@waynexia
Copy link
Member Author

Values (and EmptyTable) is supported as of #10531 :)

Updated. Thanks for implementing it!

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
development-process Related to development process of DataFusion enhancement New feature or request substrait Changes to the substrait crate
Projects
None yet
Development

No branches or pull requests

2 participants