Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[prism] Java FlattenTest.testFlattenMultipleCoders - worker crash #32930

Open
Tracked by #29650
lostluck opened this issue Oct 24, 2024 · 0 comments
Open
Tracked by #29650

[prism] Java FlattenTest.testFlattenMultipleCoders - worker crash #32930

lostluck opened this issue Oct 24, 2024 · 0 comments

Comments

@lostluck
Copy link
Contributor

lostluck commented Oct 24, 2024

org.apache.beam.sdk.transforms.FlattenTest.testFlattenMultipleCoders
and
org.apache.beam.sdk.transforms.FlattenTest.testFlattenWithDifferentInputAndOutputCoders2

Fail SDK side with a sort of crash or a stream corrupted issue. Likely there's something strange going on with coders.

Solved via full Flatten unzipping in the pipeline optimizer. which avoids the coder issue entirely/removes the flatten, or by investigating the root cause around the coder handling in the Java SDK.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant