Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch #34381

Open
wants to merge 1 commit into
base: release-2.64
Choose a base branch
from

Conversation

liferoad
Copy link
Contributor

Tests run on GHA should be queued shortly.

@github-actions github-actions bot added the build label Mar 21, 2025
Copy link
Contributor

Test Results

12 files  + 10  12 suites  +10   1h 46m 51s ⏱️ + 1h 42m 37s
15 tests  - 389  15 ✅  - 300  0 💤  - 89  0 ❌ ±0 
15 runs   - 395  15 ✅  - 300  0 💤  - 95  0 ❌ ±0 

Results for commit 4dfd83f. ± Comparison against base commit efe443d.

Copy link
Contributor

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @Abacn for label build.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

@liferoad
Copy link
Contributor Author

liferoad commented Mar 21, 2025

https://github.com/apache/beam/actions/runs/13994865366/job/39187397050?pr=34381


:runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest FAILED |  
-- | --
  |   |  
  | org.apache.beam.sdk.io.gcp.bigtable.changestreams.it.BigtableChangeStreamIT > testComplexMutation FAILED |  
  | java.lang.RuntimeException at BigtableChangeStreamIT.java:279 |  
  |   |  
  | 171 tests completed, 1 failed, 33 skipped |  

<br class="Apple-interchange-newline">

@liferoad
Copy link
Contributor Author

https://github.com/apache/beam/actions/runs/13994865357/job/39187406687?pr=34381

FAIL
Error response from daemon: No such image: us.gcr.io/apache-beam-testing/github-actions/beam_go_sdk:20250321-151459

FAILURE: Build failed with an exception.

* Where:
Build file '/runner/_work/beam/beam/sdks/go/test/build.gradle' line: 36

* What went wrong:
Execution failed for task ':sdks:go:test:dataflowValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

@liferoad
Copy link
Contributor Author

org.apache.beam.sdk.io.gcp.datastore.V1ReadIT

java.lang.RuntimeException: Failed to create a workflow job: (a228cd0fe9f70479): The workflow could not be created. Causes: (8ac844dc41db82af): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 299 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
	at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:1571)
	at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:109)
	at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:101)
	at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:56)
	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:325)
	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
	at org.apache.beam.sdk.io.gcp.datastore.V1ReadIT.testE2EV1Read(V1ReadIT.java:125)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:112)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:40)
	at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:60)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:52)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
	at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:176)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:129)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:100)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:60)
	at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
	at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:113)
	at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:65)
	at worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
	at worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
POST https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs
{
  "code": 400,
  "errors": [
    {
      "domain": "global",
      "message": "(a228cd0fe9f70479): The workflow could not be created. Causes: (8ac844dc41db82af): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 299 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
      "reason": "failedPrecondition"
    }
  ],
  "message": "(a228cd0fe9f70479): The workflow could not be created. Causes: (8ac844dc41db82af): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 299 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
  "status": "FAILED_PRECONDITION"
}
	at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
	at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:118)
	at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:37)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:439)
	at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1111)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:525)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:466)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:576)
	at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:64)
	at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:1557)
	... 51 more

@liferoad
Copy link
Contributor Author

java.lang.IllegalAccessError: failed to access class org.apache.beam.vendor.grpc.v1p69p0.io.netty.util.collection.IntObjectHashMap$2 from class org.apache.beam.vendor.grpc.v1p69p0.io.netty.util.collection.IntObjectHashMap (org.apache.beam.vendor.grpc.v1p69p0.io.netty.util.collection.IntObjectHashMap$2 is in unnamed module of loader 'app'; org.apache.beam.vendor.grpc.v1p69p0.io.netty.util.collection.IntObjectHashMap is in unnamed module of loader org.apache.flink.util.ChildFirstClassLoader @63b49936)
	at org.apache.beam.vendor.grpc.v1p69p0.io.netty.util.collection.IntObjectHashMap.values(IntObjectHashMap.java:221)
	at org.apache.beam.vendor.grpc.v1p69p0.io.netty.channel.epoll.EpollEventLoop.closeAll(EpollEventLoop.java:454)
	at org.apache.beam.vendor.grpc.v1p69p0.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:422)
	at org.apache.beam.vendor.grpc.v1p69p0.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:994)
	at org.apache.beam.vendor.grpc.v1p69p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at org.apache.beam.vendor.grpc.v1p69p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:829)

https://github.com/apache/beam/actions/runs/13994865351/job/39187406885?pr=34381

@liferoad
Copy link
Contributor Author

liferoad commented Mar 22, 2025

https://github.com/apache/beam/actions/runs/13994865212/job/39212015053?pr=34381

testE2EJpms

https://console.cloud.google.com/dataflow/jobs/us-central1/2025-03-21_16_37_31-1727973400811028777?project=apache-beam-testing

gcr.io/cloud-dataflow/v1beta3/beam_java11_sdk:2.64.0 does not exist yet.

"Error syncing pod, skipping" err="failed to \"StartContainer\" for \"sdk-0-0\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"gcr.io/cloud-dataflow/v1beta3/beam_java11_sdk:2.64.0\\\": failed to resolve reference \\\"gcr.io/cloud-dataflow/v1beta3/beam_java11_sdk:2.64.0\\\": gcr.io/cloud-dataflow/v1beta3/beam_java11_sdk:2.64.0: not found\"" pod="default/df-testpipeline-runner-03212-03211637-mdmw-harness-dt6q" podUID="5574c65a3624cdf9f9619a0cdbf1c68a"
java.lang.RuntimeException: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. Please check the worker logs in Stackdriver Logging. You can also get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. Please check the worker logs in Stackdriver Logging. You can also get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
	at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:149)
	at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:101)
	at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:56)
	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:325)
	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
	at org.apache.beam.sdk.jpmstests.WordCount.runWordCount(WordCount.java:136)
	at org.apache.beam.sdk.jpmstests.JpmsIT.testE2EJpms(JpmsIT.java:63)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:112)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:40)
	at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:60)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:52)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
	at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:176)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:129)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:100)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:60)
	at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
	at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:113)
	at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:65)
	at worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
	at worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)

@liferoad
Copy link
Contributor Author

liferoad commented Mar 22, 2025

Tests that need the released Beam 2.64.0 container images

  • .github/workflows/beam_PostCommit_Java_Nexmark_Dataflow_V2.yml

PostCommit Java Nexmark Dataflow V2

https://github.com/apache/beam/actions/runs/13994865286/job/39212202476?pr=34381

"PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"gcr.io/cloud-dataflow/v1beta3/beam-java11-streaming:2.64.0\": failed to resolve reference \"gcr.io/cloud-dataflow/v1beta3/beam-java11-streaming:2.64.0\": gcr.io/cloud-dataflow/v1beta3/beam-java11-streaming:2.64.0: not found" image="gcr.io/cloud-dataflow/v1beta3/beam-java11-streaming:2.64.0"

PostCommit Java Jpms Dataflow Java11

  • .github/workflows/beam_PostCommit_Java_Nexmark_Dataflow.yml

PostCommit Java Nexmark Dataflow

https://github.com/apache/beam/actions/runs/13994865325/job/39212195565?pr=34381

"Error syncing pod, skipping" err="failed to \"StartContainer\" for \"java-streaming\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/cloud-dataflow/v1beta3/beam-java11-streaming:2.64.0\\\"\"" pod="default/df-main-runner-0321234437-85-03211644-mewn-harness-bkq4" podUID=adbdcc4eea4b68c3c2c5d07ad6f44d3e
  • .github/workflows/beam_PostCommit_Java_IO_Performance_Tests.yml
image

Job ID: 2025-03-22_05_07_45-1128832772628514278

https://github.com/apache/beam/actions/runs/13994865214/job/39225068094?pr=34381

"Error syncing pod, skipping" err="failed to \"StartContainer\" for \"sdk-0-0\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/cloud-dataflow/v1beta3/beam_java11_sdk:2.64.0\\\"\"" pod="default/df-write-bigtable-2025032212-03220507-st8e-harness-dsck" podUID="12fc164ef7abef3f061560f71f157acf"

@liferoad
Copy link
Contributor Author

liferoad commented Mar 22, 2025

beam_PostCommit_Java_ValidatesRunner_Dataflow_V2_Streaming (Run Java Dataflow V2 ValidatesRunner Streaming)

https://github.com/apache/beam/blob/master/.github/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_V2_Streaming.yml

This keeps failing:
image

PipelineTest. testTupleProjectionTransform
SplittableDoFnTest. testPairWithIndexWindowedTimestampedUnbounded
ViewTest. testListSideInputIsImmutable
WindowTest. testMergingCustomWindowsKeyedCollection

With the same reason:

java.lang.RuntimeException: Dataflow job 2025-03-21_19_06_42-16180370250251748615 terminated in state RUNNING but did not return a failure reason.

Job ids:

2025-03-21_16_59_25-3005941218772119290

2025-03-21_23_09_25-5369433044782477434

2025-03-21_23_09_25-5369433044782477434

2025-03-21_19_06_42-16180370250251748615

@liferoad
Copy link
Contributor Author

https://github.com/apache/beam/blob/master/.github/workflows/beam_PostCommit_TransformService_Direct.yml fails with the release branch due to #34375. Will not cherry pick this since it is just related to the test changes.

# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant