See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/446/display/redirect?page=changes>
Changes:
[github] [BEAM-4030] Add compact attribute to combiners (#7405)
------------------------------------------
[...truncated 8.08 MB...]
INFO: Adding PAssert$13/GroupGlobally/GroupDummyAndContents as step s31
Jan 04, 2019 9:44:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$13/GroupGlobally/Values/Values/Map as step s32
Jan 04, 2019 9:44:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$13/GroupGlobally/ParDo(Concat) as step s33
Jan 04, 2019 9:44:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$13/GetPane/Map as step s34
Jan 04, 2019 9:44:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$13/RunChecks as step s35
Jan 04, 2019 9:44:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$13/VerifyAssertions/ParDo(DefaultConclude) as step s36
Jan 04, 2019 9:44:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-end-to-end-tests/flattentest0testflattenpcollectionsemptythenpardo-jenkins-0104214451-4ddd4202/output/results/staging/
Jan 04, 2019 9:45:00 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <77877 bytes, hash OJxL2Fqq8OK5bgRBGkApew> to gs://temp-storage-for-end-to-end-tests/flattentest0testflattenpcollectionsemptythenpardo-jenkins-0104214451-4ddd4202/output/results/staging/pipeline-OJxL2Fqq8OK5bgRBGkApew.pb
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_OUT
Dataflow SDK version: 2.10.0-SNAPSHOT
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_ERROR
Jan 04, 2019 9:45:01 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-04_13_45_00-4252070413451999358?project=apache-beam-testing
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_OUT
Submitted job: 2019-01-04_13_45_00-4252070413451999358
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_ERROR
Jan 04, 2019 9:45:01 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2019-01-04_13_45_00-4252070413451999358
Jan 04, 2019 9:45:01 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2019-01-04_13_45_00-4252070413451999358 with 0 expected assertions.
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:00.388Z: Autoscaling is enabled for job 2019-01-04_13_45_00-4252070413451999358.
The number of workers will be between 1 and 1000.
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:00.421Z: Autoscaling was automatically enabled for job 2019-01-04_13_45_00-4252070413451999358.
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
WARNING: 2019-01-04T21:45:03.014Z: The workflow name is not a valid Cloud Label. Labels
applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this
modified job name: flattentest0testflattenpcollectionsemptythenpardo-jenkins--r6m8. For the
best monitoring experience, please name your job with a valid Cloud Label. For details, see:
https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:03.337Z: Checking permissions granted to controller Service Account.
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:07.274Z: Worker configuration: n1-standard-1 in us-central1-b.
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:07.825Z: Expanding CollectionToSingleton operations into optimizable
parts.
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:07.913Z: Expanding CoGroupByKey operations into optimizable parts.
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.085Z: Expanding GroupByKey operations into optimizable parts.
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.146Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.183Z: Elided trivial flatten
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.218Z: Elided trivial flatten
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.254Z: Elided trivial flatten
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.292Z: Unzipping flatten s29 for input s17.org.apache.beam.sdk.values.PCollection.<init>:402#a4f9f304fed667ee
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.327Z: Fusing unzipped copy of PAssert$13/GroupGlobally/GroupDummyAndContents/Reify,
through flatten PAssert$13/GroupGlobally/FlattenDummyAndContents, into producer PAssert$13/GroupGlobally/KeyForDummy/AddKeys/Map
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.364Z: Fusing consumer PAssert$13/VerifyAssertions/ParDo(DefaultConclude)
into PAssert$13/RunChecks
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.400Z: Unzipping flatten s29-u40 for input s31-reify-value18-c38
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.450Z: Fusing unzipped copy of PAssert$13/GroupGlobally/GroupDummyAndContents/Write,
through flatten s29-u40, into producer PAssert$13/GroupGlobally/GroupDummyAndContents/Reify
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.481Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/GroupByWindow
into PAssert$13/GroupGlobally/GroupDummyAndContents/Read
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.521Z: Fusing consumer PAssert$13/GroupGlobally/Values/Values/Map
into PAssert$13/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.557Z: Fusing consumer PAssert$13/GetPane/Map into PAssert$13/GroupGlobally/ParDo(Concat)
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.601Z: Fusing consumer PAssert$13/RunChecks into PAssert$13/GetPane/Map
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.640Z: Fusing consumer PAssert$13/GroupGlobally/ParDo(Concat)
into PAssert$13/GroupGlobally/Values/Values/Map
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.677Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/Reify
into PAssert$13/GroupGlobally/WindowIntoDummy/Window.Assign
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.707Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/Write
into PAssert$13/GroupGlobally/GroupDummyAndContents/Reify
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.741Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with
random key
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.776Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.807Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
into PAssert$13/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.848Z: Fusing consumer PAssert$13/GroupGlobally/WindowIntoDummy/Window.Assign
into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.922Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.957Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:08.994Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Write
into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.031Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.060Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.115Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.156Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.185Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.262Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.298Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.323Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Values/Values/Map
into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.357Z: Fusing consumer PAssert$13/GroupGlobally/Window.Into()/Window.Assign
into ParDo(Identity)
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.395Z: Fusing consumer PAssert$13/GroupGlobally/RewindowActuals/Window.Assign
into PAssert$13/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.436Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.472Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.508Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key into Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.536Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
into PAssert$13/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.573Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.611Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
into PAssert$13/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.645Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
into PAssert$13/GroupGlobally/Window.Into()/Window.Assign
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.678Z: Fusing consumer PAssert$13/GroupGlobally/KeyForDummy/AddKeys/Map
into PAssert$13/GroupGlobally/RewindowActuals/Window.Assign
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.707Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.744Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
into Flatten.PCollections/Create.Values/Read(CreateSource)/Impulse
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.772Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Impulse
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.804Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:09.841Z: Fusing consumer ParDo(Identity) into Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:10.231Z: Executing operation PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:10.266Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:10.303Z: Executing operation PAssert$13/GroupGlobally/GroupDummyAndContents/Create
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:10.315Z: Starting 1 workers in us-central1-b...
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:10.326Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:10.526Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Impulse+Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jan 04, 2019 9:45:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:10.566Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Impulse+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jan 04, 2019 9:45:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:45:21.388Z: Autoscaling: Raised the number of workers to 0 based on
the rate of progress in the currently running step(s).
Jan 04, 2019 9:47:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:47:09.954Z: Autoscaling: Raised the number of workers to 1 based on
the rate of progress in the currently running step(s).
Jan 04, 2019 9:47:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:47:09.989Z: Autoscaling: Would further reduce the number of workers
but reached the minimum number allowed for the job.
Jan 04, 2019 9:47:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:47:38.002Z: Workers have started successfully.
Jan 04, 2019 9:47:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:47:38.046Z: Workers have started successfully.
Jan 04, 2019 9:48:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:48:01.392Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jan 04, 2019 9:48:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:48:01.479Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+PAssert$13/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$13/GroupGlobally/GroupDummyAndContents/Reify+PAssert$13/GroupGlobally/GroupDummyAndContents/Write
Jan 04, 2019 9:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:48:03.833Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jan 04, 2019 9:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:48:03.904Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+ParDo(Identity)+PAssert$13/GroupGlobally/Window.Into()/Window.Assign+PAssert$13/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$13/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$13/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jan 04, 2019 9:48:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:48:06.819Z: Executing operation PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jan 04, 2019 9:48:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:48:06.887Z: Executing operation PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$13/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$13/GroupGlobally/RewindowActuals/Window.Assign+PAssert$13/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$13/GroupGlobally/GroupDummyAndContents/Reify+PAssert$13/GroupGlobally/GroupDummyAndContents/Write
Jan 04, 2019 9:48:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:48:14.864Z: Executing operation PAssert$13/GroupGlobally/GroupDummyAndContents/Close
Jan 04, 2019 9:48:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:48:14.928Z: Executing operation PAssert$13/GroupGlobally/GroupDummyAndContents/Read+PAssert$13/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$13/GroupGlobally/Values/Values/Map+PAssert$13/GroupGlobally/ParDo(Concat)+PAssert$13/GetPane/Map+PAssert$13/RunChecks+PAssert$13/VerifyAssertions/ParDo(DefaultConclude)
Jan 04, 2019 9:48:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:48:22.456Z: Cleaning up.
Jan 04, 2019 9:48:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:48:22.549Z: Stopping worker pool...
Jan 04, 2019 9:50:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:50:25.766Z: Autoscaling: Resized worker pool from 1 to 0.
Jan 04, 2019 9:50:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:50:25.856Z: Autoscaling: Would further reduce the number of workers
but reached the minimum number allowed for the job.
Jan 04, 2019 9:50:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
INFO: 2019-01-04T21:50:25.902Z: Worker pool stopped.
Jan 04, 2019 9:50:31 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2019-01-04_13_45_00-4252070413451999358 finished with status DONE.
Jan 04, 2019 9:50:31 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2019-01-04_13_45_00-4252070413451999358. Found 0
success, 0 failures out of 0 expected assertions.
Gradle Test Executor 117 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest
FAILED
71 tests completed, 1 failed, 1 skipped
Finished generating test XML results (0.175 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerFnApiWorkerExecutableStageTest>
Generating HTML test report...
Finished generating test html results (0.244 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerExecutableStageTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest (Thread[Task
worker for ':' Thread 22,5,main]) completed. Took 1 hrs 2 mins 46.852 secs.
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task worker for ':' Thread
22,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:cleanUpDockerImages
Caching disabled for task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages':
Caching has not been enabled for the task
Task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java>
Command: docker rmi us.gcr.io/apache-beam-testing/java-postcommit-it/java:20190104204518
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20190104204518
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:602485c2fbc0146a6f4bdae2539d43e796b91f700880185defc3f81b9c22082a
Starting process 'command 'gcloud''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java>
Command: gcloud --quiet container images delete --force-delete-tags us.gcr.io/apache-beam-testing/java-postcommit-it/java:20190104204518
Successfully started process 'command 'gcloud''
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:602485c2fbc0146a6f4bdae2539d43e796b91f700880185defc3f81b9c22082a
Associated tags:
- 20190104204518
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20190104204518
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20190104204518].
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:602485c2fbc0146a6f4bdae2539d43e796b91f700880185defc3f81b9c22082a].
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task worker for ':' Thread
22,5,main]) completed. Took 2.505 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerExecutableStageTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log
output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 5m 29s
75 actionable tasks: 69 executed, 5 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/glg6mmpl4xkcy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
|