beam-builds mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Build failed in Jenkins: beam_PostCommit_Java_PortabilityApi #576
Date Thu, 03 Jan 2019 01:04:22 GMT
See <https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi/576/display/redirect?page=changes>

Changes:

[ehudm] [BEAM-5959] Add performance testing for writing many files

------------------------------------------
[...truncated 1.62 MB...]
    INFO: 2019-01-03T00:28:53.323Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Create
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:53.377Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Create
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:53.401Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:53.440Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:54.395Z: Executing operation BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:54.433Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Pair
with random key+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:54.470Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:54.506Z: Executing operation BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:54.556Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:54.596Z: Executing operation BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:54.630Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jan 03, 2019 12:29:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:28:54.679Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Jan 03, 2019 12:29:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:29:14.986Z: Autoscaling: Raised the number of workers to 0 based on
the rate of progress in the currently running step(s).
    Jan 03, 2019 12:29:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:29:49.079Z: Autoscaling: Raised the number of workers to 1 based on
the rate of progress in the currently running step(s).
    Jan 03, 2019 12:29:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:29:49.113Z: Autoscaling: Would further reduce the number of workers
but reached the minimum number allowed for the job.
    Jan 03, 2019 12:30:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:30:06.604Z: Workers have started successfully.
    Jan 03, 2019 12:30:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:30:06.636Z: Workers have started successfully.
    Jan 03, 2019 12:30:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:30:29.787Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Jan 03, 2019 12:30:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:30:32.273Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Jan 03, 2019 12:30:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:30:32.369Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
    Jan 03, 2019 12:30:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:30:34.645Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Jan 03, 2019 12:32:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:35.428Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Jan 03, 2019 12:32:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:40.839Z: Executing operation BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Jan 03, 2019 12:32:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:43.287Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Jan 03, 2019 12:32:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:45.661Z: Executing operation BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Jan 03, 2019 12:32:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:45.745Z: Executing operation BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/ParDo(ReadFromBoundedSource)+DropInputs
    Jan 03, 2019 12:32:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:50.891Z: Executing operation BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Jan 03, 2019 12:32:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:51.018Z: Executing operation BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/CreateJobId+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
    Jan 03, 2019 12:32:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:51.292Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
    Jan 03, 2019 12:32:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:51.407Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
    Jan 03, 2019 12:32:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:59.089Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
    Jan 03, 2019 12:32:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:32:59.184Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
    Jan 03, 2019 12:33:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:01.785Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
    Jan 03, 2019 12:33:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:01.881Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
    Jan 03, 2019 12:33:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:08.932Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
    Jan 03, 2019 12:33:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:09.033Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
    Jan 03, 2019 12:33:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:11.236Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
    Jan 03, 2019 12:33:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:13.400Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
    Jan 03, 2019 12:33:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:13.630Z: Executing operation BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/GetTempFilePrefix+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
    Jan 03, 2019 12:33:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:17.354Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
    Jan 03, 2019 12:33:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:17.451Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
    Jan 03, 2019 12:33:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:20.531Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
    Jan 03, 2019 12:33:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:20.636Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
    Jan 03, 2019 12:33:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:27.119Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
    Jan 03, 2019 12:33:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:27.336Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write+BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/rewindowIntoGlobal/Window.Assign+BigQueryIO.Write/BatchLoads/WriteBundlesToFiles+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write+BigQueryIO.Write/BatchLoads/GroupByDestination/Reify+BigQueryIO.Write/BatchLoads/GroupByDestination/Write
    Jan 03, 2019 12:33:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:31.713Z: Executing operation BigQueryIO.Write/BatchLoads/GroupByDestination/Close
    Jan 03, 2019 12:33:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:31.759Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
    Jan 03, 2019 12:33:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:31.808Z: Executing operation BigQueryIO.Write/BatchLoads/GroupByDestination/Read+BigQueryIO.Write/BatchLoads/GroupByDestination/GroupByWindow+BigQueryIO.Write/BatchLoads/WriteGroupedRecords+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
    Jan 03, 2019 12:33:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:31.851Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
    Jan 03, 2019 12:33:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:33.018Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
    Jan 03, 2019 12:33:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:33.128Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
    Jan 03, 2019 12:33:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:35.462Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/Materialize
    Jan 03, 2019 12:33:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:35.679Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Cleanup
    Jan 03, 2019 12:33:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:42.386Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/Materialize
    Jan 03, 2019 12:33:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:42.628Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyResults/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WritePartitionUntriggered+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Write+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Write
    Jan 03, 2019 12:33:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:45.313Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Close
    Jan 03, 2019 12:33:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:45.364Z: Executing operation BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Close
    Jan 03, 2019 12:33:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:45.420Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Write+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
    Jan 03, 2019 12:33:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:45.468Z: Executing operation BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Write
    Jan 03, 2019 12:33:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:50.274Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Close
    Jan 03, 2019 12:33:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:50.321Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
    Jan 03, 2019 12:33:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:50.386Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles)
    Jan 03, 2019 12:33:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:50.462Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
    Jan 03, 2019 12:33:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:53.269Z: Executing operation BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Close
    Jan 03, 2019 12:33:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:53.381Z: Executing operation BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParDo(GarbageCollectTemporaryFiles)
    Jan 03, 2019 12:33:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:55.463Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/Materialize
    Jan 03, 2019 12:33:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:55.684Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WriteRenameUntriggered
    Jan 03, 2019 12:34:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:59.528Z: Cleaning up.
    Jan 03, 2019 12:34:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:33:59.682Z: Stopping worker pool...
    Jan 03, 2019 12:36:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:36:15.948Z: Autoscaling: Resized worker pool from 1 to 0.
    Jan 03, 2019 12:36:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:36:16.011Z: Autoscaling: Would further reduce the number of workers
but reached the minimum number allowed for the job.
    Jan 03, 2019 12:36:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T00:36:16.065Z: Worker pool stopped.
    Jan 03, 2019 12:36:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
    INFO: Job 2019-01-02_16_28_30-17482769681792707496 finished with status DONE.
    Jan 03, 2019 12:36:24 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
    INFO: Success result for Dataflow job 2019-01-02_16_28_30-17482769681792707496. Found
0 success, 0 failures out of 0 expected assertions.
    Jan 03, 2019 12:36:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
    INFO: Job 2019-01-02_16_28_30-17482769681792707496 finished with status DONE.
    Jan 03, 2019 12:36:24 AM org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT verifyLegacyQueryRes
    INFO: Starting verifyLegacyQueryRes in outputTable apache-beam-testing:bq_query_to_table_1546475298552_484.output_table
    Jan 03, 2019 12:36:25 AM org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT verifyLegacyQueryRes
    INFO: Finished to query result table apache-beam-testing:bq_query_to_table_1546475298552_484.output_table
    Jan 03, 2019 12:36:25 AM org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT cleanBqEnvironment
    INFO: Start to clean up tables and datasets.
    Jan 03, 2019 12:36:25 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient deleteTable
    INFO: Successfully deleted table: output_table
    Jan 03, 2019 12:36:25 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient deleteDataset
    INFO: Successfully deleted dataset: bq_query_to_table_1546475298552_484

Gradle Test Executor 5 finished executing tests.

> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest

org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT > testE2EBigtableWrite STANDARD_ERROR
    Jan 03, 2019 1:02:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    SEVERE: 2019-01-03T01:02:15.824Z: Workflow failed. Causes: The Dataflow job appears to
be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud
Dataflow at https://cloud.google.com/dataflow/support.
    Jan 03, 2019 1:02:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T01:02:15.965Z: Cancel request is committed for workflow job: 2019-01-02_16_02_05-5789785114149995680.
    Jan 03, 2019 1:02:16 AM org.apache.beam.runners.dataflow.TestDataflowRunner$ErrorMonitorMessagesHandler
process
    INFO: Dataflow job 2019-01-02_16_02_05-5789785114149995680 threw exception. Failure message
was: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity
has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
    Jan 03, 2019 1:02:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T01:02:16.054Z: Cleaning up.
    Jan 03, 2019 1:02:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T01:02:16.169Z: Stopping worker pool...
    Jan 03, 2019 1:04:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T01:04:12.842Z: Autoscaling: Reduced the number of workers to 0 based
on the rate of progress in the currently running step(s).
    Jan 03, 2019 1:04:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
process
    INFO: 2019-01-03T01:04:12.895Z: Worker pool stopped.
    Jan 03, 2019 1:04:17 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
    INFO: Job 2019-01-02_16_02_05-5789785114149995680 failed with status FAILED.
    Jan 03, 2019 1:04:18 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
    INFO: Success result for Dataflow job 2019-01-02_16_02_05-5789785114149995680. Found 0
success, 0 failures out of 0 expected assertions.
    Jan 03, 2019 1:04:18 AM com.google.cloud.bigtable.grpc.io.OAuthCredentialsCache info
    INFO: Refreshing the OAuth token

Gradle Test Executor 3 finished executing tests.

> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest
FAILED

org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT > testE2EBigtableWrite FAILED
    java.lang.RuntimeException: Workflow failed. Causes: The Dataflow job appears to be stuck
because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow
at https://cloud.google.com/dataflow/support.
        at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:134)
        at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90)
        at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)
        at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
        at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299)
        at org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT.testE2EBigtableWrite(BigtableWriteIT.java:130)

7 tests completed, 1 failed
Finished generating test XML results (0.029 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformFnApiWorkerIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.023 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformFnApiWorkerIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest (Thread[Task
worker for ':' Thread 6,5,main]) completed. Took 1 hrs 2 mins 40.703 secs.
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task worker for ':' Thread
6,5,main]) started.

> Task :beam-runners-google-cloud-dataflow-java:cleanUpDockerImages
Caching disabled for task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages':
Caching has not been enabled for the task
Task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages' is not up-to-date because:
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi/ws/src/runners/google-cloud-dataflow-java>
Command: docker rmi us.gcr.io/apache-beam-testing/java-postcommit-it/java:20190102234638
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20190102234638
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7751664f4cdd9d0bac223398d2bcb84dbdab29b20ac59d8787e58fc9a887e947
Starting process 'command 'gcloud''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi/ws/src/runners/google-cloud-dataflow-java>
Command: gcloud --quiet container images delete --force-delete-tags us.gcr.io/apache-beam-testing/java-postcommit-it/java:20190102234638
Successfully started process 'command 'gcloud''
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7751664f4cdd9d0bac223398d2bcb84dbdab29b20ac59d8787e58fc9a887e947
  Associated tags:
 - 20190102234638
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20190102234638
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20190102234638].
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7751664f4cdd9d0bac223398d2bcb84dbdab29b20ac59d8787e58fc9a887e947].
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task worker for ':' Thread
6,5,main]) completed. Took 2.257 secs.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformFnApiWorkerIntegrationTest/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log
output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 17m 54s
90 actionable tasks: 84 executed, 5 from cache, 1 up-to-date

Publishing build scan...
https://gradle.com/s/blb2shc2suaa2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Mime
View raw message