beam-builds mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #3120
Date Fri, 08 Jan 2021 00:16:21 GMT
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3120/display/redirect?page=changes>

Changes:

[dcavazos] [BEAM-10983] Add getting started from Spark page

[dcavazos] Add "From Apache Spark" entry to side menu

[dcavazos] Add links to transform catalog

[dcavazos] Add more links

[dcavazos] Add RDD/DataFrame clarification

[dcavazos] Add link to from-spark page

[dcavazos] Added extra explanations

[dcavazos] Fixed typos + removed italics

[Kyle Weaver] [BEAM-11504] Clean up direct runner parallelism section.

[Robert Bradshaw] [BEAM-1833] Give transforms more control over the names of their inputs

[Ismaël Mejía] [BEAM-11419] Update Flink supported versions in the website

[noreply] Clarify some assertions (#13515)

[Robert Bradshaw] mypy

[noreply] Revert "[BEAM-11474] Track transform processing thread in Java SDK


------------------------------------------
[...truncated 399.93 KB...]
INFO: Partition (1/1) (3701221938c9e4f88004699b98e97197) switched from DEPLOYING to RUNNING.
Jan 08, 2021 12:15:59 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap
at ExtractOutput[0]) (1/1) (32b84457b2c468854ff249e71f0e396d) switched from DEPLOYING to RUNNING.
Jan 08, 2021 12:15:59 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1) (a354e8688568c8284b6b2edee025a32f)
switched from DEPLOYING to RUNNING.
Jan 08, 2021 12:15:59 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2957>))
-> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (a62ab1ce10858908ff54bd53277252ff) switched
from DEPLOYING to RUNNING.
Jan 08, 2021 12:15:59 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine
at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1) (803924348a725c3ef70cd80f9e6d29f7)
switched from DEPLOYING to RUNNING.
Jan 08, 2021 12:16:00 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSource (Impulse) (1/1)#0 (bcb91f99ed9b6b7896100d8759bb16e3) switched from RUNNING
to FINISHED.
Jan 08, 2021 12:16:00 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSource (Impulse) (1/1)#0 (150b04ad5a2c93eed919b88aa432c874) switched from RUNNING
to FINISHED.
Jan 08, 2021 12:16:00 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSource (Impulse) (1/1)#0 (bcb91f99ed9b6b7896100d8759bb16e3).
Jan 08, 2021 12:16:00 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSource (Impulse) (1/1)#0 (150b04ad5a2c93eed919b88aa432c874).
Jan 08, 2021 12:16:00 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task
DataSource (Impulse) (1/1)#0 bcb91f99ed9b6b7896100d8759bb16e3.
Jan 08, 2021 12:16:00 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task
DataSource (Impulse) (1/1)#0 150b04ad5a2c93eed919b88aa432c874.
Jan 08, 2021 12:16:00 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSource (Impulse) (1/1) (bcb91f99ed9b6b7896100d8759bb16e3) switched from RUNNING
to FINISHED.
Jan 08, 2021 12:16:00 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSource (Impulse) (1/1) (150b04ad5a2c93eed919b88aa432c874) switched from RUNNING
to FINISHED.
Jan 08, 2021 12:16:01 AM org.apache.beam.runners.fnexecution.environment.DockerCommand runImage
WARNING: Unable to pull docker image apache/beam_python3.7_sdk:2.28.0.dev, cause: Received
exit code 1 for command 'docker pull apache/beam_python3.7_sdk:2.28.0.dev'. stderr: Error
response from daemon: manifest for apache/beam_python3.7_sdk:2.28.0.dev not found
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService logging
INFO: Beam Fn Logging client connected.
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Logging handler created.
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: semi_persistent_directory: /tmp
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Status HTTP server running at localhost:35125
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
WARNING: Discarding unparseable args: ['--app_name=None', '--direct_runner_use_stacked_bundle',
'--job_server_timeout=60', '--options_id=1', '--parallelism=1', '--pipeline_type_check'] 
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Python sdk harness started with pipeline_options: {'job_name': 'BeamApp-jenkins-0108001554-dbf4880f',
'experiments': ['beam_fn_api'], 'save_main_session': True, 'sdk_location': 'container', 'environment_type':
'DOCKER', 'environment_options': ['docker_container_image=apache/beam_python3.7_sdk:2.28.0.dev'],
'sdk_worker_parallelism': '1', 'environment_cache_millis': '0', 'flink_job_server_jar': '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.12/job-server/build/libs/beam-runners-flink-1.12-job-server-2.28.0-SNAPSHOT.jar',>
'flink_submit_uber_jar': True}
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating state cache with size 0
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure control channel for localhost:39303.
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Control channel established.
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Initializing SDKHarness with unbounded number of workers.
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
control
INFO: Beam Fn Control client connected with id 1-1
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-2
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-5
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-3
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-4
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure state channel for localhost:36737.
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: State channel established.
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating client data channel for localhost:44913
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO: Beam Fn Data client connected.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap
at ExtractOutput[0]) (1/1)#0 (32b84457b2c468854ff249e71f0e396d) switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [4]assert_that/{Create,
Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (32b84457b2c468854ff249e71f0e396d).
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2957>))
-> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (a62ab1ce10858908ff54bd53277252ff) switched
from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task
CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap
at ExtractOutput[0]) (1/1)#0 32b84457b2c468854ff249e71f0e396d.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda
at core.py:2957>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (a62ab1ce10858908ff54bd53277252ff).
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: Partition (1/1)#0 (3701221938c9e4f88004699b98e97197) switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for Partition (1/1)#0 (3701221938c9e4f88004699b98e97197).
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task
CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2957>)) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 a62ab1ce10858908ff54bd53277252ff.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task
Partition (1/1)#0 3701221938c9e4f88004699b98e97197.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (3edafec3d6d6a07a5a86741128b64706)
switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda
at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0
(3edafec3d6d6a07a5a86741128b64706).
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task
CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 3edafec3d6d6a07a5a86741128b64706.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine
at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)#0 (803924348a725c3ef70cd80f9e6d29f7)
switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor)
(1/1)#0 (803924348a725c3ef70cd80f9e6d29f7).
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task
CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)#0 803924348a725c3ef70cd80f9e6d29f7.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)#0 (a354e8688568c8284b6b2edee025a32f)
switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/GroupByKey)
(1/1)#0 (a354e8688568c8284b6b2edee025a32f).
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task
GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)#0 a354e8688568c8284b6b2edee025a32f.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap
at ExtractOutput[0]) (1/1) (32b84457b2c468854ff249e71f0e396d) switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2957>))
-> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (a62ab1ce10858908ff54bd53277252ff) switched
from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (3701221938c9e4f88004699b98e97197) switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (3edafec3d6d6a07a5a86741128b64706)
switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine
at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1) (803924348a725c3ef70cd80f9e6d29f7)
switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1) (a354e8688568c8284b6b2edee025a32f)
switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient
unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.7_sdk:2.28.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.28.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
dependencies {
  type_urn: "beam:artifact:type:file:v1"
  type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-bcf1411b-cd16-42af-a5f7-841bdbc7e40b/b3922f09cb5cffa04a4fa3ef1e1891abbbd7885320a69858f3e40619e9977cb2-pickled_main_session"
  role_urn: "beam:artifact:role:staging_to:v1"
  role_payload: "\n\024pickled_main_session"
}

Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Jan 08, 2021 12:16:15 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver
onCompleted
WARNING: Hanged up for unknown endpoint.
Jan 08, 2021 12:16:15 AM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment
close
INFO: Closing Docker container 831d7e870a13093a992af443b648da367f1d9357d4f02fdaed891e0202600fca.
Logs:
2021/01/08 00:16:13 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:artifact_port:v1"
 value:{string_value:"0"}}  fields:{key:"beam:option:beam_services:v1"  value:{struct_value:{}}}
 fields:{key:"beam:option:dataflow_endpoint:v1"  value:{string_value:"https://dataflow.googleapis.com"}}
 fields:{key:"beam:option:direct_num_workers:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:direct_runner_bundle_repeat:v1"
 value:{string_value:"0"}}  fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1"
 value:{bool_value:true}}  fields:{key:"beam:option:direct_running_mode:v1"  value:{string_value:"in_memory"}}
 fields:{key:"beam:option:dry_run:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_streaming_engine:v1"
 value:{bool_value:false}}  fields:{key:"beam:option:environment_cache_millis:v1"  value:{string_value:"0"}}
 fields:{key:"beam:option:environment_options:v1"  value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.7_sdk:2.28.0.dev"}}}}
 fields:{key:"beam:option:environment_type:v1"  value:{string_value:"DOCKER"}}  fields:{key:"beam:option:expansion_port:v1"
 value:{string_value:"0"}}  fields:{key:"beam:option:experiments:v1"  value:{list_value:{values:{string_value:"beam_fn_api"}}}}
 fields:{key:"beam:option:flink_job_server_jar:v1"  value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.12/job-server/build/libs/beam-runners-flink-1.12-job-server-2.28.0-SNAPSHOT.jar"}}>
 fields:{key:"beam:option:flink_master:v1"  value:{string_value:"[auto]"}}  fields:{key:"beam:option:flink_submit_uber_jar:v1"
 value:{bool_value:true}}  fields:{key:"beam:option:flink_version:v1"  value:{string_value:"1.10"}}
 fields:{key:"beam:option:hdfs_full_urls:v1"  value:{bool_value:false}}  fields:{key:"beam:option:job_name:v1"
 value:{string_value:"BeamApp-jenkins-0108001554-dbf4880f"}}  fields:{key:"beam:option:job_port:v1"
 value:{string_value:"0"}}  fields:{key:"beam:option:job_server_java_launcher:v1"  value:{string_value:"java"}}
 fields:{key:"beam:option:job_server_jvm_properties:v1"  value:{list_value:{}}}  fields:{key:"beam:option:job_server_timeout:v1"
 value:{string_value:"60"}}  fields:{key:"beam:option:no_auth:v1"  value:{bool_value:false}}
 fields:{key:"beam:option:options_id:v1"  value:{number_value:1}}  fields:{key:"beam:option:parallelism:v1"
 value:{string_value:"1"}}  fields:{key:"beam:option:performance_runtime_type_check:v1"  value:{bool_value:false}}
 fields:{key:"beam:option:pipeline_type_check:v1"  value:{bool_value:true}}  fields:{key:"beam:option:profile_cpu:v1"
 value:{bool_value:false}}  fields:{key:"beam:option:profile_memory:v1"  value:{bool_value:false}}
 fields:{key:"beam:option:profile_sample_rate:v1"  value:{number_value:1}}  fields:{key:"beam:option:runtime_type_check:v1"
 value:{bool_value:false}}  fields:{key:"beam:option:s3_disable_ssl:v1"  value:{bool_value:false}}
 fields:{key:"beam:option:save_main_session:v1"  value:{bool_value:true}}  fields:{key:"beam:option:sdk_location:v1"
 value:{string_value:"container"}}  fields:{key:"beam:option:sdk_worker_parallelism:v1"  value:{string_value:"1"}}
 fields:{key:"beam:option:spark_master_url:v1"  value:{string_value:"local[4]"}}  fields:{key:"beam:option:spark_submit_uber_jar:v1"
 value:{bool_value:false}}  fields:{key:"beam:option:streaming:v1"  value:{bool_value:false}}
 fields:{key:"beam:option:type_check_additional:v1"  value:{string_value:""}}  fields:{key:"beam:option:type_check_strictness:v1"
 value:{string_value:"DEFAULT_TO_ANY"}}  fields:{key:"beam:option:update:v1"  value:{bool_value:false}}}
 retrieval_token:"__no_artifacts_staged__"  logging_endpoint:{url:"localhost:39747"}  artifact_endpoint:{url:"localhost:35995"}
 control_endpoint:{url:"localhost:39303"}  dependencies:{type_urn:"beam:artifact:type:file:v1"
 type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-bcf1411b-cd16-42af-a5f7-841bdbc7e40b/b3922f09cb5cffa04a4fa3ef1e1891abbbd7885320a69858f3e40619e9977cb2-pickled_main_session"
 role_urn:"beam:artifact:role:staging_to:v1"  role_payload:"\n\x14pickled_main_session"}
2021/01/08 00:16:13 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:40407
2021/01/08 00:16:13 Found artifact: pickled_main_session
2021/01/08 00:16:13 Installing setup packages ...
2021/01/08 00:16:13 Executing: python -m apache_beam.runners.worker.sdk_worker_main
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 (1ed458e344e23c3322efa0bc08e10b15)
switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (a0afe3e0a5217b9220b15332687efb75) switched from
RUNNING to FINISHED.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [3]assert_that/{Group, Unkey,
Match}) (1/1)#0 (1ed458e344e23c3322efa0bc08e10b15).
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (a0afe3e0a5217b9220b15332687efb75).
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task
MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 1ed458e344e23c3322efa0bc08e10b15.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task
DataSink (DiscardingOutput) (1/1)#0 a0afe3e0a5217b9220b15332687efb75.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1) (1ed458e344e23c3322efa0bc08e10b15)
switched from RUNNING to FINISHED.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (a0afe3e0a5217b9220b15332687efb75) switched from RUNNING
to FINISHED.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0108001554-dbf4880f (1f6e535572d9b307f5957ffe27676a6f) switched
from state RUNNING to FINISHED.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedGloballyTerminalState
INFO: Job 1f6e535572d9b307f5957ffe27676a6f reached globally terminal state FINISHED.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0108001554-dbf4880f(1f6e535572d9b307f5957ffe27676a6f).
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl suspend
INFO: Suspending SlotPool.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 2350ee72449a11645bc9bb8dded1b5c5: Stopping JobMaster
for job BeamApp-jenkins-0108001554-dbf4880f(1f6e535572d9b307f5957ffe27676a6f)..
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl close
INFO: Stopping SlotPool.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{managedMemory=128.000mb
(134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: 0aeea824759a8fae53d0a5a171a402e0,
jobId: 1f6e535572d9b307f5957ffe27676a6f).
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager a019c574edeeef2d29581c9891a34b7a@akka://flink/user/rpc/jobmanager_3
for job 1f6e535572d9b307f5957ffe27676a6f from the resource manager.
Jan 08, 2021 12:16:16 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job 1f6e535572d9b307f5957ffe27676a6f from job leader monitoring.
Jan 08, 2021 12:16:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 1f6e535572d9b307f5957ffe27676a6f.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

kill %1 || echo "Failed to shut down Flink mini cluster"

rm -rf "$ENV_DIR"

>>> SUCCESS
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 203

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 203

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.7.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 54s
160 actionable tasks: 118 executed, 39 from cache, 3 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/scjdo2qk7qore

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Mime
View raw message