beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Build failed in Jenkins: beam_PerformanceTests_Python #570
Date Sat, 18 Nov 2017 06:08:49 GMT
See <https://builds.apache.org/job/beam_PerformanceTests_Python/570/display/redirect?page=changes>

Changes:

[kedin] [Nexmark] Extract GeneratorCheckpoint into a separate class. Move

[kedin] [Nexmark] Extract PersonGenerator, StringsGenerator, LongGenerator from

[kedin] [Nexmark] Extract AuctionGenerator, PriceGenerator from Generator

[kedin] [Nexmark] Extract BidGenerator from Generator

[lcwik] Move AVRO files to avro source location

[lcwik] Initial gradle build definitions for all java based modules which is

[lcwik] Add license headers to all build.gradle files.

[lcwik] Add provided scope plugin and migrate compileOnly/testCompileOnly to

[lcwik] Add the ability to list dependencies recursively. Also ban the

[lcwik] Update comments

[lcwik] Configure the checkstyle plugin

[lcwik] Add support to run the Apache Rat plugin Add gradle generated files to

[lcwik] Adding Python gradle changes

[lcwik] Fix python tasks to not re-use the default gradle lifecycle names.

[lcwik] Add test task dependencies for testCython and testGcp and also add lint

[lcwik] Create build_rules file moving out specific plugins to them.

[lcwik] Add missing build_rules file.

[lcwik] Ignore test categories NeedsRunner, ValidatesRunner, and all *IT tests

[lcwik] Add code style validation and auto-formatting to Gradle build.

[lcwik] Add beam-sdks-java-core dependency to beam-local-artifact-service

[lcwik] Add gradle build for sdks/go

[lcwik] Get evaluation dependency order fixed because of dependency on

[lcwik] Update comments on root project

[lcwik] Set beamUseDummyRunner = true

[lcwik] Move spotless plugin to delegate config

[lcwik] Fix spotless config

[lcwik] Change hamcrest and junit to testCompile in

[lcwik] Add findbugs to the build

[lcwik] Add test to check phase

[lcwik] Filter resources to set dataflow environrment versions in

[lcwik] Force dependency resolution of common Java dependencies

[lcwik] Filter sdk.properties, set pom.version and build timestamp

[lcwik] Use dummy runner in tests in google-cloud-dataflow-java

[lcwik] Add test dependecy on beam-sdks-java-core to

[lcwik] Migrate findbugs to be configurable from the JavaNatureConfiguration

[lcwik] Setup several maven-surefire-plugin configurations

[lcwik] Remove added sdk-core dependencies because of

[lcwik] Fix provided scope in sdks/java/extensions/sorter

[lcwik] Ban hamcrest-all/mockito-all and migrate to hamcrest-core/mockito-core

[lcwik] Add gradle rule for python container

[lcwik] Fix python container gradle build

[lcwik] Fix hadoop-file-system test dependencies Explain why hcatalog is failing

[lcwik] Add license header to sdks/python/build.gradle

[lcwik] Get spark runner unit tests to pass.

[lcwik] Define the correct versions of apex-core Add comments to hcatalog/hbase

[lcwik] Simplify ApexYarnLauncher matching Attempt to create dependency tree

[lcwik] Enable configuraton on demand by default Get ApexYarnLauncher test to

[lcwik] Fix sdks/java/core testCompile dependency to bring in

[lcwik] Re-enable Python SDK

[lcwik] Disable findbugs within sdks/java/io/kafka to match findbugs

[lcwik] Add a task dependency visualization plugin. Resolve a spurious error

[lcwik] Fix classpath bundling issue caused by Hive and its dependencies

[lcwik] Define Tika dependencies version as variable

[lcwik] Rebase on apache/master and add new subprojects, update versions of

[lcwik] Skip test failures in hadoop related modules due to dependency

[lcwik] Add Jacoco plugin

[lcwik] Add Gradle builds for gcemd and gcsproxy

[lcwik] Add Java SDK Container Gradle build file

[lcwik] Create uber jar of the Java SDK harness and copy it into the location

[lcwik] Make docker tasks correctly depend on required build tasks

[lcwik] Fix runners/gcp/* go package paths

[lcwik] Add shadow configuration for sdks/java/core updating all other projects

[lcwik] Configure default shading profile on all java sub-projects to shade away

[lcwik] Shade direct-java and sql projects. Update repackaged locations to

[lcwik] Fix gcemd and gcsproxy builds. Fix whitespace formatting.

[lcwik] Enforce that gogradle dependency resolution/installation is done

[lcwik] Also ensure that resolving test dependencies are done sequentially with

[lcwik] Use valid repackage path on shadow relocations Fix Spark runners tests

[lcwik] Move user.avsc to directory which corresponds with namespace under

[lcwik] Add comments to various parts of build_rules.gradle

[lcwik] Fix excludes to correctly match the .idea/ directory.

[lcwik] Update build.gradle files to correspond with pom.xml changes within

[lcwik] Enable FFMP -> JavaCC path to generate Beam SQL parser for

[tgroh] Add a Local Java Core Module

[tgroh] Move StructuralKey to the local execution module

[tgroh] Add A TransformExecutorFactory

[chamikara] Clarify documentation on support for reading from/writing to time

------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
+refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 022e74460433e0ad9b44356229151c0d7b0af351 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 022e74460433e0ad9b44356229151c0d7b0af351
Commit message: "This closes #4147"
 > git rev-list f10399d7c374d0342fdac524c8a2ddf4d7ec5cd3 # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins2133352925076915801.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7168219796139475913.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins988525984695506756.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages
(from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from
-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt
(line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages
(from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages
(from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages
(from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages
(from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied: numpy in /home/jenkins/.local/lib/python2.7/site-packages (from
-r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages
(from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages
(from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages
(from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from
absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages
(from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages
(from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages
(from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages
(from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages
(from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line
25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages
(from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line
25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages
(from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages
(from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages
(from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages
(from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt
(line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages
(from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt
(line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages
(from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt
(line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages
(from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt
(line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages
(from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r
PerfKitBenchmarker/requirements.txt (line 25))
/usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:318:
SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension
to TLS is not available on this platform. This may cause the server to present an incorrect
TLS certificate, which can cause validation failures. You can upgrade to a newer version of
Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#snimissingwarning.
  SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:122:
InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3
from configuring SSL appropriately and may cause certain SSL connections to fail. You can
upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning.
  InsecurePlatformWarning
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins544213913297504256.sh
+ pip install --user -e 'sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: grpcio<2.0,>=1.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: oauth2client<4.0.0,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: protobuf<=3.3.0,>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: six<1.11,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: google-apitools<=0.5.11,>=0.5.10 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages
(from apache-beam==2.3.0.dev)
Requirement already satisfied: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from grpcio<2.0,>=1.0->apache-beam==2.3.0.dev)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages
(from grpcio<2.0,>=1.0->apache-beam==2.3.0.dev)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages
(from mock<3.0.0,>=1.0.1->apache-beam==2.3.0.dev)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages
(from mock<3.0.0,>=1.0.1->apache-beam==2.3.0.dev)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages
(from oauth2client<4.0.0,>=2.0.1->apache-beam==2.3.0.dev)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages
(from oauth2client<4.0.0,>=2.0.1->apache-beam==2.3.0.dev)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages
(from oauth2client<4.0.0,>=2.0.1->apache-beam==2.3.0.dev)
Requirement already satisfied: setuptools in /usr/lib/python2.7/dist-packages (from protobuf<=3.3.0,>=3.2.0->apache-beam==2.3.0.dev)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages
(from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.3.0.dev)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages
(from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages
(from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: proto-google-cloud-pubsub-v1[grpc]<0.16dev,>=0.15.4 in
/home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages
(from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages
(from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: requests<3.0dev,>=2.13.0 in /home/jenkins/.local/lib/python2.7/site-packages
(from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages
(from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages
(from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages
(from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages
(from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Installing collected packages: apache-beam
  Found existing installation: apache-beam 2.3.0.dev0
    Uninstalling apache-beam-2.3.0.dev0:
      Successfully uninstalled apache-beam-2.3.0.dev0
  Running setup.py develop for apache-beam
Successfully installed apache-beam
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7832708401297371404.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--bigquery_table=beam_performance.pkb_results --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2017-11-18 06:00:32,127 73ec6fc3 MainThread INFO     Verbose logging to: /tmp/perfkitbenchmarker/runs/73ec6fc3/pkb.log
2017-11-18 06:00:32,127 73ec6fc3 MainThread INFO     PerfKitBenchmarker version: v1.12.0-198-g903eb82
2017-11-18 06:00:32,128 73ec6fc3 MainThread INFO     Flag values:
--beam_sdk=python
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2017-11-18 06:00:32,379 73ec6fc3 MainThread WARNING  The key "flags" was not in the default
config, but was in user overrides. This may indicate a typo.
2017-11-18 06:00:32,379 73ec6fc3 MainThread INFO     Initializing the edw service decoder
2017-11-18 06:00:32,561 73ec6fc3 MainThread beam_integration_benchmark(1/1) INFO     Provisioning
resources for benchmark beam_integration_benchmark
2017-11-18 06:00:32,564 73ec6fc3 MainThread beam_integration_benchmark(1/1) INFO     Preparing
benchmark beam_integration_benchmark
2017-11-18 06:00:32,565 73ec6fc3 MainThread beam_integration_benchmark(1/1) INFO     Running:
git clone https://github.com/apache/beam.git
2017-11-18 06:00:39,075 73ec6fc3 MainThread beam_integration_benchmark(1/1) INFO     Running:
/home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true
-Pdataflow-runner
2017-11-18 06:08:21,383 73ec6fc3 MainThread beam_integration_benchmark(1/1) INFO     Running
benchmark beam_integration_benchmark
2017-11-18 06:08:21,397 73ec6fc3 MainThread beam_integration_benchmark(1/1) INFO     Running:
python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing"
"--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it"
"--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner
--sdk_location=/tmp/perfkitbenchmarker/runs/73ec6fc3/beam/sdks/python/target/apache-beam-2.3.0.dev.tar.gz
2017-11-18 06:08:21,700 73ec6fc3 MainThread beam_integration_benchmark(1/1) INFO     Ran python
setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing"
"--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it"
"--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner
--sdk_location=/tmp/perfkitbenchmarker/runs/73ec6fc3/beam/sdks/python/target/apache-beam-2.3.0.dev.tar.gz.
Got return code (1).
STDOUT: 
STDERR: /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option:
'python_requires'
  warnings.warn(msg)
/tmp/perfkitbenchmarker/runs/73ec6fc3/beam/sdks/python/nose-1.3.7-py2.7.egg/nose/plugins/manager.py:395:
RuntimeWarning: Unable to load plugin beam_test_plugin = test_config:BeamTestPlugin: (futures
3.0.5 (/home/jenkins/.local/lib/python2.7/site-packages), Requirement.parse('futures>=3.1.1,<4.0.0'))
  RuntimeWarning)
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
   or: setup.py --help [cmd1 cmd2 ...]
   or: setup.py --help-commands
   or: setup.py cmd --help

error: option --test-pipeline-options not recognized

2017-11-18 06:08:21,701 73ec6fc3 MainThread beam_integration_benchmark(1/1) ERROR    Error
during benchmark beam_integration_benchmark
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 584, in RunBenchmark
    DoRunPhase(spec, collector, detailed_timer)
  File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 495, in DoRunPhase
    samples = spec.BenchmarkRun(spec)
  File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",>
line 159, in Run
    job_type=job_type)
  File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",>
line 90, in SubmitJob
    assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2017-11-18 06:08:21,702 73ec6fc3 MainThread beam_integration_benchmark(1/1) INFO     Cleaning
up benchmark beam_integration_benchmark
2017-11-18 06:08:21,703 73ec6fc3 MainThread beam_integration_benchmark(1/1) ERROR    Benchmark
1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2017-11-18 06:08:21,749 73ec6fc3 MainThread INFO     Benchmark run statuses:
---------------------------------------------------------------
Name                        UID                          Status
---------------------------------------------------------------
beam_integration_benchmark  beam_integration_benchmark0  FAILED
---------------------------------------------------------------
Success rate: 0.00% (0/1)
2017-11-18 06:08:21,750 73ec6fc3 MainThread INFO     Complete logs can be found at: /tmp/perfkitbenchmarker/runs/73ec6fc3/pkb.log
2017-11-18 06:08:21,750 73ec6fc3 MainThread INFO     Completion statuses can be found at:
/tmp/perfkitbenchmarker/runs/73ec6fc3/completion_statuses.json
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user kedin@kedin-macbookpro.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user github@nakomis.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user ajamato@ajamato2016.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
ERROR: Unable to send to address: echauchot@gmail.com+jbonofre@apache.org
javax.mail.internet.AddressException: Domain contains illegal character in string ``echauchot@gmail.com+jbonofre@apache.org''
	at javax.mail.internet.InternetAddress.checkAddress(InternetAddress.java:1269)
	at javax.mail.internet.InternetAddress.parse(InternetAddress.java:1091)
	at javax.mail.internet.InternetAddress.parse(InternetAddress.java:633)
	at javax.mail.internet.InternetAddress.<init>(InternetAddress.java:111)
	at hudson.tasks.Mailer.stringToAddress(Mailer.java:206)
	at jenkins.plugins.mailer.tasks.MimeMessageBuilder.toNormalizedAddress(MimeMessageBuilder.java:309)
	at jenkins.plugins.mailer.tasks.MimeMessageBuilder.addRecipients(MimeMessageBuilder.java:168)
	at jenkins.plugins.mailer.tasks.MimeMessageBuilder.addRecipients(MimeMessageBuilder.java:160)
	at hudson.tasks.MailSender.createEmptyMail(MailSender.java:389)
	at hudson.tasks.MailSender.createFailureMail(MailSender.java:266)
	at hudson.tasks.MailSender.createMail(MailSender.java:181)
	at hudson.tasks.MailSender.run(MailSender.java:112)
	at hudson.tasks.Mailer.perform(Mailer.java:170)
	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:736)
	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:682)
	at hudson.model.Build$BuildExecution.post2(Build.java:186)
	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:627)
	at hudson.model.Run.execute(Run.java:1762)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:419)

Mime
View raw message