beam-builds mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #6770
Date Sun, 10 Jan 2021 00:09:17 GMT
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6770/display/redirect>

Changes:


------------------------------------------
[...truncated 402.53 KB...]
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
  0013  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
  0014  query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          76.8                    130223.6                    10000000             

  0001          62.2                    160766.5                     9200000             

  0002          53.8                    185994.6                       83527             

  0003  *** not run ***
  0004          66.0                     15151.3                         140             

  0005          77.1                    129621.0                        4567             

  0006          66.7                     14986.4                        8902             

  0007  *** not run ***
  0008          62.4                    160135.8                       92833             

  0009          66.9                     14953.0                       32548             

  0010          99.5                    100536.9                         100             

  0011          84.2                    118801.5                     1839657             

  0012          57.0                    175349.4                      199929             

  0013          70.5                    141922.5                     9200000             

  0014         127.6                     78377.3                     9200000             

==========================================================================================

2021-01-10T00:07:27.823Z no activity
2021-01-10T00:07:27.857Z DONE Query7

==========================================================================================
Run started 2021-01-10T00:02:35.007Z and ran for PT292.897S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
  0002  query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
  0013  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
  0014  query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          76.8                    130223.6                    10000000             

  0001          62.2                    160766.5                     9200000             

  0002          53.8                    185994.6                       83527             

  0003  *** not run ***
  0004          66.0                     15151.3                         140             

  0005          77.1                    129621.0                        4567             

  0006          66.7                     14986.4                        8902             

  0007         115.2                     86798.8                         100             

  0008          62.4                    160135.8                       92833             

  0009          66.9                     14953.0                       32548             

  0010          99.5                    100536.9                         100             

  0011          84.2                    118801.5                     1839657             

  0012          57.0                    175349.4                      199929             

  0013          70.5                    141922.5                     9200000             

  0014         127.6                     78377.3                     9200000             

==========================================================================================

2021-01-10T00:07:42.973Z RUNNING Query3
Jan 10, 2021 12:07:43 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query3.Results
Jan 10, 2021 12:07:43 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query3.Results
2021-01-10T00:07:43.837Z no activity
2021-01-10T00:07:58.905Z RUNNING Query3
2021-01-10T00:07:59.723Z new perf {"snapshots":null,"runtimeSec":220.047,"numEvents":10000000,"eventsPerSec":45444.83678486869,"eventBytesPerSec":5833139.724695179,"numResults":55318,"resultsPerSec":251.3917481265366,"resultBytesPerSec":8033.342876749059,"startupDelaySec":-160.386,"processingDelaySec":215.259,"shutdownDelaySec":3.573,"timeDilation":4.542302326321195,"errors":null,"jobId":null}
2021-01-10T00:08:14.792Z RUNNING Query3
2021-01-10T00:08:15.679Z new perf {"snapshots":null,"runtimeSec":220.643,"numEvents":10000000,"eventsPerSec":45322.081371264896,"eventBytesPerSec":5817383.270713325,"numResults":59507,"resultsPerSec":269.698109615986,"resultBytesPerSec":8618.755183713058,"startupDelaySec":-160.386,"processingDelaySec":215.259,"shutdownDelaySec":18.863,"timeDilation":4.530032677220668,"errors":null,"jobId":null}
2021-01-10T00:08:30.752Z RUNNING Query3
2021-01-10T00:08:31.549Z no activity
2021-01-10T00:08:46.622Z RUNNING Query3
2021-01-10T00:08:47.410Z no activity
2021-01-10T00:09:02.531Z DONE Query3

==========================================================================================
Run started 2021-01-10T00:02:35.007Z and ran for PT387.561S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
  0002  query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
  0013  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
  0014  query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          76.8                    130223.6                    10000000             

  0001          62.2                    160766.5                     9200000             

  0002          53.8                    185994.6                       83527             

  0003         220.6                     45322.1                       59507             

  0004          66.0                     15151.3                         140             

  0005          77.1                    129621.0                        4567             

  0006          66.7                     14986.4                        8902             

  0007         115.2                     86798.8                         100             

  0008          62.4                    160135.8                       92833             

  0009          66.9                     14953.0                       32548             

  0010          99.5                    100536.9                         100             

  0011          84.2                    118801.5                     1839657             

  0012          57.0                    175349.4                      199929             

  0013          70.5                    141922.5                     9200000             

  0014         127.6                     78377.3                     9200000             

==========================================================================================


==========================================================================================
Run started 2021-01-10T00:02:35.007Z and ran for PT399.729S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
  0002  query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main"   0011  query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
  0013  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
  0014  query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          76.8                    130223.6                    10000000             

  0001          62.2                    160766.5                     9200000             

  0002          53.8                    185994.6                       83527             

  0003         220.6                     45322.1                       59507             

  0004          66.0                     15151.3                         140             

  0005          77.1                    129621.0                        4567             

  0006          66.7                     14986.4                        8902             

  0007         115.2                     86798.8                         100             

  0008          62.4                    160135.8                       92833             

  0009          66.9                     14953.0                       32548             

  0010          99.5                    100536.9                         100             

  0011          84.2                    118801.5                     1839657             

  0012          57.0                    175349.4                      199929             

  0013          70.5                    141922.5                     9200000             

  0014         127.6                     78377.3                     9200000             

==========================================================================================

com.google.cloud.bigquery.BigQueryException: 502 Bad Gateway
POST https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/nexmark/tables/nexmark_5_DataflowRunner_batch/insertAll?prettyPrint=false
<!DOCTYPE html>
<html lang=en>
  <meta charset=utf-8>
  <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
  <title>Error 502 (Server Error)!!1</title>
  <style>
    *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7%
auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png)
100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a
img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png)
no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
  </style>
  <a href=//www.google.com/><span id=logo aria-label=Google></span></a>
  <p><b>502.</b> <ins>That’s an error.</ins>
  <p>The server encountered a temporary error and could not complete your request.<p>Please
try again in 30 seconds.  <ins>That’s all we know.</ins>

	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.translate(HttpBigQueryRpc.java:115)
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.insertAll(HttpBigQueryRpc.java:491)
	at com.google.cloud.bigquery.BigQueryImpl.insertAll(BigQueryImpl.java:1032)
	at org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertAll(BigQueryClient.java:123)
	at org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertRow(BigQueryClient.java:98)
	at org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertRow(BigQueryClient.java:89)
	at org.apache.beam.sdk.testutils.publishing.BigQueryResultsPublisher.publish(BigQueryResultsPublisher.java:47)
	at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:203)
	at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:164)
	at org.apache.beam.sdk.nexmark.Main.main(Main.java:494)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 502 Bad Gateway
POST https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/nexmark/tables/nexmark_5_DataflowRunner_batch/insertAll?prettyPrint=false
<!DOCTYPE html>
<html lang=en>
  <meta charset=utf-8>
  <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
  <title>Error 502 (Server Error)!!1</title>
  <style>
    *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7%
auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png)
100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a
img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png)
no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
  </style>
  <a href=//www.google.com/><span id=logo aria-label=Google></span></a>
  <p><b>502.</b> <ins>That’s an error.</ins>
  <p>The server encountered a temporary error and could not complete your request.<p>Please
try again in 30 seconds.  <ins>That’s all we know.</ins>

	at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:149)
	at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:112)
	at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:39)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:443)
	at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1108)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:541)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:474)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:591)
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.insertAll(HttpBigQueryRpc.java:489)
	... 8 more

> Task :sdks:java:testing:nexmark:run FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero
exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to
get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.7.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 48s
123 actionable tasks: 79 executed, 44 from cache

Publishing build scan...
https://gradle.com/s/asnbpfhk3pufe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Mime
View raw message