beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-3397) beam_PreCommit_Java_MavenInstall failing on Dataflow integration test because of too long commandline
Date Fri, 12 Jan 2018 23:26:02 GMT

    [ https://issues.apache.org/jira/browse/BEAM-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324724#comment-16324724
] 

ASF GitHub Bot commented on BEAM-3397:
--------------------------------------

alanmyrvold closed pull request #4388: [BEAM-3397] Fix the failure in the dataflow integration
test by removing the spark and flink pipeline options
URL: https://github.com/apache/beam/pull/4388
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/examples/java/pom.xml b/examples/java/pom.xml
index ce4527d6096..8e5c9916fa0 100644
--- a/examples/java/pom.xml
+++ b/examples/java/pom.xml
@@ -269,6 +269,15 @@
                   </includes>
                   <parallel>all</parallel>
                   <threadCount>4</threadCount>
+                  <classpathDependencyExcludes>
+                    <!-- Avoid [BEAM-3397] errors by reducing the pipeline
+                         options and the copies of filesToStage.
+                         A longer term solution will be to split up the
+                         precommit runs as in [BEAM-2596].
+                     -->
+                     <classpathDependencyExcludes>org.apache.beam:beam-runners-spark</classpathDependencyExcludes>
+                     <classpathDependencyExcludes>org.apache.beam:beam-runners-flink_2.11</classpathDependencyExcludes>
+                  </classpathDependencyExcludes>
                   <systemPropertyVariables>
                     <beamTestPipelineOptions>
                       [
@@ -293,6 +302,15 @@
                   </includes>
                   <parallel>all</parallel>
                   <threadCount>4</threadCount>
+                  <classpathDependencyExcludes>
+                    <!-- Avoid [BEAM-3397] errors by reducing the pipeline
+                         options and the copies of filesToStage.
+                         A longer term solution will be to split up the
+                         precommit runs as in [BEAM-2596].
+                     -->
+                     <classpathDependencyExcludes>org.apache.beam:beam-runners-spark</classpathDependencyExcludes>
+                     <classpathDependencyExcludes>org.apache.beam:beam-runners-flink_2.11</classpathDependencyExcludes>
+                  </classpathDependencyExcludes>
                   <systemPropertyVariables>
                     <beamTestPipelineOptions>
                       [


 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> beam_PreCommit_Java_MavenInstall failing on Dataflow integration test because of too
long commandline
> -----------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-3397
>                 URL: https://issues.apache.org/jira/browse/BEAM-3397
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow, testing
>            Reporter: Luke Cwik
>            Priority: Blocker
>             Fix For: 2.3.0
>
>
> The Dataflow worker fails to launch the process because the command line is too long.
The worker logs are riddled with a very long command line followed by this error message:
> `java failed with fork/exec /usr/local/bin/java: argument list too long`
> Example failures from run from master @ 49981f15009de434af9c09c3c9f50003c7417b88
> https://builds.apache.org/view/A-D/view/Beam/job/beam_PreCommit_Java_MavenInstall/16428/
> Job ids (project: apache-beam-testing):
> 2017-12-28_01_32_55-16084854344397840285
> 2017-12-28_01_32_55-213040034028880428
> 2017-12-28_01_32_55-16742595557951289122



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message