spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (Jira)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-29329) maven incremental builds not working
Date Wed, 02 Oct 2019 12:58:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942790#comment-16942790
] 

Thomas Graves commented on SPARK-29329:
---------------------------------------

there are few comments on SPARK-28759 in regards to this, see:

 

https://issues.apache.org/jira/browse/SPARK-28759?focusedCommentId=16942407&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16942407

> maven incremental builds not working
> ------------------------------------
>
>                 Key: SPARK-29329
>                 URL: https://issues.apache.org/jira/browse/SPARK-29329
>             Project: Spark
>          Issue Type: Bug
>          Components: Build
>    Affects Versions: 3.0.0
>            Reporter: Thomas Graves
>            Priority: Major
>
> It looks like since we Upgraded scala-maven-plugin to 4.2.0 https://issues.apache.org/jira/browse/SPARK-28759
spark incremental builds stop working.  Everytime you build its building all files, which
takes forever.
> It would be nice to fix this.
>  
> To reproduce, just build spark once ( I happened to be using the command below):
> build/mvn -Phadoop-3.2 -Phive-thriftserver -Phive -Pyarn -Pkinesis-asl -Pkubernetes -Pmesos
-Phadoop-cloud -Pspark-ganglia-lgpl package -DskipTests
> Then build it again and you will see that it compiles all the files and takes 15-30 minutes.
With incremental it skips all unnecessary files and takes closer to 5 minutes.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message