spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Hamstra <m...@clearstorydata.com>
Subject Re: ANNOUNCE: New build script ./build/mvn
Date Sat, 27 Dec 2014 23:44:35 GMT
>
> Scala complication speed


Heh.  I like that.

On Sat, Dec 27, 2014 at 1:51 PM, Nicholas Chammas <
nicholas.chammas@gmail.com> wrote:

> Linkies for the curious:
>
>    - SPARK-4501 <https://issues.apache.org/jira/browse/SPARK-4501>: Create
>    build/mvn to automatically download maven/zinc/scalac
>    - https://github.com/apache/spark/pull/3707
>    - New build folder (mvn and sbt):
>    https://github.com/apache/spark/tree/master/build
>
> Nick
> ‚Äč
>
> On Sat Dec 27 2014 at 4:46:23 PM Patrick Wendell <pwendell@gmail.com>
> wrote:
>
> > Hi All,
> >
> > A consistent piece of feedback from Spark developers has been that the
> > Maven build is very slow. Typesafe provides a tool called Zinc which
> > improves Scala complication speed substantially with Maven, but is
> > difficult to install and configure, especially for platforms other
> > than Mac OS.
> >
> > I've just merged a patch (authored by Brennon York) that provides an
> > automatically configured Maven instance with Zinc embedded in Spark.
> > E.g.:
> >
> >     ./build/mvn -Phive -Phive-thriftserver -Pyarn -Phadoop-2.3 package
> >
> > It is hard to test changes like this across all environments, so
> > please give this a spin and report any issues on the Spark JIRA. It is
> > working correctly if you see the following message during compilation:
> >
> >     [INFO] Using zinc server for incremental compilation
> >
> > Note that developers preferring their own Maven installation are
> > unaffected by this and can just ignore this new feature.
> >
> > Cheers,
> > - Patrick
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> > For additional commands, e-mail: dev-help@spark.apache.org
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message