spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Timothy Chen <tnac...@gmail.com>
Subject Re: [SPARK on MESOS] Avoid re-fetching Spark binary
Date Fri, 06 Jul 2018 23:06:12 GMT
I know there are some community efforts shown in Spark summits before,
mostly around reusing the same Spark context with multiple “jobs”.

I don’t think reducing Spark job startup time is a community priority afaik.

Tim
On Fri, Jul 6, 2018 at 7:12 PM Tien Dat <tphan.dat@gmail.com> wrote:

> Dear Timothy,
>
> It works like a charm now.
>
> BTW (don't judge me if I am to greedy :-)), the latency to start a Spark
> job
> is around 2-4 seconds, unless I am not aware of some awesome optimization
> on
> Spark. Do you know if Spark community is working on reducing this latency?
>
> Best
>
>
>
> --
> Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>

Mime
View raw message