spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Taotao.Li" <charles.up...@gmail.com>
Subject How to persist SparkContext?
Date Sun, 28 Aug 2016 03:32:49 GMT
Hi, there,

       Did you see the tech talk from Bloomberg on this year's Spark
Summit?  the link is here :
https://spark-summit.org/2016/events/managed-dataframes-and-dynamically-composable-analytics-the-bloomberg-spark-server/

       In that talk, on the page 2 of your slide, they say that their
system would persist the SparkContext?

       And here is my problem, how to persist SparkContext? if just store
it in RAM, how to restore it when the server crash and restart?

here it the slide link: http://www.slideshare.net/JenAman/spark-at-
bloomberg-dynamically-composable-analytics

here is the page 2 of the slide:
-- 
*___________________*
Quant | Engineer | Boy
*___________________*
*blog*:    http://litaotao.github.io
<http://litaotao.github.io?utm_source=spark_mail>
*github*: www.github.com/litaotao

Mime
View raw message