spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akhil Das <ak...@sigmoidanalytics.com>
Subject Re: Spark History Server pointing to S3
Date Tue, 16 Jun 2015 13:08:13 GMT
Not quiet sure, but try pointing the spark.history.fs.logDirectory to your
s3

Thanks
Best Regards

On Tue, Jun 16, 2015 at 6:26 PM, Gianluca Privitera <
gianluca.privitera2@studio.unibo.it> wrote:

> In Spark website it’s stated in the View After the Fact section (
> https://spark.apache.org/docs/latest/monitoring.html) that you can point
> the start-history-server.sh script to a directory in order do view the Web
> UI using the logs as data source.
>
> Is it possible to point that script to S3? Maybe from a EC2 instance?
>
> Thanks,
>
> Gianluca
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message