spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Deyhim, Parviz" <>
Subject Spark 0.8.1 on Amazon Elastic MapReduce
Date Fri, 14 Feb 2014 16:53:53 GMT
Spark community,

Wanted to let you know that the version of Spark and Shark on Amazon Elastic MapReduce has
been updated to 0.8.1. This new version provides a much better experience in terms of stability
and performance but also supports the following features:

  *   Integration with Amazon Cloudwatch
  *   Integration of Spark Streaming with Amazon Kinesis.
  *   Automatic log shipping to S3

For a complete detail of the features Spark on EMR provides, please see the following article:

And yes I'm working hard to push another update to support 0.9.0 :)

What would be great is to hear from the community on what other features you like to see on
Spark on EMR. For example, how useful is autoscaling for Spark? Any other features you like
to see?


Parviz Deyhim
Solutions Architect
Amazon Web Services<>
M:  408.315.2305

[Description: Description: Description: C:\Users\aiden\AppData\Local\Microsoft\Windows\Temporary
Internet Files\Content.Word\aws.gif]<>

  • Unnamed multipart/related (inline, None, 0 bytes)
View raw message