spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tathagata Das <tathagata.das1...@gmail.com>
Subject Re: Spark 0.8.1 on Amazon Elastic MapReduce
Date Fri, 14 Feb 2014 18:42:43 GMT
That's interesting! I am curious to find out as well.

TD


On Fri, Feb 14, 2014 at 9:28 AM, Nick Pentreath <nick.pentreath@gmail.com>wrote:

> Thanks Parviz, this looks great and good to see it getting updated. Look
> forward to 0.9.0!
>
> A perhaps stupid question - where does the KinesisWordCount example live?
> Is that an Amazon example, since I don't see it under the streaming
> examples included in the Spark project. If it's a third party example is it
> possible to get the code?
>
> Thanks
> Nick
>
>
> On Fri, Feb 14, 2014 at 6:53 PM, Deyhim, Parviz <parvizd@amazon.com>wrote:
>
>>   Spark community,
>>
>>  Wanted to let you know that the version of Spark and Shark on Amazon
>> Elastic MapReduce has been updated to 0.8.1. This new version provides a
>> much better experience in terms of stability and performance but also
>> supports the following features:
>>
>>    - Integration with Amazon Cloudwatch
>>    - Integration of Spark Streaming with Amazon Kinesis.
>>    - Automatic log shipping to S3
>>
>> For a complete detail of the features Spark on EMR provides, please see
>> the following article: http://aws.amazon.com/articles/4926593393724923
>>
>>  And yes I'm working hard to push another update to support 0.9.0 :)
>>
>>  What would be great is to hear from the community on what other
>> features you like to see on Spark on EMR. For example, how useful is
>> autoscaling for Spark? Any other features you like to see?
>>
>>  Thanks,
>>
>>    *Parviz Deyhim*
>>
>> Solutions Architect
>>
>> *Amazon Web Services <http://aws.amazon.com/>*
>>
>> E: parvizd@amazon.com
>>
>> M:  408.315.2305
>>
>>
>>
>> [image: Description: Description: Description:
>> C:\Users\aiden\AppData\Local\Microsoft\Windows\Temporary Internet
>> Files\Content.Word\aws.gif] <http://aws.amazon.com/>
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message