spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vaquar khan <vaquar.k...@gmail.com>
Subject Re: [Spark] Can Apache Spark be used with time series processing?
Date Thu, 31 Aug 2017 02:10:03 GMT
Hi Alex,

Hope following links help you to understand why Spark is good for your
usecase.



   - https://www.youtube.com/watch?v=tKkneWcAIqU&feature=youtu.be
   -
   https://blog.cloudera.com/blog/2015/12/spark-ts-a-new-library-for-analyzing-time-series-data-with-apache-spark/
   - http://ampcamp.berkeley.edu/6/exercises/time-series-tutorial-taxis.html


Regards,
Vaquar khan

On Wed, Aug 30, 2017 at 1:21 PM, Irving Duran <irving.duran@gmail.com>
wrote:

> I think it will work.  Might want to explore spark streams.
>
>
> Thank You,
>
> Irving Duran
>
> On Wed, Aug 30, 2017 at 10:50 AM, <kanth909@gmail.com> wrote:
>
>> I don't see why not
>>
>> Sent from my iPhone
>>
>> > On Aug 24, 2017, at 1:52 PM, Alexandr Porunov <
>> alexandr.porunov@gmail.com> wrote:
>> >
>> > Hello,
>> >
>> > I am new in Apache Spark. I need to process different time series data
>> (numeric values which depend on time) and react on next actions:
>> > 1. Data is changing up or down too fast.
>> > 2. Data is changing constantly up or down too long.
>> >
>> > For example, if the data have changed 30% up or down in the last five
>> minutes (or less), then I need to send a special event.
>> > If the data have changed 50% up or down in two hours (or less), then I
>> need to send a special event.
>> >
>> > Frequency of data changing is about 1000-3000 per second. And I need to
>> react as soon as possible.
>> >
>> > Does Apache Spark fit well for this scenario or I need to search for
>> another solution?
>> > Sorry for stupid question, but I am a total newbie.
>> >
>> > Regards
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
>>
>


-- 
Regards,
Vaquar Khan
+1 -224-436-0783
Greater Chicago

Mime
View raw message