spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mich Talebzadeh <>
Subject Re: Is there any spark API function to handle a group of companies at once in this scenario?
Date Sun, 07 Apr 2019 08:34:01 GMT
Are these ticker prices for these companies like share value etc?

How do you get this company data in Spark? Are you using Spark streaming to
get the prices, then work out the stats (AVG, STDDEV etc) and put them back
into DB?


Dr Mich Talebzadeh

LinkedIn *

*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.

On Fri, 5 Apr 2019 at 10:51, Shyam P <> wrote:

> Hi ,
> In my scenario I have few companies , for which I need to calculate few
> stats like avg I need to be stored in Cassandra , for next set of records I
> need to get previously calculated and over it i need to calculate
> accumulated results ( i.e preset set of data + previously stored stats) and
> stored it back to Cassandra.
> what function/API of spark be used while calculating the above for a group
> of companies?
> Regards,
> Shyam

View raw message