spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mich Talebzadeh <mich.talebza...@gmail.com>
Subject Re: Stream reading from database using spark streaming
Date Thu, 02 Jun 2016 17:12:18 GMT
I don't understand this.  How are you going to read from RDBMS database,
through JDBC?

How often are you going to sample the transactional tables?

You may find that a JDBC connection will take longer than your sliding
window length.

Is this for real time analytics?

Thanks



Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com



On 2 June 2016 at 18:08, Ted Yu <yuzhihong@gmail.com> wrote:

>
> http://www.sparkexpert.com/2015/03/28/loading-database-data-into-spark-using-data-sources-api/
>
>
> https://spark.apache.org/docs/1.6.1/api/scala/index.html#org.apache.spark.rdd.JdbcRDD
>
> FYI
>
> On Thu, Jun 2, 2016 at 6:26 AM, Zakaria Hili <zakahili@gmail.com> wrote:
>
>> I want to use spark streaming to read data from RDBMS database like mysql.
>>
>> but I don't know how to do this using JavaStreamingContext
>>
>>  JavaStreamingContext jssc = new JavaStreamingContext(conf, Durations.milliseconds(500));DataFrame
df = jssc. ??
>>
>> I search in the internet but I didn't find anything
>>
>> thank you in advance.
>> ᐧ
>>
>
>

Mime
View raw message