spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: What's the best practice to load data from RDMS to Spark
Date Mon, 02 Jan 2017 16:20:51 GMT
FYI option works with boolean literals directly.

Jacek

On 30 Dec 2016 9:32 p.m., "Palash Gupta" <spline_palash@yahoo.com.invalid>
wrote:

> Hi,
>
> If you want to load from csv, you can use below procedure. Of course you
> need to define spark context first. (Given example to load all csv under a
> folder, you can use specific name for single file)
>
> // these lines are equivalent in Spark 2.0
> spark.read.format("csv").option("header", "true").load("../Downloads/*.csv")
> spark.read.option("header", "true").csv("../Downloads/*.csv")
>
>
> Best regards
>
> Palash Gupta
>
>
> Sent from Yahoo Mail on Android
> <https://overview.mail.yahoo.com/mobile/?.src=Android>
>
> On Fri, 30 Dec, 2016 at 11:39 pm, Raymond Xie
> <xie3208080@gmail.com> wrote:
> Hello,
>
> I am new to Spark, as a SQL developer, I only took some courses online and
> spent some time myself, never had a chance working on a real project.
>
> I wonder what would be the best practice (tool, procedure...) to load data
> (csv, excel) into Spark platform?
>
> Thank you.
>
>
>
> *Raymond*
>
>

Mime
View raw message