spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mich Talebzadeh <mich.talebza...@gmail.com>
Subject Re: Does Spark CSV accept a CSV String
Date Wed, 30 Mar 2016 21:06:37 GMT
just to clarify are you talking about databricks csv package.

$SPARK_HOME/bin/spark-shell --packages com.databricks:spark-csv_2.11:1.3.0

Where are these zipped files? Are they copied to a staging directory in
hdfs?

HTH

Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com



On 30 March 2016 at 15:17, Benjamin Kim <bbuild11@gmail.com> wrote:

> I have a quick question. I have downloaded multiple zipped files from S3
> and unzipped each one of them into strings. The next step is to parse using
> a CSV parser. I want to know if there is a way to easily use the spark csv
> package for this?
>
> Thanks,
> Ben
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message