spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matei Zaharia <matei.zaha...@gmail.com>
Subject Re: union of SchemaRDDs
Date Sat, 01 Nov 2014 23:08:40 GMT
Try unionAll, which is a special method on SchemaRDDs that keeps the schema on the results.

Matei

> On Nov 1, 2014, at 3:57 PM, Daniel Mahler <dmahler@gmail.com> wrote:
> 
> I would like to combine 2 parquet tables I have create.
> I tried:
> 
>       sc.union(sqx.parquetFile("fileA"), sqx.parquetFile("fileB"))
> 
> but that just returns RDD[Row].
> How do I combine them to get a SchemaRDD[Row]?
> 
> thanks
> Daniel


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message