spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Armbrust <mich...@databricks.com>
Subject Re: Does JavaSchemaRDD inherit the Hive partitioning of data?
Date Tue, 28 Oct 2014 19:25:49 GMT
DISTRIBUTE BY only promises that data will be collocated, but does not
create a partition for each value.  You are probably looking for Dynamic
Partitions
<https://cwiki.apache.org/confluence/display/Hive/DynamicPartitions>, which
was recently merged into HiveContext.

On Tue, Oct 28, 2014 at 11:49 AM, nitinkak001 <nitinkak001@gmail.com> wrote:

> Any suggestions guys??
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Does-JavaSchemaRDD-inherit-the-Hive-partitioning-of-data-tp17410p17539.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message