spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From heather79 <rong.qi...@gmail.com>
Subject distribute partitions evenly to my cluster
Date Thu, 03 Nov 2016 06:05:10 GMT
Hi, I have a cluster with 4 nodes (12 cores/ node). I want to distribute my
dataset to 24 partitions and allocate 6 partitions/ node. However, i found i
got 12 partitions with 2 nodes and 0 partition with the other 2 nodes.
Anyone has idea of how to  set 6 partitions/node? is that possible to do
that?
Thanks



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/distribute-partitions-evenly-to-my-cluster-tp27998.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message