spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sun Rui <sunrise_...@163.com>
Subject Re: RDD Location
Date Fri, 30 Dec 2016 07:38:00 GMT
Maybe you can create your own subclass of RDD and override the getPreferredLocations() to implement
the logic of dynamic changing of the locations.
> On Dec 30, 2016, at 12:06, Fei Hu <hufei68@gmail.com> wrote:
> 
> Dear all,
> 
> Is there any way to change the host location for a certain partition of RDD?
> 
> "protected def getPreferredLocations(split: Partition)" can be used to initialize the
location, but how to change it after the initialization?
> 
> 
> Thanks,
> Fei
> 
> 



---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Mime
View raw message