I am not sure if this works, but SparkContext seems to have hadoopFile and hadoopRDD methods which can accept Hadoop Input formats. If you have an InputFormat with isSplittable false, maybe it works?



Best Regards,
Sonal
Nube Technologies 





On Sat, Oct 18, 2014 at 11:29 AM, Davies Liu <davies@databricks.com> wrote:
You can call coalesce() to merge the small splits into bigger ones.

Davies

On Fri, Oct 17, 2014 at 5:35 PM, Larry Liu <larryliu05@gmail.com> wrote:
> Is it possible to disable input split if input is already small?

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org