spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From amit tewari <>
Subject Programatically create RDDs based on input
Date Sat, 31 Oct 2015 12:09:15 GMT

I need the ability to be able to create RDDs programatically inside my
program (e.g. based on varaible number of input files).

Can this be done?

I need this as I want to run the following statement inside an iteration:

JavaRDD<String> rdd1 = jsc.textFile("/file1.txt");


View raw message