spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Samarth Mailinglist <mailinglistsama...@gmail.com>
Subject Re: spark-submit question
Date Mon, 17 Nov 2014 07:59:10 GMT
I figured it out. I had to use pyspark.files.SparkFiles to get the
locations of files loaded into Spark.


On Mon, Nov 17, 2014 at 1:26 PM, Sean Owen <sowen@cloudera.com> wrote:

> You are changing these paths and filenames to match your own actual
> scripts and file locations right?
> On Nov 17, 2014 4:59 AM, "Samarth Mailinglist" <
> mailinglistsamarth@gmail.com> wrote:
>
>> I am trying to run a job written in python with the following command:
>>
>> bin/spark-submit --master spark://localhost:7077 /path/spark_solution_basic.py --py-files
/path/*.py --files /path/config.properties
>>
>> I always get an exception that config.properties is not found:
>>
>> INFO - IOError: [Errno 2] No such file or directory: 'config.properties'
>>
>> Why isn't this working?
>> ‚Äč
>>
>

Mime
View raw message