spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From KhajaAsmath Mohammed <mdkhajaasm...@gmail.com>
Subject Re: [EXTERNAL] Urgent Help - Py Spark submit error
Date Fri, 14 May 2021 22:05:36 GMT
You are right. It worked but I still don't understand why I need to pass
that to all executors.

On Fri, May 14, 2021 at 5:03 PM KhajaAsmath Mohammed <
mdkhajaasmath@gmail.com> wrote:

> I am using json only to read properties before calling spark session. I
> don't know why we need to pass that to all executors.
>
>
> On Fri, May 14, 2021 at 5:01 PM Longjiang.Yang <Longjiang.Yang@target.com>
> wrote:
>
>> Could you check whether this file is accessible in executors? (is it in
>> HDFS or in the client local FS)
>> /appl/common/ftp/conf.json
>>
>>
>>
>>
>>
>> *From: *KhajaAsmath Mohammed <mdkhajaasmath@gmail.com>
>> *Date: *Friday, May 14, 2021 at 4:50 PM
>> *To: *"user @spark" <user@spark.apache.org>
>> *Subject: *[EXTERNAL] Urgent Help - Py Spark submit error
>>
>>
>>
>> /appl/common/ftp/conf.json
>>
>

Mime
View raw message