spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shushant Arora <>
Subject spark --files permission error
Date Mon, 03 Aug 2015 08:34:05 GMT
Is there any setting to allow --files to copy jar from driver to executor

When I am passing some jar files using --files to executors and adding them
in class path of executor it throws exception of File not found

15/08/03 07:59:50 WARN TaskSetManager: Lost task 8.0 in stage 0.0 (TID 8,
ip): ./jar (Permission denied)
        at Method)

Running program as :
spark-submit --class classname  --files "externaljarname.jar"
--driver-class-path "externaljarname.jar" --conf
"spark.executor.extraClassPath=externaljarname.jar" mainjar.jar

View raw message