spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Moein Hosseini <>
Subject Can not start thrift-server on spark2.4
Date Mon, 04 Feb 2019 09:36:59 GMT
I like to start spark thrift server on cluster of 3 machine with HDFS and
standalone HA spark (v2.4).
So I started it with following command under user spark24 but get runtime
exception about hdfs permissions.
*./ --master spark://master:7077*
* exception:*
*Caused by: java.lang.RuntimeException: java.lang.RuntimeException: The
root scratch dir: /tmp/hive on HDFS should be writable. Current permissions
are: rwxr-xr-x                                                  *

But I think the hdfs permission is fine because I chmod everything under
*/tmp/hive* to *777* and set rwx access to spark24 and hive users and all

*$ hdfs dfs -ls -d /tmp/hive*
*drwxrwxrwx+  - hive hdfs          0 2019-02-03 14:13 /tmp/hive*

*$ hdfs dfs -getfacl /tmp/hive*
*# file: /tmp/hive*
*# owner: hive*
*# group: hdfs*

What is wrong with in my case?

Moein Hosseini
Data Engineer
mobile: +98 912 468 1859 <+98+912+468+1859>
[image: linkedin] <>
[image: twitter] <>

View raw message