spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Moein Hosseini <moein...@gmail.com>
Subject Can not start thrift-server on spark2.4
Date Mon, 04 Feb 2019 09:36:59 GMT
I like to start spark thrift server on cluster of 3 machine with HDFS and
standalone HA spark (v2.4).
So I started it with following command under user spark24 but get runtime
exception about hdfs permissions.
*Command:*
*./start-thriftserver.sh --master spark://master:7077*
* exception:*
*Caused by: java.lang.RuntimeException: java.lang.RuntimeException: The
root scratch dir: /tmp/hive on HDFS should be writable. Current permissions
are: rwxr-xr-x                                                  *

But I think the hdfs permission is fine because I chmod everything under
*/tmp/hive* to *777* and set rwx access to spark24 and hive users and all
groups.

*$ hdfs dfs -ls -d /tmp/hive*
*drwxrwxrwx+  - hive hdfs          0 2019-02-03 14:13 /tmp/hive*

*$ hdfs dfs -getfacl /tmp/hive*
*# file: /tmp/hive*
*# owner: hive*
*# group: hdfs*
*user::rwx*
*user:hive:rwx*
*user:spark24:rwx*
*group::rwx*
*group:hive:rwx*
*group:spark24:rwx*
*mask::rwx*
*other::rwx*

What is wrong with in my case?
-- 

Moein Hosseini
Data Engineer
mobile: +98 912 468 1859 <+98+912+468+1859>
site: www.moein.xyz
email: moein7tl@gmail.com
[image: linkedin] <https://www.linkedin.com/in/moeinhm>
[image: twitter] <https://twitter.com/moein7tl>

Mime
View raw message