ranger-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From pengjianhua <peng.jian...@zte.com.cn>
Subject Review Request 60733: RANGER-1681:Now ranger's kerberos configuration item relies directly on the configuration of the hadoop component. When the HDFS opens other functions such as HA, the test connection of hbase will fail
Date Mon, 10 Jul 2017 07:01:52 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/60733/
-----------------------------------------------------------

Review request for ranger, Don Bosco Durai, Colm O hEigeartaigh, Ramesh Mani, Selvamohan Neethiraj,
Velmurugan Periasamy, and Qiang Zhang.


Bugs: RANGER-1681
    https://issues.apache.org/jira/browse/RANGER-1681


Repository: ranger


Description
-------

Currently, ragner-admin opens kerberos switch:
1.Configure the ranger-admin install.properties file:
	hadoop_conf=/etc/hadoop/conf
2.Read the configuration items in the hadoop configuration file core-site.xml:
	<property>
		<name>hadoop.security.authentication</name>
		<value>kerberos</value>
	</property>
However, when ranger-admin opened kerberos,and the HDFS opens the HA function,
hbase-plugin service tests connection failure ,this is because ranger and hadoop shared the
same kerberos switch configuration file which caused a series of unnecessary dependencies

2017-06-22 08:14:44,518 INFO org.apache.ranger.services.hbase.client.HBaseClient: HBase connection
has [zookeeper.znode.parent] with value [/hbase]
2017-06-22 08:14:44,520 INFO org.apache.ranger.plugin.client.BaseClient: Init Login: security
not enabled, using username
2017-06-22 08:14:44,581 INFO org.apache.ranger.services.hbase.client.HBaseClient: getHBaseStatus:
creating default Hbase configuration
2017-06-22 08:14:44,582 INFO org.apache.ranger.services.hbase.client.HBaseClient: getHBaseStatus:
setting config values from client
2017-06-22 08:14:44,582 INFO org.apache.ranger.services.hbase.client.HBaseClient: getHBaseStatus:
checking HbaseAvailability with the new config
2017-06-22 08:14:44,923 WARN org.apache.zookeeper.ClientCnxn: SASL configuration failed: javax.security.auth.login.LoginException:
No JAAS configuration section named 'Client' was found in specified JAAS configuration file:
'/dev/null'. Will continue connection to Zookeeper server without SASL authentication, if
Zookeeper server allows it.
2017-06-22 08:14:45,033 ERROR org.apache.ranger.services.hbase.client.HBaseClient: getHBaseStatus:
Unable to check availability of Hbase environment [hbasedev].java.io.IOException: java.lang.reflect.InvocationTargetException
2017-06-22 08:14:45,033 ERROR org.apache.ranger.services.hbase.client.HBaseClient: <==
HBaseClient.testConnection(): Unable to retrieve any databases using given parameters
org.apache.ranger.plugin.client.HadoopException: getHBaseStatus: Unable to check availability
of Hbase environment [hbasedev].
	at org.apache.ranger.services.hbase.client.HBaseClient$1.run(HBaseClient.java:175)
	at org.apache.ranger.services.hbase.client.HBaseClient$1.run(HBaseClient.java:128)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:356)
	at org.apache.ranger.services.hbase.client.HBaseClient.getHBaseStatus(HBaseClient.java:128)
	at org.apache.ranger.services.hbase.client.HBaseClient.connectionTest(HBaseClient.java:100)
	at org.apache.ranger.services.hbase.client.HBaseResourceMgr.connectionTest(HBaseResourceMgr.java:47)
	at org.apache.ranger.services.hbase.RangerServiceHBase.validateConfig(RangerServiceHBase.java:59)
	at org.apache.ranger.biz.ServiceMgr$ValidateCallable.actualCall(ServiceMgr.java:560)
	at org.apache.ranger.biz.ServiceMgr$ValidateCallable.actualCall(ServiceMgr.java:547)
	at org.apache.ranger.biz.ServiceMgr$TimedCallable.call(ServiceMgr.java:508)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.lang.reflect.InvocationTargetException
	at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:240)
	at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:218)
	at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119)
	at org.apache.hadoop.hbase.client.HBaseAdmin.checkHBaseAvailable(HBaseAdmin.java:2916)
	at org.apache.ranger.services.hbase.client.HBaseClient$1.run(HBaseClient.java:138)
	... 14 more
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
	at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:238)
	... 18 more
Caused by: java.lang.ExceptionInInitializerError
	at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
	at org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:75)
	at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:105)
	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.retrieveClusterId(ConnectionManager.java:880)
	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.<init>(ConnectionManager.java:636)
	... 23 more
Caused by: java.lang.IllegalArgumentException: java.net.UnknownHostException: nameservice
	at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:377)
	at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:320)
	at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:176)
	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:692)
	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:633)
	at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2694)
	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:100)
	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2728)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2710)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:384)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:178)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368)
	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)
	at org.apache.hadoop.hbase.util.DynamicClassLoader.initTempDir(DynamicClassLoader.java:120)
	at org.apache.hadoop.hbase.util.DynamicClassLoader.<init>(DynamicClassLoader.java:98)
	at org.apache.hadoop.hbase.protobuf.ProtobufUtil.<clinit>(ProtobufUtil.java:241)
	... 28 more
Caused by: java.net.UnknownHostException: nameservice
	... 45 more
2017-06-22 08:14:45,034 ERROR org.apache.ranger.services.hbase.client.HBaseResourceMgr: <==
HBaseResourceMgr.connectionTest() Error: org.apache.ranger.plugin.client.HadoopException:
getHBaseStatus: Unable to check availability of Hbase environment [hbasedev].
2017-06-22 08:14:45,034 ERROR org.apache.ranger.services.hbase.RangerServiceHBase: <==
RangerServiceHBase.validateConfig() Error:org.apache.ranger.plugin.client.HadoopException:
getHBaseStatus: Unable to check availability of Hbase environment [hbasedev].
2017-06-22 08:14:45,034 ERROR org.apache.ranger.biz.ServiceMgr: TimedCallable.call: Error:org.apache.ranger.plugin.client.HadoopException:
getHBaseStatus: Unable to check availability of Hbase environment [hbasedev].
2017-06-22 08:14:45,035 ERROR org.apache.ranger.biz.ServiceMgr: ==> ServiceMgr.validateConfig
Error:org.apache.ranger.plugin.client.HadoopException: org.apache.ranger.plugin.client.HadoopException:
getHBaseStatus: Unable to check availability of Hbase environment [hbasedev].


Diffs
-----

  security-admin/scripts/install.properties 268b8ac 
  security-admin/scripts/setup.sh 1630684 
  security-admin/src/main/resources/conf.dist/core-site.xml PRE-CREATION 


Diff: https://reviews.apache.org/r/60733/diff/1/


Testing
-------


Thanks,

pengjianhua


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message