samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nelson VERDIER <nelson.verd...@ysance.com>
Subject SamzaAppMaster failling on yarn 2.5.1
Date Wed, 01 Jul 2015 13:33:08 GMT
Hi,

Being curious about samza i've decided to play with it a little. Having
successfully run hello samza plus some custom StreamTasks of my own on my
local computer i decided to reproduce the experience on a in-house cluster
we have.

The cluster is a MapR 4.1.0 running yarn 2.5.1. The problem we face is when
yarn is trying to register samza app master.

Below are container logs:

Exception in thread "main" javax.security.sasl.SaslException:
DIGEST-MD5: digest response format violation. Mismatched URI:
default/; expecting: null/default [Caused by
org.apache.hadoop.ipc.RemoteException(javax.security.sasl.SaslException):
DIGEST-MD5: digest response format violation. Mismatched URI:
default/; expecting: null/default]
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
	at org.apache.hadoop.yarn.ipc.RPCUtil.instantiateException(RPCUtil.java:53)
	at org.apache.hadoop.yarn.ipc.RPCUtil.unwrapAndThrowException(RPCUtil.java:104)
	at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationMasterProtocolPBClientImpl.registerApplicationMaster(ApplicationMasterProtocolPBClientImpl.java:109)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:190)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:103)
	at com.sun.proxy.$Proxy17.registerApplicationMaster(Unknown Source)
	at org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.registerApplicationMaster(AMRMClientImpl.java:196)
	at org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl.registerApplicationMaster(AMRMClientAsyncImpl.java:138)
	at org.apache.samza.job.yarn.SamzaAppMasterLifecycle.onInit(SamzaAppMasterLifecycle.scala:39)
	at org.apache.samza.job.yarn.SamzaAppMaster$$anonfun$run$1.apply(SamzaAppMaster.scala:108)
	at org.apache.samza.job.yarn.SamzaAppMaster$$anonfun$run$1.apply(SamzaAppMaster.scala:108)
	at scala.collection.immutable.List.foreach(List.scala:318)
	at org.apache.samza.job.yarn.SamzaAppMaster$.run(SamzaAppMaster.scala:108)
	at org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:95)
	at org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)

And RM logs:

2015-07-01 14:13:28,551 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl:
appattempt_1435679592284_0004_000001 State change from ALLOCATED to
LAUNCHED
2015-07-01 14:13:29,519 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1435679592284_0004_01_000001 Container Transitioned from
ACQUIRED to RUNNING
2015-07-01 14:13:34,899 WARN
SecurityLogger.org.apache.hadoop.ipc.Server: Auth failed for
10.19.1.194:44153:null (DIGEST-MD5: digest response format violation.
Mismatched URI: default/; expecting: null/default)
2015-07-01 14:13:34,900 INFO org.apache.hadoop.ipc.Server: Socket
Reader #1 for port 8030: readAndProcess from client 10.19.1.194 threw
exception [javax.security.sasl.SaslException: DIGEST-MD5: digest
response format violation. Mismatched URI: default/
; expecting: null/default]
2015-07-01 14:13:35,763 WARN
SecurityLogger.org.apache.hadoop.ipc.Server: Auth failed for
10.19.1.194:44154:null (DIGEST-MD5: digest response format violation.
Mismatched URI: default/; expecting: null/default)
2015-07-01 14:13:35,764 INFO org.apache.hadoop.ipc.Server: Socket
Reader #1 for port 8030: readAndProcess from client 10.19.1.194 threw
exception [javax.security.sasl.SaslException: DIGEST-MD5: digest
response format violation. Mismatched URI: default/
; expecting: null/default]

I am desperate to understand why the samzaAppMaster can't be launched
properly. Is Yarn 2.5 compatible with samza 0.9. Do you have any idea why
we have this digest-md5 issue?

Regards,

-- 
*Nelson Verdier*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message