samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bharath Kumara Subramanian <codin.mart...@gmail.com>
Subject Re: Can't start app in Yarn
Date Wed, 29 May 2019 19:41:35 GMT
Hi Qi,

Can you share your application configuration? Especially the systems your
application consumes and produces to and its related configuration.
Also, would it be possible for to attach the entire log?

Thanks,
Bharath

On Tue, May 28, 2019 at 7:07 PM QiShu <shuqi@eefung.com> wrote:

> Hi,
>
>         Below is the running environment:
> Hadoop version 3.1.0
> java version “1.8.0_151"
> samza-api-1.1.0.jar
> samza-core_2.12-1.1.0.jar
> samza-kafka_2.12-1.1.0.jar
> samza-kv_2.12-1.1.0.jar
> samza-kv-inmemory_2.12-1.1.0.jar
> samza-kv-rocksdb_2.12-1.1.0.jar
> samza-log4j_2.12-1.1.0.jar
> samza-shell-1.1.0-dist.tgz
> samza-yarn_2.12-1.1.0.jar
> scala-compiler-2.12.1.jar
> scala-library-2.12.1.jar
> scala-logging_2.12-3.7.2.jar
> scala-parser-combinators_2.12-1.0.4.jar
> scala-reflect-2.12.4.jar
> scalate-core_2.12-1.8.0.jar
> scalate-util_2.12-1.8.0.jar
> scalatra_2.12-2.5.0.jar
> scalatra-common_2.12-2.5.0.jar
> scalatra-scalate_2.12-2.5.0.jar
> scala-xml_2.12-1.0.6.jar
> kafka_2.12-1.1.0.jar
> kafka-clients-1.1.0.jar
>
>         Below is the exception when starting app in Yarn:
> 2019-05-29 09:52:47.851 [main] AppInfoParser [INFO] Kafka version : 1.1.0
> 2019-05-29 09:52:47.851 [main] AppInfoParser [INFO] Kafka commitId :
> fdcf75ea326b8e07
> 2019-05-29 09:52:47.862 [main] Log4jControllerRegistration$ [INFO]
> Registered kafka:type=kafka.Log4jController MBean
> 2019-05-29 09:52:47.877 [main] KafkaSystemAdmin [INFO] Created
> KafkaSystemAdmin for system kafka
> Exception in thread "main" org.apache.samza.SamzaException: Failed to run
> application
>         at
> org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:79)
>         at
> org.apache.samza.runtime.ApplicationRunnerUtil.invoke(ApplicationRunnerUtil.java:49)
>         at
> org.apache.samza.runtime.ApplicationRunnerMain.main(ApplicationRunnerMain.java:53)
> Caused by: java.lang.NullPointerException
>         at java.util.HashMap.merge(HashMap.java:1225)
>         at
> java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1320)
>         at
> java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)
>         at
> java.util.HashMap$EntrySpliterator.forEachRemaining(HashMap.java:1696)
>         at
> java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
>         at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
>         at
> java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
>         at
> java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
>         at
> java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
>         at
> org.apache.samza.config.JavaSystemConfig.getSystemAdmins(JavaSystemConfig.java:84)
>         at
> org.apache.samza.system.SystemAdmins.<init>(SystemAdmins.java:38)
>         at
> org.apache.samza.execution.StreamManager.<init>(StreamManager.java:55)
>         at
> org.apache.samza.execution.JobPlanner.buildAndStartStreamManager(JobPlanner.java:64)
>         at
> org.apache.samza.execution.JobPlanner.getExecutionPlan(JobPlanner.java:94)
>         at
> org.apache.samza.execution.RemoteJobPlanner.prepareJobs(RemoteJobPlanner.java:57)
>         at
> org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:67)
>         ... 2 more
>
>
>         Thanks for your help!
>
> Qi Shu
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message