samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yi Pan <nickpa...@gmail.com>
Subject Re: Jackson null pointer when upgrading to Samza 0.10.0
Date Wed, 23 Mar 2016 21:57:36 GMT
Hi, Yuanchi,

Is this related w/ the issue you reported earlier regarding to "problem
picking up checkpoint after upgrade" in another thread? I assume that you
are using the official Samza 0.10 release? That has jackson version 1.8.5
by default. How do you change it in your own build/package to 1.9.13?

Thanks!

-Yi

On Wed, Mar 23, 2016 at 12:00 PM, Yuanchi Ning <ningyuanchi320@gmail.com>
wrote:

> Hi All,
>
> When we upgrade our existing samza job from 0.9 to 0.10, we found this
> error below:
>
>
> /var/lib/hadoop-yarn/data/samza-yarn/usercache/yuanchi/appcache/application_1458330755534_0075/container_1458330755534_0075_02_000001/__package/bin/run-class.sh:
> line 63: OpenJDK: command not found
> java version "1.7.0_95"
> OpenJDK Runtime Environment (IcedTea 2.6.4) (7u95-2.6.4-0ubuntu0.12.04.1)
> OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode)
> Exception in thread "main" java.lang.NullPointerException
>         at java.io.StringReader.<init>(StringReader.java:50)
>         at
> org.codehaus.jackson.JsonFactory.createJsonParser(JsonFactory.java:636)
>         at
> org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1863)
>         at
> org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:71)
>         at
> org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)
>
>
> And that line 71 in SamzaAppMaster is:
>
> val coordinatorSystemConfig = new
>
> MapConfig(SamzaObjectMapper.getObjectMapper.readValue(System.getenv(ShellCommandConfig.ENV_COORDINATOR_SYSTEM_CONFIG),
> classOf[Config]))
>
> And our checkpoint/ new version related properties are as below:
>
> ##################### Job config #####################
>
> job.factory.class=org.apache.samza.job.yarn.YarnJobFactory
>
> job.name=trip-counter
>
> job.datacenter=sjc1
>
> job.environment=sandbox
>
> job.coordinator.system=kafka
>
> job.coordinator.replication.factor=3
>
>
> ##################### Task config #####################
>
> task.class=com.uber.athena.TripCounterTask
>
> task.inputs=kafka.trip_details,kafka.hp-api-client_signups
>
> task.outputTripTopic=trip_count_details
>
> task.outputClientSignUpsTopic=client_sign_ups_count_details
>
>
> task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory
>
> task.checkpoint.system=kafka
>
> task.checkpoint.replication.factor=3
>
>
> Plus our version for codehaus jackson dependencies is 1.9.13 as
> suggested in other dev email threads.
>
>
> Any ideas what would cause this issue?
>
> Thanks!
>
> Yuanchi
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> --
> Yuanchi Ning
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message