samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yuanchi Ning <ningyuanchi...@gmail.com>
Subject Jackson null pointer when upgrading to Samza 0.10.0
Date Wed, 23 Mar 2016 19:00:04 GMT
Hi All,

When we upgrade our existing samza job from 0.9 to 0.10, we found this
error below:

/var/lib/hadoop-yarn/data/samza-yarn/usercache/yuanchi/appcache/application_1458330755534_0075/container_1458330755534_0075_02_000001/__package/bin/run-class.sh:
line 63: OpenJDK: command not found
java version "1.7.0_95"
OpenJDK Runtime Environment (IcedTea 2.6.4) (7u95-2.6.4-0ubuntu0.12.04.1)
OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode)
Exception in thread "main" java.lang.NullPointerException
	at java.io.StringReader.<init>(StringReader.java:50)
	at org.codehaus.jackson.JsonFactory.createJsonParser(JsonFactory.java:636)
	at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1863)
	at org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:71)
	at org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)


And that line 71 in SamzaAppMaster is:

val coordinatorSystemConfig = new
MapConfig(SamzaObjectMapper.getObjectMapper.readValue(System.getenv(ShellCommandConfig.ENV_COORDINATOR_SYSTEM_CONFIG),
classOf[Config]))

And our checkpoint/ new version related properties are as below:

##################### Job config #####################

job.factory.class=org.apache.samza.job.yarn.YarnJobFactory

job.name=trip-counter

job.datacenter=sjc1

job.environment=sandbox

job.coordinator.system=kafka

job.coordinator.replication.factor=3


##################### Task config #####################

task.class=com.uber.athena.TripCounterTask

task.inputs=kafka.trip_details,kafka.hp-api-client_signups

task.outputTripTopic=trip_count_details

task.outputClientSignUpsTopic=client_sign_ups_count_details

task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory

task.checkpoint.system=kafka

task.checkpoint.replication.factor=3


Plus our version for codehaus jackson dependencies is 1.9.13 as
suggested in other dev email threads.


Any ideas what would cause this issue?

Thanks!

Yuanchi

















-- 
Yuanchi Ning

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message