spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aecc <>
Subject Kafka in Yarn
Date Thu, 13 Mar 2014 17:58:31 GMT
Hi, I would like to know how is the correct way to add kafka to my project in
StandAlone YARN, given that now it's in a different artifact than the Spark

I tried adding the dependency to my project but I get a
NotClassFoundException to my main class. Also, that makes my Jar file very
big, so it's not convenient.

The next code is how I run it:

/opt/spark/bin/spark-class org.apache.spark.deploy.yarn.Client --jar
project.jar --class StarterClass --args yarn-standalone  --num-workers 1
--worker-cores 1 --master-memory 1536m --worker-memory 1536m


View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message