samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jordi Blasi Uribarri <jbl...@nextel.es>
Subject RE: NoSuchMethodError
Date Tue, 17 Mar 2015 15:52:19 GMT
I hope that I am Reading the right documentation. In this page

http://samza.apache.org/learn/documentation/latest/jobs/job-runner.html

you can read:

Samza jobs are started using a script called run-job.sh.

samza-example/target/bin/run-job.sh \
  --config-factory=samza.config.factories.PropertiesConfigFactory \
  --config-path=file://$PWD/config/hello-world.properties

The way you say it works. Now I have another different problem that I will have to check before
asking.

Thanks for your help.

Cheers,

	Jordi


-----Mensaje original-----
De: Chris Riccomini [mailto:criccomini@apache.org] 
Enviado el: martes, 17 de marzo de 2015 16:43
Para: dev@samza.apache.org
Asunto: Re: NoSuchMethodError

Hey Jordi,

PropertiesConfigFactory is located in this package:
org.apache.samza.config.factories

You have the package set to samza.config.factories. You'll need to set it
to:

  org.apache.samza.config.factories.PropertiesConfigFactory

Curious where you're getting that value from? We haven't had a "samza.*"
prefix to packages since we open sourced Samza. What docs are you looking at?

Cheers,
Chris

On Tue, Mar 17, 2015 at 5:45 AM, Jordi Blasi Uribarri <jblasi@nextel.es>
wrote:

> After doing what you told me, now I am including all the dependencies 
> in a package. What I am seeing now is another ClassNotFoundException 
> but in this case it does not seem that it is related to external 
> libraries but to Samza itself, as it is referencing the config factory.
>
> # bin/run-job.sh
> --config-factory=samza.config.factories.PropertiesConfigFactory
> --config-path=file://\$PWD/samzafroga.jar
> java version "1.7.0_75"
> OpenJDK Runtime Environment (IcedTea 2.5.4) (7u75-2.5.4-2) OpenJDK 
> 64-Bit Server VM (build 24.75-b04, mixed mode) 
> /usr/lib/jvm/java-7-openjdk-amd64/bin/java
> -Dlog4j.configuration=file:bin/log4j-console.xml 
> -Dsamza.log.dir=/opt/jobs -Djava.io.tmpdir=/opt/jobs/tmp -Xmx768M 
> -XX:+PrintGCDateStamps -Xloggc:/opt/jobs/gc.log 
> -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 
> -XX:GCLogFileSize=10241024 -d64 -cp 
> /root/.samza/conf:/opt/jobs/lib/samzafroga-0.0.1-SNAPSHOT.jar:/opt/job
> s/lib/samzafroga-0.0.1-SNAPSHOT-jar-with-dependencies.jar
> org.apache.samza.job.JobRunner
> --config-factory=samza.config.factories.PropertiesConfigFactory
> --config-path=file://$PWD/samzafroga.jar
> Exception in thread "main" java.lang.ClassNotFoundException:
> samza.config.factories.PropertiesConfigFactory
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>         at java.lang.Class.forName0(Native Method)
>         at java.lang.Class.forName(Class.java:191)
>         at
> org.apache.samza.util.CommandLine.loadConfig(CommandLine.scala:66)
>         at org.apache.samza.job.JobRunner$.main(JobRunner.scala:36)
>         at org.apache.samza.job.JobRunner.main(JobRunner.scala)
>
> Do I have to include anything more?
>
> Thanks,
>
>                 Jordi
>
> >Hey Jordi,
> >
> >The stack trace you've pasted suggests that you're missing Scala in 
> >the classpath, or have a different version of Scala in the classpath 
> >than what Samza was compiled with.
> >
> >You should not be manually assembling the dependencies for your job. 
> >Your build system should be doing this for you. Please see 
> >hello-samza's
> pom.xml:
> >
> >  https://github.com/apache/samza-hello-samza/blob/master/pom.xml
> >
> >For an example of how to do this. Specifically, the "assembly" plugin 
> >in Maven is used to build a .tgz file for your job, which has all of 
> >its required components:
> >
> >  http://maven.apache.org/plugins/maven-assembly-plugin/
> >
> >If you're not using Maven, Gradle and SBT can both assemble .tgz 
> >files as well.
> >
> >Cheers,
> >Chris
> >
> >On Mon, Mar 16, 2015 at 4:11 AM, Jordi Blasi Uribarri 
> ><jblasi@nextel.es>
> >wrote:
> >
> >> Hello,
> >>
> >> I am new to Samza and I am trying to test it. I have not found much 
> >> documentation and I am not sure if this is the correct place for 
> >> this
> kind
> >> of questions. Please let me know if I am in the wrong place. I have
> tried
> >> to follow the documentation but I guess I missed something or  did 
> >> something wrong.
> >>
> >> I have installed a clean debian box and followed the instructions 
> >> to download and build from git.
> >>
> >> git clone http://git-wip-us.apache.org/repos/asf/samza.git
> >> cd samza
> >> ./gradlew clean build
> >>
> >> I have also installed scala (2.9.2 ) and java 7 jdk an jre.
> >>
> >> I have created a simple job in java and I am trying to run it but I 
> >> am seeing some java dependencies problems when I try to run both 
> >> run-job.sh and run-am.sh scripts.
> >>
> >> What I have done is create a folder for the jobs in /opt/jobs. 
> >> There I have created a bin folder for the scripts and a lib folder 
> >> for all the
> jars
> >> that I find that are required (as I have seen in the script that 
> >> this
> the
> >> place where they are obtained). I have copied there all the jar
> contained
> >> in the samza folders and the ones I have obtained from a 
> >> hadoop-2.6.0 instalation package. Some of the dependencies have 
> >> been solved but I am stuck in the following error when I run run-am.sh:
> >>
> >> Exception in thread "main" java.lang.NoSuchMethodError:
> >> scala.Predef$.augmentString(Ljava/lang/String;)Ljava/lang/String;
> >>         at
> >>
> org.apache.samza.job.yarn.SamzaAppMaster$$anonfun$main$3.apply(SamzaAp
> pMaster.scala:63)
> >>         at
> >>
> org.apache.samza.job.yarn.SamzaAppMaster$$anonfun$main$3.apply(SamzaAp
> pMaster.scala:63)
> >>         at org.apache.samza.util.Logging$class.info(Logging.scala:55)
> >>         at
> >> org.apache.samza.job.yarn.SamzaAppMaster$.info(SamzaAppMaster.scala:55)
> >>         at
> >> org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:63)
> >>         at
> >> org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)
> >>
> >> What I am missing?
> >>
> >> As a more general question, I am having quite a work compiling the 
> >> dependencies. Is there a reference of the jar files needed for the 
> >> jobs
> and
> >> scripts to run correctly?
> >>
> >> thanks for your help,
> >>
> >>                 Jordi
> >> ________________________________
> >> Jordi Blasi Uribarri
> >> Área I+D+i
> >>
> >> jblasi@nextel.es
> >> Oficina Bilbao
> >>
> >> [http://www.nextel.es/wp-content/uploads/Firma_Nextel_2014.png]
> >>
>
Mime
View raw message