samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Navina Ramesh <nram...@linkedin.com.INVALID>
Subject Re: testThreadInterruptInOperationSleep on clean installation
Date Tue, 04 Aug 2015 07:07:00 GMT
Hi Jordi,
Looks like you are hitting this error:
org.apache.samza.storage.kv.TestRocksDbKeyValueStore > testTTL
STANDARD_ERROR
    SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for
further details.
*/usr/lib/jvm/java-7-openjdk-amd64/bin/java: symbol lookup error:
/tmp/librocksdbjni1871304830042440508..so: undefined symbol: clock_gettime*

This is a known issue when building Samza on Linux and is being tracked in
SAMZA-747 <https://issues.apache.org/jira/browse/SAMZA-747>. This is
blocked on the RocksDB 3.11.1 release and hence, a blocker for the Samza
0.10 release as well.

If the build is just failing on this test, try to comment out testTTL in
TestRocksDBKeyValueStore.scala and give it a try. I hope it solves your
build issues.

Thanks!
Navina

On Mon, Aug 3, 2015 at 11:53 PM, Jordi Blasi Uribarri <jblasi@nextel.es>
wrote:

> Hi,
>
> There was no gradle process and I have tried to run it increasing the log
> level. It seems that the test that is failing is the one related to Rocksdb.
>
> How can I run the test on eclipse?
>
> This is what I get:
>
> Executing task ':samza-kv-rocksdb_2.10:sourcesJar' (up-to-date check took
> 0.005 secs) due to:
>   Output file
> /opt/samza/samza-kv-rocksdb/build/libs/samza-kv-rocksdb_2.10-0.10.0-SNAPSHOT-sources.jar
> has changed.
>   Output file
> /opt/samza/samza-kv-rocksdb/build/libs/samza-kv-rocksdb_2.10-0.10.0-SNAPSHOT-sources.jar
> has been removed.
> :samza-kv-rocksdb_2.10:sourcesJar (Thread[Daemon,5,main]) completed. Took
> 0.019 secs.
> :samza-kv-rocksdb_2.10:signArchives (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:signArchives
> Skipping task ':samza-kv-rocksdb_2.10:signArchives' as task onlyIf is
> false.
> :samza-kv-rocksdb_2.10:signArchives SKIPPED
> :samza-kv-rocksdb_2.10:signArchives (Thread[Daemon,5,main]) completed.
> Took 0.003 secs.
> :samza-kv-rocksdb_2.10:assemble (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:assemble
> Skipping task ':samza-kv-rocksdb_2.10:assemble' as it has no actions.
> :samza-kv-rocksdb_2.10:assemble (Thread[Daemon,5,main]) completed. Took
> 0.001 secs.
> :samza-kv-rocksdb_2.10:compileTestJava (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:compileTestJava
> Skipping task ':samza-kv-rocksdb_2.10:compileTestJava' as it has no source
> files.
> :samza-kv-rocksdb_2.10:compileTestJava UP-TO-DATE
> :samza-kv-rocksdb_2.10:compileTestJava (Thread[Daemon,5,main]) completed.
> Took 0.001 secs.
> :samza-kv-rocksdb_2.10:compileTestScala (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:compileTestScala
> Executing task ':samza-kv-rocksdb_2.10:compileTestScala' (up-to-date check
> took 0.068 secs) due to:
>   Output file /opt/samza/samza-kv-rocksdb/build/classes/test has changed.
>   Output file
> /opt/samza/samza-kv-rocksdb/build/classes/test/org/apache/samza/storage/kv/TestRocksDbKeyValueStore.class
> has been removed.
>   Output file
> /opt/samza/samza-kv-rocksdb/build/classes/test/org/apache/samza/storage/kv/TestRocksDbKeyValueStore$$anonfun$testTTL$2.class
> has been removed.
> Compiling with Ant scalac task.
> [ant:scalac] Compiling 1 source file to
> /opt/samza/samza-kv-rocksdb/build/classes/test
> [ant:scalac] Element '/opt/samza/samza-kv-rocksdb/build/resources/main'
> does not exist.
> :samza-kv-rocksdb_2.10:compileTestScala (Thread[Daemon,5,main]) completed.
> Took 1.158 secs.
> :samza-kv-rocksdb_2.10:processTestResources (Thread[Daemon,5,main])
> started.
> :samza-kv-rocksdb_2.10:processTestResources
> Skipping task ':samza-kv-rocksdb_2.10:processTestResources' as it has no
> source files.
> :samza-kv-rocksdb_2.10:processTestResources UP-TO-DATE
> :samza-kv-rocksdb_2.10:processTestResources (Thread[Daemon,5,main])
> completed. Took 0.003 secs.
> :samza-kv-rocksdb_2.10:testClasses (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:testClasses
> Skipping task ':samza-kv-rocksdb_2.10:testClasses' as it has no actions.
> :samza-kv-rocksdb_2.10:testClasses (Thread[Daemon,5,main]) completed. Took
> 0.001 secs.
> :samza-kv-rocksdb_2.10:test (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:test
> Executing task ':samza-kv-rocksdb_2.10:test' (up-to-date check took 0.11
> secs) due to:
>   No history is available.
> Starting process 'Gradle Test Executor 16'. Working directory:
> /opt/samza/samza-kv-rocksdb Command:
> /usr/lib/jvm/java-7-openjdk-amd64/bin/java
> -Djava.security.manager=jarjar.org.gradle.process.internal.child.BootstrapSecurityManager
> -Dfile.encoding=UTF-8 -ea -cp
> /root/.gradle/caches/2.0/workerMain/gradle-worker.jar
> jarjar.org.gradle.process.internal.launcher.GradleWorkerMain
> Successfully started process 'Gradle Test Executor 16'
> Gradle Test Executor 16 started executing tests.
>
> org.apache.samza.storage.kv.TestRocksDbKeyValueStore > testTTL
> STANDARD_ERROR
>     SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
>     SLF4J: Defaulting to no-operation (NOP) logger implementation
>     SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for
> further details.
> /usr/lib/jvm/java-7-openjdk-amd64/bin/java: symbol lookup error:
> /tmp/librocksdbjni1871304830042440508..so: undefined symbol: clock_gettime
> :samza-kv-rocksdb_2.10:test FAILED
> :samza-kv-rocksdb_2.10:test (Thread[Daemon,5,main]) completed. Took 2.36
> secs.
>
> FAILURE: Build failed with an exception.
>
> * What went wrong:
> Execution failed for task ':samza-kv-rocksdb_2.10:test'.
> > Process 'Gradle Test Executor 16' finished with non-zero exit value 127
>
> Thanks,
>
>     Jordi
>
> -----Mensaje original-----
> De: Yan Fang [mailto:yanfang724@gmail.com]
> Enviado el: martes, 04 de agosto de 2015 0:29
> Para: dev@samza.apache.org
> Asunto: Re: testThreadInterruptInOperationSleep on clean installation
>
> Hi Jordi,
>
> Those two exceptions seems like caused by the race condition. Since I can
> not reproduce it, can you try 1) kill all the GradleDaemon and
> GradleWrapperMain processes when you rerun the build ? 2) can you try to
> run those two tests in the eclipse (or some other ways) without gradle ? I
> doubt both are related to the gradle.
>
> Thanks,
>
> Fang, Yan
> yanfang724@gmail.com
>
> On Sun, Aug 2, 2015 at 11:45 PM, Jordi Blasi Uribarri <jblasi@nextel.es>
> wrote:
>
> > Hi,
> >
> > I am trying to do a clean installation of Samza on a newly installed
> > Debian 7.8 box. Following the stpes I collected in a previous 0.8.2
> > Samza installation I have performed the following steps:
> >
> > apt-get install openjdk-7-jdk openjdk-7-jre git maven curl vi
> > /root/.bashrc export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64
> > export CLASSPATH=$CLASSPATH:/usr/share/java
> >
> > cd /opt
> > git clone http://git-wip-us.apache.org/repos/asf/samza.git
> > cd samza
> > ./gradlew clean build
> >
> >
> > Every time I run it I get an error on the test the script runs:
> > testThreadInterruptInOperationSleep
> > va.lang.AssertionError: expected:<1> but was:<0>
> >        at org.junit.Assert.fail(Assert.java:91)
> >        at org.junit.Assert.failNotEquals(Assert.java:645)
> >        at org.junit.Assert.assertEquals(Assert.java:126)
> >        at org.junit.Assert.assertEquals(Assert.java:470)
> >        at org.junit.Assert.assertEquals(Assert.java:454)
> >        at
> >
> org.apache.samza.util.TestExponentialSleepStrategy.testThreadInterruptInOperationSleep(TestExponentialSleepStrategy.scala:158)
> >        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >        at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >        at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >        at java.lang.reflect.Method.invoke(Method.java:606)
> >        at
> >
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
> >        at
> >
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
> >        at
> >
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
> >        at
> >
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
> >        at
> >
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76)
> >        at
> >
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
> >        at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
> >        at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
> >        at
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
> >        at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
> >        at
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
> >        at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
> >        at
> >
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:86)
> >        at
> >
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:49)
> >        at
> >
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
> >        at
> >
> org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:48)
> >        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >        at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >        at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >        at java.lang.reflect.Method.invoke(Method.java:606)
> >        at
> >
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
> >        at
> >
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
> >        at
> >
> org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
> >        at
> >
> org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
> >        at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
> >        at
> >
> org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:105)
> >        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >        at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >        at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >        at java.lang.reflect.Method.invoke(Method.java:606)
> >        at
> >
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
> >        at
> >
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
> >        at
> >
> org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
> >        at
> >
> org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:64)
> >        at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >        at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > I am also seeing on the report the following errors:
> >
> >
> > Exception in thread "SAMZA-filereader-" java.lang.Error:
> > java.io.FileNotFoundException: empty.txt (No existe el fichero o el
> > directorio)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1151)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:615)
> >
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > Caused by: java.io.FileNotFoundException: empty.txt (No existe el
> > fichero o el directorio)
> >
> >        at java.io.RandomAccessFile.open(Native Method)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> >
> >        at
> > org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.ru
> > n(FileReaderSystemConsumer.scala:121)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1145)
> >
> >        ... 2 more
> >
> > Exception in thread "SAMZA-filereader-" java.lang.Error:
> > java.io.FileNotFoundException: twoEnter.txt (No existe el fichero o el
> > directorio)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1151)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:615)
> >
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > Caused by: java.io.FileNotFoundException: twoEnter.txt (No existe el
> > fichero o el directorio)
> >
> >        at java.io.RandomAccessFile.open(Native Method)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> >
> >        at
> > org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.ru
> > n(FileReaderSystemConsumer.scala:121)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1145)
> >
> >        ... 2 more
> >
> > Exception in thread "SAMZA-filereader-" java.lang.Error:
> > java.io.FileNotFoundException: noEnter.txt (No existe el fichero o el
> > directorio)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1151)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:615)
> >
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > Caused by: java.io.FileNotFoundException: noEnter.txt (No existe el
> > fichero o el directorio)
> >
> >        at java.io.RandomAccessFile.open(Native Method)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> >
> >        at
> > org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.ru
> > n(FileReaderSystemConsumer.scala:121)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1145)
> >
> >        ... 2 more
> >
> > Exception in thread "SAMZA-filereader-" java.lang.Error:
> > java.io.FileNotFoundException: moreEnter.txt (No existe el fichero o
> > el
> > directorio)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1151)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:615)
> >
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > Caused by: java.io.FileNotFoundException: moreEnter.txt (No existe el
> > fichero o el directorio)
> >
> >        at java.io.RandomAccessFile.open(Native Method)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> >
> >        at
> > org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.ru
> > n(FileReaderSystemConsumer.scala:121)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1145)
> >
> >        ... 2 more
> >
> > Exception in thread "SAMZA-filereader-" java.lang.Error:
> > java.io.FileNotFoundException: oneEnter.txt (No existe el fichero o el
> > directorio)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1151)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:615)
> >
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > Caused by: java.io.FileNotFoundException: oneEnter.txt (No existe el
> > fichero o el directorio)
> >
> >        at java.io.RandomAccessFile.open(Native Method)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> >
> >        at
> > org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.ru
> > n(FileReaderSystemConsumer.scala:121)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1145)
> >
> >        ... 2 more
> >
> > What I am missing? Thanks in advance.
> >
> > Bye
> >
> >                 Jordi
> > ________________________________
> > Jordi Blasi Uribarri
> > Área I+D+i
> >
> > jblasi@nextel.es
> > Oficina Bilbao
> >
> > [http://www.nextel.es/wp-content/uploads/Firma_Nextel_2015.png]
> >
>



-- 
Navina R.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message