stratos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rajkumar Rajaratnam <rajkum...@wso2.com>
Subject The trend in nightly/commit build breaks due to JVM crashing - found the who the culprit is?
Date Fri, 09 Oct 2015 02:38:37 GMT
Hi Devs,

We can see that the nightly and commit build is failing very often due to
JVM crashing. AFAIK, it started to happen very recently.

Nightly build fails due to JVM crashes while running "
*org.apache.stratos.common.test.ThriftClientConfigParserTest*". The
following build failures occurred due to this.

Build failed in Jenkins: Stratos-41x-Nightly-Build » Apache Stratos -
Common #31
Build failed in Jenkins: Stratos-41x-Nightly-Build » Apache Stratos -
Common #30
Build failed in Jenkins: Stratos-41x-Nightly-Build » Apache Stratos -
Common #28
Build failed in Jenkins: Stratos-41x-Nightly-Build » Apache Stratos -
Common #26
Build failed in Jenkins: Stratos-41x-Nightly-Build » Apache Stratos -
Common #25
Build failed in Jenkins: Stratos-41x-Nightly-Build » Apache Stratos -
Common #24
Build failed in Jenkins: Stratos-41x-Nightly-Build » Apache Stratos -
Common #21
Build failed in Jenkins: Stratos-41x-Nightly-Build » Apache Stratos -
Common #9

Commit build fails due to JVM crashes while running "
*org.apache.stratos.common.test.DistributedObjectProviderTest*". The
following build failures occurred due to this.

Build failed in Jenkins: Stratos-41x-Commit-Build » Apache Stratos - Common
#70
Build failed in Jenkins: Stratos-41x-Commit-Build » Apache Stratos - Common
#16
Build failed in Jenkins: Stratos-41x-Commit-Build » Apache Stratos - Common
#9
Build failed in Jenkins: Stratos-41x-Commit-Build » Apache Stratos - Common
#8

One interesting thing you can notice is that the JVM crashes at the same
test case (though, different in nightly and commit builds)

When I dig into the full logs of each build, I found another interesting
pattern.

Build NumberBuild StatusJVM Crashing?Builder Machine20Success-H11 (Ubuntu
ubuntu)21FailedYesubuntu-6 (docker Ubuntu ubuntu)22Success-H11 (Ubuntu
ubuntu)23Success-H11 (Ubuntu ubuntu)24FailedYesubuntu-6 (docker Ubuntu
ubuntu)25FailedYesubuntu-6 (docker Ubuntu ubuntu)26FailedYesubuntu-6
(docker Ubuntu ubuntu)27UnstableNojenkins-ubuntu-1404-4gb-82f
(jenkins-cloud-4GB cloud-slave Ubuntu ubuntu)28FailedYesubuntu-6 (docker
Ubuntu ubuntu)29Success-H11 (Ubuntu ubuntu)30FailedYesubuntu-6 (docker
Ubuntu ubuntu)31FailedYesubuntu-6 (docker Ubuntu ubuntu)

As you can see, JVM crashes in *ubuntu-6 (docker Ubuntu ubuntu)* builder
machine only. Please update the ticket Akila opened against infra with this
information.

PS :
H11 (Ubuntu ubuntu) - https://builds.apache.org/computer/H11/
ubuntu-6 (docker Ubuntu ubuntu) -
https://builds.apache.org/computer/ubuntu-6/

Thanks,
Raj.

-- 
Rajkumar Rajaratnam
Committer & PMC Member, Apache Stratos
Software Engineer, WSO2

Mobile : +94777568639
Blog : rajkumarr.com

Mime
View raw message