spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tathagata Das (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-1409) Flaky Test: "actor input stream" test in org.apache.spark.streaming.InputStreamsSuite
Date Fri, 25 Apr 2014 20:33:15 GMT

    [ https://issues.apache.org/jira/browse/SPARK-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981555#comment-13981555
] 

Tathagata Das commented on SPARK-1409:
--------------------------------------

The test seems to run fine when launched from Intellij Idea but not from sbt. I am not sure
why yet. It is something to do with Akka's Prop (actually Typesafe Config it uses) being not
serializable under certain conditions. I am afraid that there may be two versions of Props/Config
in the classpath (when running from sbt) though I havent figured out how. The serialization
error causes the test to fail, every time. 

Some change in the last couple of months resulted in this side effect. Comparing spark 0.9
branch (where tests run fine), there is no difference in the Akka / Typesafe Config. The only
difference is saw is in the version of sbt - 0.12.1 for branch 0.9, 0.13.2 for master.

So, still not solution, bumping this to post 1.0

> Flaky Test: "actor input stream" test in org.apache.spark.streaming.InputStreamsSuite
> -------------------------------------------------------------------------------------
>
>                 Key: SPARK-1409
>                 URL: https://issues.apache.org/jira/browse/SPARK-1409
>             Project: Spark
>          Issue Type: Bug
>          Components: Streaming
>            Reporter: Michael Armbrust
>            Assignee: Tathagata Das
>
> Here are just a few cases:
> https://travis-ci.org/apache/spark/jobs/22151827
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13709/



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message