spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Commented] (SPARK-3431) Parallelize execution of tests
Date Tue, 09 Dec 2014 20:19:14 GMT


Sean Owen commented on SPARK-3431:

Hm. Well, when I run {{BlockTransferMessagesSuite}} by itself in my IDE, it also fails. I'm
wondering if we're simply discovering that lots of the Java tests don't actually succeed.
Step 1 may be SPARK-4159, getting Java tests running too. I think I can do that. Once that's
cleared up, which will entail something a lot like my patch here, I think it's easier to move
forward (possibly) with surefire for all, parallel tests.

> Parallelize execution of tests
> ------------------------------
>                 Key: SPARK-3431
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build
>            Reporter: Nicholas Chammas
>            Assignee: Nicholas Chammas
>         Attachments: SPARK-3431-srowen-attempt.patch
> Running all the tests in {{dev/run-tests}} takes up to 2 hours. A common strategy to
cut test time down is to parallelize the execution of the tests. Doing that may in turn require
some prerequisite changes to be made to how certain tests run.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message