spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ameen Tayyebi (JIRA)" <>
Subject [jira] [Created] (SPARK-17777) Spark Scheduler Hangs Indefinitely
Date Tue, 04 Oct 2016 18:16:20 GMT
Ameen Tayyebi created SPARK-17777:

             Summary: Spark Scheduler Hangs Indefinitely
                 Key: SPARK-17777
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 1.6.0
         Environment: AWS EMR 4.3, can also be reproduced locally
            Reporter: Ameen Tayyebi

We've identified a problem with Spark scheduling. The issue manifests itself when an RDD calls
SparkContext.parallelize within its getPartitions method. This seemingly "recursive" call
causes the problem. We have a repro case that can easily be run.

Please advise on what the issue might be and how we can work around it in the mean time.


This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message