spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ameen Tayyebi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-17777) Spark Scheduler Hangs Indefinitely
Date Tue, 04 Oct 2016 18:16:20 GMT
Ameen Tayyebi created SPARK-17777:
-------------------------------------

             Summary: Spark Scheduler Hangs Indefinitely
                 Key: SPARK-17777
                 URL: https://issues.apache.org/jira/browse/SPARK-17777
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 1.6.0
         Environment: AWS EMR 4.3, can also be reproduced locally
            Reporter: Ameen Tayyebi


We've identified a problem with Spark scheduling. The issue manifests itself when an RDD calls
SparkContext.parallelize within its getPartitions method. This seemingly "recursive" call
causes the problem. We have a repro case that can easily be run.

Please advise on what the issue might be and how we can work around it in the mean time.

Thanks,
-Ameen



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message