spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "deshanxiao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-26954) Do not attemp when user code throws exception
Date Thu, 21 Feb 2019 11:17:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-26954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

deshanxiao updated SPARK-26954:
-------------------------------
    Description: 
Yarn attemps the failed App depending on YarnRMClient#unregister. However, some attemps are
useless like the example:

{code:java}
sc.parallelize(Seq(1,2,3)).map(_ => throw new RuntimeException("exception")).collect()
{code}

Also some attemps when "FileNorFoundException" is thrown in user code looks unreasonable.

Some environment errors, such as node dead, attemps reasonablely. So, it will be better that
user exception will not attemp.


  was:
Yarn attemps the failed App depending on YarnRMClient#unregister. However, some attemps are
useless:

{code:java}
sc.parallelize(Seq(1,2,3)).map(_ => throw new RuntimeException("exception")).collect()
{code}

Some environment errors, such as node dead, attemps reasonablely. So, it will be bettler to
at



> Do not attemp when user code throws exception
> ---------------------------------------------
>
>                 Key: SPARK-26954
>                 URL: https://issues.apache.org/jira/browse/SPARK-26954
>             Project: Spark
>          Issue Type: Improvement
>          Components: YARN
>    Affects Versions: 2.3.3, 2.4.0
>            Reporter: deshanxiao
>            Priority: Critical
>
> Yarn attemps the failed App depending on YarnRMClient#unregister. However, some attemps
are useless like the example:
> {code:java}
> sc.parallelize(Seq(1,2,3)).map(_ => throw new RuntimeException("exception")).collect()
> {code}
> Also some attemps when "FileNorFoundException" is thrown in user code looks unreasonable.
> Some environment errors, such as node dead, attemps reasonablely. So, it will be better
that user exception will not attemp.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message