spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jungtaek Lim (Jira)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-31011) Failed to register signal handler for PWR
Date Tue, 03 Mar 2020 04:12:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-31011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049880#comment-17049880
] 

Jungtaek Lim commented on SPARK-31011:
--------------------------------------

According to the wikipedia, SIGPWR is NOT listed in the POSIX specification, so we may need
to handle such case, at least provide better message instead of random message.

But in anyway, looks like it should just leave warn message and doesn't break functionality
other than effectively disabling decommission. If the application is failed, that's something
we should take a look. (Please add OS version as well.)

> Failed to register signal handler for PWR
> -----------------------------------------
>
>                 Key: SPARK-31011
>                 URL: https://issues.apache.org/jira/browse/SPARK-31011
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 3.0.0
>            Reporter: Gabor Somogyi
>            Priority: Major
>
> I've just tried to test something on standalone mode but the application fails.
> Environment:
> * Scala 2.12.10
> * Java 1.8.0_241-b07
> Steps to reproduce:
> * Compile Spark
> * ./sbin/start-master.sh
> * ./sbin/start-slave.sh spark://host:7077
> * submit an empty application
> Error:
> {code:java}
> 20/03/02 14:25:44 INFO SignalUtils: Registering signal handler for PWR
> 20/03/02 14:25:44 WARN SignalUtils: Failed to register signal handler for PWR
> java.lang.IllegalArgumentException: Unknown signal: PWR
> 	at sun.misc.Signal.<init>(Signal.java:143)
> 	at org.apache.spark.util.SignalUtils$.$anonfun$register$1(SignalUtils.scala:64)
> 	at scala.collection.mutable.HashMap.getOrElseUpdate(HashMap.scala:86)
> 	at org.apache.spark.util.SignalUtils$.register(SignalUtils.scala:62)
> 	at org.apache.spark.executor.CoarseGrainedExecutorBackend.onStart(CoarseGrainedExecutorBackend.scala:85)
> 	at org.apache.spark.rpc.netty.Inbox.$anonfun$process$1(Inbox.scala:120)
> 	at org.apache.spark.rpc.netty.Inbox.safelyCall(Inbox.scala:203)
> 	at org.apache.spark.rpc.netty.Inbox.process(Inbox.scala:100)
> 	at org.apache.spark.rpc.netty.MessageLoop.org$apache$spark$rpc$netty$MessageLoop$$receiveLoop(MessageLoop.scala:75)
> 	at org.apache.spark.rpc.netty.MessageLoop$$anon$1.run(MessageLoop.scala:41)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 	at java.lang.Thread.run(Thread.java:748)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message