spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jiaqi Li (Jira)" <j...@apache.org>
Subject [jira] [Created] (SPARK-30304) When the specified shufflemanager is incorrect, print the prompt.
Date Thu, 19 Dec 2019 14:31:00 GMT
Jiaqi Li created SPARK-30304:
--------------------------------

             Summary: When the specified shufflemanager is incorrect, print the prompt.
                 Key: SPARK-30304
                 URL: https://issues.apache.org/jira/browse/SPARK-30304
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 2.4.4
            Reporter: Jiaqi Li


During the instantiation of the specified `ShuffleManager`, if the configuration is wrong, whether
the log can print some tips.

before:
{code:java}
java.lang.ClassNotFoundException: hash
	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:348)
	at org.apache.spark.util.Utils$.classForName(Utils.scala:206)
	at org.apache.spark.SparkEnv$.instantiateClass$1(SparkEnv.scala:274)
	at org.apache.spark.SparkEnv$.create(SparkEnv.scala:338)
	at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:188)
	at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:277)
	at org.apache.spark.SparkContext.<init>(SparkContext.scala:462)
	at org.apache.spark.SparkContext.<init>(SparkContext.scala:131)
	at org.apache.spark.SortShuffleSuite.$anonfun$new$1(SortShuffleSuite.scala:67)
	at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
{code}
 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message