spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lieyan <lie...@yahoo.com>
Subject different behaviour of the same code
Date Fri, 31 Oct 2014 07:31:26 GMT
I am trying to write some sample code under IntelliJ IDEA. I start with a
non-sbt scala project. In order that the program compile, I add
*spark-assembly-1.1.0-hadoop2.4.0.jar* in the *spark/lib* directory as one
external library of the IDEA project. 
<http://apache-spark-user-list.1001560.n3.nabble.com/file/n17803/proj.jpg> 


The code are here:  LogReg.scala
<http://apache-spark-user-list.1001560.n3.nabble.com/file/n17803/LogReg.scala>  

Then I click the "Run" button of the IDEA, and I get the following error
message  
errlog.txt
<http://apache-spark-user-list.1001560.n3.nabble.com/file/n17803/errlog.txt> 
.
But when I export the jar file, and use *spark-submit --class
net.yanl.spark.LogReg log_reg.jar 150000*. The program works finely. 

This is somehow annoying. Can anyone resolve this issue?


You may need the following file to reproduce the error. 
out5_training.log/out5_testing.log
<http://apache-spark-user-list.1001560.n3.nabble.com/file/n17803/small01.log>  



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/different-behaviour-of-the-same-code-tp17803.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message