spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lieyan <>
Subject different behaviour of the same code
Date Fri, 31 Oct 2014 07:31:26 GMT
I am trying to write some sample code under IntelliJ IDEA. I start with a
non-sbt scala project. In order that the program compile, I add
*spark-assembly-1.1.0-hadoop2.4.0.jar* in the *spark/lib* directory as one
external library of the IDEA project. 

The code are here:  LogReg.scala

Then I click the "Run" button of the IDEA, and I get the following error
But when I export the jar file, and use *spark-submit --class
net.yanl.spark.LogReg log_reg.jar 150000*. The program works finely. 

This is somehow annoying. Can anyone resolve this issue?

You may need the following file to reproduce the error. 

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message