spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kazuaki Ishizaki" <ISHIZ...@jp.ibm.com>
Subject Re: Linear regression + Janino Exception
Date Mon, 21 Nov 2016 14:48:56 GMT
Thank you for reporting the error.
I think that this is associated to 
https://issues.apache.org/jira/browse/SPARK-18492

The reporter of this JIRA entry has not posted the program yet. Would it 
be possible to add your program that can reproduce this issue to this JIRA 
entry?

Regards,
Kazuaki Ishizaki



From:   janardhan shetty <janardhanp22@gmail.com>
To:     user <user@spark.apache.org>
Date:   2016/11/21 12:01
Subject:        Re: Linear regression + Janino Exception



Seems like this is associated to :
https://issues.apache.org/jira/browse/SPARK-16845

On Sun, Nov 20, 2016 at 6:09 PM, janardhan shetty <janardhanp22@gmail.com> 
wrote:
Hi,

I am trying to execute Linear regression algorithm for Spark 2.02 and 
hitting the below error when I am fitting my training set:

val lrModel = lr.fit(train)

It happened on 2.0.0 as well. Any resolution steps is appreciated.

Error Snippet: 
16/11/20 18:03:45 ERROR CodeGenerator: failed to compile: 
org.codehaus.janino.JaninoRuntimeException: Code of method 
"(Lorg/apache/spark/sql/catalyst/expressions/GeneratedClass;[Ljava/lang/Object;)V" 
of class 
"org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" 
grows beyond 64 KB
/* 001 */ public java.lang.Object generate(Object[] references) {
/* 002 */   return new SpecificUnsafeProjection(references);
/* 003 */ }
/* 004 */
/* 005 */ class SpecificUnsafeProjection extends 
org.apache.spark.sql.catalyst.expressions.UnsafeProjection {
/* 006 */
/* 007 */   private Object[] references;
/* 008 */   private org.apache.spark.sql.catalyst.expressions.ScalaUDF 
scalaUDF;
/* 009 */   private scala.Function1 catalystConverter;
/* 010 */   private scala.Function1 converter;
/* 011 */   private scala.Function1 udf;
/* 012 */   private org.apache.spark.sql.catalyst.expressions.ScalaUDF 
scalaUDF1;
/* 013 */   private scala.Function1 catalystConverter1;
/* 014 */   private scala.Function1 converter1;
/* 015 */   private scala.Function1 udf1;
/* 016 */   private org.apache.spark.sql.catalyst.expressions.ScalaUDF 
scalaUDF2;
/* 017 */   private scala.Function1 catalystConverter2;






Mime
View raw message