spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From janardhan shetty <janardhan...@gmail.com>
Subject Re: Linear regression + Janino Exception
Date Mon, 21 Nov 2016 03:00:33 GMT
Seems like this is associated to :
https://issues.apache.org/jira/browse/SPARK-16845

On Sun, Nov 20, 2016 at 6:09 PM, janardhan shetty <janardhanp22@gmail.com>
wrote:

> Hi,
>
> I am trying to execute Linear regression algorithm for Spark 2.02 and
> hitting the below error when I am fitting my training set:
>
> val lrModel = lr.fit(train)
>
>
> It happened on 2.0.0 as well. Any resolution steps is appreciated.
>
> *Error Snippet: *
> 16/11/20 18:03:45 *ERROR CodeGenerator: failed to compile:
> org.codehaus.janino.JaninoRuntimeException: Code of method
> "(Lorg/apache/spark/sql/catalyst/expressions/GeneratedClass;[Ljava/lang/Object;)V"
> of class
> "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection"
> grows beyond 64 KB*
> /* 001 */ public java.lang.Object generate(Object[] references) {
> /* 002 */   return new SpecificUnsafeProjection(references);
> /* 003 */ }
> /* 004 */
> /* 005 */ class SpecificUnsafeProjection extends
> org.apache.spark.sql.catalyst.expressions.UnsafeProjection {
> /* 006 */
> /* 007 */   private Object[] references;
> /* 008 */   private org.apache.spark.sql.catalyst.expressions.ScalaUDF
> scalaUDF;
> /* 009 */   private scala.Function1 catalystConverter;
> /* 010 */   private scala.Function1 converter;
> /* 011 */   private scala.Function1 udf;
> /* 012 */   private org.apache.spark.sql.catalyst.expressions.ScalaUDF
> scalaUDF1;
> /* 013 */   private scala.Function1 catalystConverter1;
> /* 014 */   private scala.Function1 converter1;
> /* 015 */   private scala.Function1 udf1;
> /* 016 */   private org.apache.spark.sql.catalyst.expressions.ScalaUDF
> scalaUDF2;
> /* 017 */   private scala.Function1 catalystConverter2;
>
>
>

Mime
View raw message