spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aris <arisofala...@gmail.com>
Subject Re: Spark 2.0.0 JaninoRuntimeException
Date Tue, 16 Aug 2016 21:15:42 GMT
Hello Michael,

I made a JIRA with sample code to reproduce this problem. I set you as the
"shepherd" -- I Hope this is enough, otherwise I can fix it.

https://issues.apache.org/jira/browse/SPARK-17092



On Sun, Aug 14, 2016 at 9:38 AM, Michael Armbrust <michael@databricks.com>
wrote:

> Anytime you see JaninoRuntimeException you are seeing a bug in our code
> generation.  If you can come up with a small example that causes the
> problem it would be very helpful if you could open a JIRA.
>
> On Fri, Aug 12, 2016 at 2:30 PM, dhruve ashar <dhruveashar@gmail.com>
> wrote:
>
>> I see a similar issue being resolved recently: https://issues.apach
>> e.org/jira/browse/SPARK-15285
>>
>> On Fri, Aug 12, 2016 at 3:33 PM, Aris <arisofalaska@gmail.com> wrote:
>>
>>> Hello folks,
>>>
>>> I'm on Spark 2.0.0 working with Datasets -- and despite the fact that
>>> smaller data unit tests work on my laptop, when I'm on a cluster, I get
>>> cryptic error messages:
>>>
>>> Caused by: org.codehaus.janino.JaninoRuntimeException: Code of method
>>>> "(Lorg/apache/spark/sql/catalyst/InternalRow;Lorg/apache/spa
>>>> rk/sql/catalyst/InternalRow;)I" of class "org.apache.spark.sql.catalyst
>>>> .expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB
>>>>
>>>
>>> Unfortunately I'm not clear on how to even isolate the source of this
>>> problem. I didn't have this problem in Spark 1.6.1.
>>>
>>> Any clues?
>>>
>>
>>
>>
>> --
>> -Dhruve Ashar
>>
>>
>

Mime
View raw message