hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <>
Subject [jira] [Commented] (HIVE-12175) Upgrade Kryo version to 3.0.x
Date Tue, 24 Nov 2015 18:43:11 GMT


Prasanth Jayachandran commented on HIVE-12175:

This patch is for master branch only. For branch 1.2.1 you can remove the changes remove the
lines related to registration of  StandardConstant* related classes. I would recommend fixing
the issue separately for branch-1.2.1 instead of upgrading the kryo version. I will put up
another patch for branch-1 as soon as possible.

> Upgrade Kryo version to 3.0.x
> -----------------------------
>                 Key: HIVE-12175
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Serializers/Deserializers
>    Affects Versions: 2.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>         Attachments: HIVE-12175.1.patch, HIVE-12175.2.patch, HIVE-12175.3.patch, HIVE-12175.3.patch,
HIVE-12175.4.patch, HIVE-12175.5.patch, HIVE-12175.6.patch
> Current version of kryo (2.22) has some issue (refer exception below and in HIVE-12174)
with serializing ArrayLists generated using Arrays.asList(). We need to either replace all
occurrences of  Arrays.asList() or change the current StdInstantiatorStrategy. This issue
is fixed in later versions and kryo community recommends using DefaultInstantiatorStrategy
with fallback to StdInstantiatorStrategy. More discussion about this issue is here
Alternatively, custom serilization/deserilization class can be provided for Arrays.asList.
> Also, kryo 3.0 introduced unsafe based serialization which claims to have much better
performance for certain types of serialization. 
> Exception:
> {code}
> Caused by: java.lang.NullPointerException
> 	at java.util.Arrays$ArrayList.size(
> 	at java.util.AbstractList.add(
> 	at
> 	at
> 	at
> 	at
> 	... 57 more
> {code}

This message was sent by Atlassian JIRA

View raw message