spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Armbrust (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-6368) Build a specialized serializer for Exchange operator.
Date Tue, 17 Mar 2015 00:31:40 GMT

     [ https://issues.apache.org/jira/browse/SPARK-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Michael Armbrust updated SPARK-6368:
------------------------------------
    Priority: Critical  (was: Major)

> Build a specialized serializer for Exchange operator. 
> ------------------------------------------------------
>
>                 Key: SPARK-6368
>                 URL: https://issues.apache.org/jira/browse/SPARK-6368
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Yin Huai
>            Priority: Critical
>
> Kryo is still pretty slow because it works on individual objects and relative expensive
to allocate. For Exchange operator, because the schema for key and value are already defined,
we can create a specialized serializer to handle the specific schemas of key and value. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message