spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yin Huai (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-6368) Build a specialized serializer for Exchange operator.
Date Mon, 16 Mar 2015 23:43:38 GMT
Yin Huai created SPARK-6368:
-------------------------------

             Summary: Build a specialized serializer for Exchange operator. 
                 Key: SPARK-6368
                 URL: https://issues.apache.org/jira/browse/SPARK-6368
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Yin Huai


Kryo is still pretty slow because it works on individual objects and relative expensive to
allocate. For Exchange operator, because the schema for key and value are already defined,
we can create a specialized serializer to handle the specific schemas of key and value. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message