Yin Huai created SPARK-6368:
-------------------------------
Summary: Build a specialized serializer for Exchange operator.
Key: SPARK-6368
URL: https://issues.apache.org/jira/browse/SPARK-6368
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Yin Huai
Kryo is still pretty slow because it works on individual objects and relative expensive to
allocate. For Exchange operator, because the schema for key and value are already defined,
we can create a specialized serializer to handle the specific schemas of key and value.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org
|