Hyunsik Choi created TAJO-222:
---------------------------------
Summary: Eliminate local data transmission during repartition phases
Key: TAJO-222
URL: https://issues.apache.org/jira/browse/TAJO-222
Project: Tajo
Issue Type: Improvement
Components: repartitioning
Reporter: Hyunsik Choi
During a repartition phase, each worker pulls intermediate of completed tasks of one or more
child execution blocks. However, a worker pulls the intermediate data completed at the same
worker via HTTP. This causes unnecessary read/write overheads on disk. We should eliminate
this overhead.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
|