tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3722) Have MultiMROutput support different configurations for different writers
Date Thu, 11 May 2017 19:16:04 GMT
Ming Ma created TEZ-3722:
----------------------------

             Summary: Have MultiMROutput support different configurations for different writers
                 Key: TEZ-3722
                 URL: https://issues.apache.org/jira/browse/TEZ-3722
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Ming Ma


TEZ-3215 added the support for MultiMROutput so that a task can write its output to different
HDFS files depending on the data. Internally MultiMROutput creates different writers keyed
by the path. All writers use the same configuration.

We have use cases that different writers need to have different configurations, it can be
used to specify different output formats, or different configuration values for the same output
format. So it will be useful to allow applications to specify different configuration for
different writers.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message