hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Kimball (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6420) String-to-String Maps should be embeddable in Configuration
Date Fri, 11 Dec 2009 08:11:18 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12789163#action_12789163

Aaron Kimball commented on HADOOP-6420:

This is used for MAPREDUCE-1126. In HADOOP-6165, the serialization system was changed such
that serialization metadata is defined as a {{Map<String, String>}} with an arbitrary
set of (key, value) pairs inside.

To support more serialization formats than just WritableSerialization, we need to allow these
arbitrary maps of data to be specified by the user via the job's {{Configuration}}. Thus,
much as how we have defined mechanisms to embed ints, booleans, and lists of strings in the
Configuration, we need to expand the set of datatypes we can embed in the configuration to
also include maps of string->string. This does so without needing to worry about escape
characters or other clumsiness that would result via embedding a single (k, v) pair in the

> String-to-String Maps should be embeddable in Configuration
> -----------------------------------------------------------
>                 Key: HADOOP-6420
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6420
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: conf
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: HADOOP-6420.2.patch, HADOOP-6420.3.patch, HADOOP-6420.4.patch, HADOOP-6420.patch
> Per MAPREDUCE-1126, we need to be able to take a map of (key, value) pairs and embed
that inside a Configuration object.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message