beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Halperin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (BEAM-138) Extend TextIO to new protocols (and maybe rename to FileIO)
Date Sat, 25 Jun 2016 17:07:37 GMT

     [ https://issues.apache.org/jira/browse/BEAM-138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Halperin updated BEAM-138:
---------------------------------
    Fix Version/s: Not applicable

> Extend TextIO to new protocols (and maybe rename to FileIO)
> -----------------------------------------------------------
>
>                 Key: BEAM-138
>                 URL: https://issues.apache.org/jira/browse/BEAM-138
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-extensions
>            Reporter: Jean-Baptiste Onofré
>            Assignee: Jean-Baptiste Onofré
>             Fix For: Not applicable
>
>
> The current TextIO supports:
> - local file when using directly path like /path/to...
> - Google Service file using path like gs:...
> On the other hand, we have a contribution (from Tom) to support HDFS.
> For an user perspective, it would be easier to use an unique IO supporting different
protocol:
> - file:
> - gs:
> - hdfs:
> - mvn:
> - ...
> It would also be convenient to be able to combine protocols and eventually use a different
coder (for instance xml:hdfs:).
> In that case, maybe I would make sense to rename TextIO as generic FileIO.
> Thoughts ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message