gora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lewis John McGibbney (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (GORA-355) Integration with Apache Parquet
Date Wed, 14 Mar 2018 15:14:38 GMT

     [ https://issues.apache.org/jira/browse/GORA-355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lewis John McGibbney updated GORA-355:
--------------------------------------
    Description: 
I've been over on elephantbird [0] as I was trying out some things with the aim in mind of
utilizing the elephantbird I/O formats for obtaining data locality in gora-lucene. 
[~dvryaboy] suggested that we would be nice to pursue the option of persisting Parquet files
in HDFS... something which [~renato2099] mentioned a number of years ago to me as well!!!
Maybe we can extend support for this in 0.6.

[0] https://github.com/twitter/elephant-bird/issues/406

  was:
I've been over on elephantbird [0] as I was trying out some things with the aim in mind of
utilizing the elephantbird I/O formats for obtaining data locality in gora-lucene. 
[~dvryaboy] suggested that we would be nice to pursue the option of persisting Parquet files
in HDFS... something which [~renato2099] mentioned a number of years ago to me as well!!!
Maybe we can extend support for this in 0.6.

[0] https://github.com/kevinweil/elephant-bird/issues/406


> Integration with Apache Parquet
> -------------------------------
>
>                 Key: GORA-355
>                 URL: https://issues.apache.org/jira/browse/GORA-355
>             Project: Apache Gora
>          Issue Type: Improvement
>          Components: avro, gora-core
>            Reporter: Lewis John McGibbney
>            Priority: Major
>             Fix For: 0.9
>
>
> I've been over on elephantbird [0] as I was trying out some things with the aim in mind
of utilizing the elephantbird I/O formats for obtaining data locality in gora-lucene. 
> [~dvryaboy] suggested that we would be nice to pursue the option of persisting Parquet
files in HDFS... something which [~renato2099] mentioned a number of years ago to me as well!!!
> Maybe we can extend support for this in 0.6.
> [0] https://github.com/twitter/elephant-bird/issues/406



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message