gora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ferdy Galema (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GORA-119) implement a filter enabled scan in gora
Date Wed, 18 Apr 2012 10:11:43 GMT

    [ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256412#comment-13256412
] 

Ferdy Galema commented on GORA-119:
-----------------------------------

This would be very useful indeed. I can think of Nutchgora that uses it for skipping rows
that do not match the (generate/fetch..) mark. There are a few ways to implement it:

A) The quick cheap workaround by passing filter options on Configuration so that the store
instance will apply it to all queries. A way to only make it work for HBase. Easy to implement.
B) Make it a generic Query option, but make it optional. This allows for some stores to implement
it, but it won't be necessary. Clients need to accept that filtering *might* be done, but
still have to check every row in order to skip were necessary.
C) Like B, the generic option, but create a generic implementation that makes sure filtering
is always applied, even for a Store does not explicitely implements it. This way it is still
optional for a store to implement it (i.e. HBaseStore that applies regionside filtering) but
when they don't, the generic implementation at the Gora client side will still skip the rows
before they are passed to the application client.

I like to adopt for C.
                
> implement a filter enabled scan in gora
> ---------------------------------------
>
>                 Key: GORA-119
>                 URL: https://issues.apache.org/jira/browse/GORA-119
>             Project: Apache Gora
>          Issue Type: Improvement
>    Affects Versions: 0.2
>         Environment: gora hbase gora-core gora-hbase
>            Reporter: raf shin
>              Labels: filter, gora-core, gora-hbase, scan
>             Fix For: 0.3
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core
and gora-hbase components.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message