hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Gray" <jl...@streamy.com>
Subject RE: How can I running HBase on PHP
Date Tue, 09 Dec 2008 18:36:00 GMT
Seref,

Sounds excellent and a good fit for HBase.  Within a couple months, I expect
us to have made significant progress with internal caching.  This would
potentially alleviate you from having to even think about doing any
additional cache layers.

Best of luck.

JG

> -----Original Message-----
> From: Seref Arikan [mailto:serefarikan@kurumsalteknoloji.com]
> Sent: Tuesday, December 09, 2008 8:27 AM
> To: hbase-user@hadoop.apache.org
> Subject: Re: How can I running HBase on PHP
> 
> Thanks Jonathan,
> I am working on a quite complex domain layer with persistence waiting
> as a
> todo item. At the moment rdmbs solutions provide persistence, but a
> production system will very likely go up to terabyte levels in terms of
> storage, and hybrid approaches where data ends up in a scaleable
> solution is
> very attractive to me at the moment.
> I'll be getting back with questions in a couple of months, given the
> current
> pace of my work, and I'm sure your experience and others' will be of
> great
> value.
> 
> Kind regards
> Seref
> 
> On Tue, Dec 9, 2008 at 12:01 AM, Jonathan Gray <jlist@streamy.com>
> wrote:
> 
> > Also, 0.19 and 0.20 releases bring new mechanisms for caching data
> > internally/automatically without the need for something like
> Memcached on
> > top.
> >
> > 0.19 (current trunk) already has block-caching which caches blocks
> fetched
> > from HDFS in an LRU-style queue.
> >
> > 0.20 will add a column cache which will store read cells into memory
> in an
> > LRU-style queue.  This is very similar to how you might use Memcached
> > externally.
> >
> > There are also plans for in-memory tables, hopefully in 0.20, and a
> > time-based cache which would do something like "keep past 24 hours of
> data
> > in memory".  These are still early in development but stay tuned to
> the
> > list
> > over the next month or two to follow progress.
> >
> > Until then, it's increasingly common to put a Memcached-like key/val
> on top
> > of HBase to help with random reading performance.  Memcached is in-
> memory
> > and typically based on TTLs, if you want to cache more data than can
> fit in
> > memory or you want real invalidations rather than expiration, you
> might
> > also
> > look at BerkeleyDB or Tokyo Cabinet which are disk-based key/val
> stores.
> >  If
> > you have any more questions, there are a number of us on the list who
> have
> > done things like this and can help.
> >
> > JG
> >
> > > -----Original Message-----
> > > From: Seref Arikan [mailto:serefarikan@kurumsalteknoloji.com]
> > > Sent: Monday, December 08, 2008 2:30 PM
> > > To: hbase-user@hadoop.apache.org
> > > Subject: Re: How can I running HBase on PHP
> > >
> > > Thanks for your response.
> > >
> > > Best,
> > > Seref
> > >
> > > On Mon, Dec 8, 2008 at 9:50 PM, Dan Zinngrabe <dan@sometrics.com>
> > > wrote:
> > >
> > > > Not that I know of, though it's not difficult at all. There are
> > > plenty of
> > > > articles about memcached in general, and plenty about using it
> with a
> > > > database as well. It's very easy to apply those to using it with
> > > HBase
> > > > since
> > > > memcached is a networked, in memory key-value store.
> > > >
> > > > On Mon, Dec 8, 2008 at 12:49 PM, Seref Arikan <
> > > > serefarikan@kurumsalteknoloji.com> wrote:
> > > >
> > > > > Ah, very nice news indeed. My schema is probably very fit for
> > > HBase, a
> > > > > plain
> > > > > structure with only some node-value pairs. Any documents about
> > > memcached
> > > > > use
> > > > > with HBase?
> > > > >
> > > > > Thanks
> > > > > Seref
> > > > >
> > > > >
> > > > > On Mon, Dec 8, 2008 at 8:46 PM, Krzysztof Szlapinski <
> > > > > krzysztof.szlapinski@starline.hk> wrote:
> > > > >
> > > > > > Seref Arikan pisze:
> > > > > >
> > > > > >> Hi there,
> > > > > >> Based on the response, can I assume that people use HBase
as
> a
> > > backend
> > > > > for
> > > > > >> PHP? I've asked a question about real time use of HBase
> before,
> > > and
> > > > the
> > > > > >> general consensus seemed to be not yet, but in case PHP
> based
> > > web apps
> > > > > are
> > > > > >> using it as a backend, I'd love to hear about that.
> > > > > >>
> > > > > >>
> > > > > > Yes, we are using hbase for our PHP web app with success (we
> will
> > > > release
> > > > > > it the next two months). We use java bridge and though we had
> to
> > > > overcome
> > > > > > some technical issues it works fine now. We had to develop a
> > > middle
> > > > tier
> > > > > in
> > > > > > java so it was easy for us to talk to hbase. Part of it
> became a
> > > > project
> > > > > > called pigi (http://www.pigi-project.org/).
> > > > > >
> > > > > > krzysiek
> > > > > >
> > > > > >
> > > > >
> > > >
> >
> >


Mime
View raw message