gora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sheriffo Ceesay <sneceesa...@gmail.com>
Subject Re: Week 8 Report
Date Tue, 23 Jul 2019 09:25:38 GMT
Hi Kevin,

Thanks again for the input.

I have taken note of your comments and I will factor them in
moving forward.

Thank you.


**Sheriffo Ceesay**


On Tue, Jul 23, 2019 at 10:13 AM Kevin Ratnasekera <djkevincr1989@gmail.com>
wrote:

> Hi Sheriffo,
>
> Thank you for your findings and hard work on this. I agree on most of the
> points you already mentioned. But I dont think we have consistent client
> implementations across all data stores in Apache Gora. That means some
> clients use async version of their API s as default, some uses sync. Some
> clients have connection pooling implemented and some use single connection
> to do all the data store work. These configurations will generally change
> the behavior when these client s are performed under a huge load. I think
> we will be good, if we do track the client setup/configurations in which
> benchmarks are captured.
>
> Regards
> Kevin
>
> On Tue, Jul 23, 2019 at 2:14 PM Sheriffo Ceesay <sneceesay77@gmail.com>
> wrote:
>
> > **Sheriffo Ceesay**
> >
> >
> > On Tue, Jul 23, 2019 at 6:52 AM Kevin Ratnasekera <
> djkevincr1989@gmail.com
> > >
> > wrote:
> >
> > > Hi Sheriffo,
> > >
> > > Adding to what Kamaci already mentioned, Have you tried Hbase-Store
> with
> > > buffered mutator engaged? [1] It allows HBase operations Eg:- puts to
> be
> > > batched and asynchronous.
> >
> >
> > Hi Kevin,
> > Yes I am using *gora.hbasestore.hbase.client.autoflush.enabled=true *in
> the
> > gora.properties file.
> >
> >
> >
> > > On related note also have a look on points where
> > > you flush() the datastore with native HBase implementation.
> > >
> >
> > The native implementation is through Yahoo! Cloud Service Benchmark. I
> > haven't gone through their implementation. I think it may be due to the
> > default configuration that I am using. I will try to dig further to see
> if
> > I can strike some improvement.
> >
> >
> > >
> > > [1] gora.hbasestore.hbase.client.autoflush.enabled=true
> > >
> > > Regards
> > > Kevin
> > >
> > > On Tue, Jul 23, 2019 at 5:40 AM Furkan KAMACI <furkankamaci@gmail.com>
> > > wrote:
> > >
> > > > Hi Sheriffo,
> > > >
> > > > I've checked all the GSoC reports including your's. Thanks for
> filling
> > > > your reports with time slot information about tasks.
> > > >
> > > > You have 3 benchmark result charts at your Week 8 Report.
> Hbase-native
> > is
> > > > dramatically slow compared to the others at 2 out of 3. Do you have
> any
> > > > comment about it?
> > > >
> > > > Kind Regards,
> > > > Furkan KAMACI
> > > >
> > > > On Sun, Jul 21, 2019 at 7:33 PM Sheriffo Ceesay <
> sneceesay77@gmail.com
> > >
> > > > wrote:
> > > >
> > > >> Week eight report is available at
> > > >>
> > > >>
> > >
> >
> https://cwiki.apache.org/confluence/display/GORA/%5BGORA-532%5D+Apache+Gora+Benchmark+Module+Weekly+Report
> > > >>
> > > >> I ran some workloads to compare Gora implementation of Mongo and
> HBase
> > > to
> > > >> the native implementations. Plots are provided in the reports and
> the
> > > >> generated data is also available at [1]. This is a work in
> progress, I
> > > >> have
> > > >> done Workload A and Workload B [2].
> > > >>
> > > >> Please let me know if you have any suggestions or questions.
> > > >>
> > > >> [1] https://github.com/sneceesay77/gora/tree/GORA-532
> > > >> [2] https://github.com/brianfrankcooper/YCSB/wiki/Core-Workloads
> > > >>
> > > >>
> > > >> **Sheriffo Ceesay**
> > > >>
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message