hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ch huang <justlo...@gmail.com>
Subject different test result from PerformanceEvaluation and from my own test!
Date Mon, 01 Jul 2013 03:28:37 GMT
i am benchmarking the  sequentialWrite speed use HBase,but i find the
result is different ,i do not know which will be right

here is my own procedure,( i modified the PerformanceEvaluation)

 void testInsert(String tablename, String[] cfg) {
         try{
          HTable table = new HTable(conf, tablename);
          System.out.println("test begin");
          for (int i = 0; i< 1024*1024; i++){
           Put put = new Put(Bytes.toBytes("rows"+i));
           byte[] value = generateValue(this.rand);
           for (int j = 0; j < cfg.length; j++) {
            put.add(Bytes.toBytes(cfg[j]),Bytes.toBytes("j"), value);
           }
              put.setWriteToWAL(writeToWAL);
              table.put(put);
              if( i > 0 && (i % (1024)) == 0){
               System.out.print((i*100/1024/1024) +" percent finished"+"
i="+i+"\n");
              }
          }

         } catch (IOException e){
          e.printStackTrace();
         }

    }

 public static void   main (String [] agrs) {
        try {
            String tablename = "demo2";
            String[] familys = { "grade", "course" };
      //      HBaseTest. creatTable(tablename, familys);
            HBaseTest ht = new HBaseTest();
            long startTime = System.currentTimeMillis();
            ht.testInsert(tablename,familys);

            long elapsedTime = System.currentTimeMillis() - startTime;

            System.out.println("elapsed time is : "+elapsedTime+" ms\n");
        } catch (Exception e) {
            e.printStackTrace();
        }
    }


and result is
elapsed time is : 1956328 ms

also i use PerformanceEvaluation   ,BTW: i am newbie on hbase,so the whole
system is default ,not tune yet

# hbase org.apache.hadoop.hbase.PerformanceEvaluation sequentialWrite 1

13/07/01 09:08:34 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$SequentialWriteTest in
81466ms at offset 0 for 1048576 rows

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message