hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rachana Srivastava <rachanasrivas...@yahoo.com.INVALID>
Subject How to Intgrate HBase With SparkStreaming
Date Thu, 10 Mar 2016 14:36:18 GMT
Hello all,
I am trying to integrate HBase with SparkStreaming new APIs mentioned here http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/
I am using    JavaHBaseContext hbaseContext = new JavaHBaseContext(jssc.sparkContext(),
conf);  Then called bulk Get API
hbaseContext.streamBulkGet(TableName.valueOf(tableName), 2, lines, new GetFunction2(), new

But this bulk API is invoked during initialization not during each streaming message.   Also

hbaseContext.foreachPartition(jDStream,new VoidFunction<Tuple2<Iterator<String>,
Connection>>() {
      public void call(Tuple2<Iterator<String>, Connection> t)throws Exception
{ ...}
The API exists but somehow it  is not working for streaming message.
Do we have example of how to get data using the spark streaming api.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message