From user-return-53355-apmail-hbase-user-archive=hbase.apache.org@hbase.apache.org Thu Mar 2 06:32:41 2017 Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 89F9319EC7 for ; Thu, 2 Mar 2017 06:32:41 +0000 (UTC) Received: (qmail 30355 invoked by uid 500); 2 Mar 2017 06:32:40 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 30261 invoked by uid 500); 2 Mar 2017 06:32:40 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 30249 invoked by uid 99); 2 Mar 2017 06:32:39 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Mar 2017 06:32:39 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 494B1C0AC6 for ; Thu, 2 Mar 2017 06:32:39 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id Iq49qGPivmtN for ; Thu, 2 Mar 2017 06:32:38 +0000 (UTC) Received: from mail-qk0-f177.google.com (mail-qk0-f177.google.com [209.85.220.177]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 362265F253 for ; Thu, 2 Mar 2017 06:32:38 +0000 (UTC) Received: by mail-qk0-f177.google.com with SMTP id u188so108789640qkc.2 for ; Wed, 01 Mar 2017 22:32:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=3ChNBwgIDTM8GvsQiLMx/gWxK+I8pONrcq49Z7yse9I=; b=RKDpTd5MO8vpImY0gg5HSNmzkcHiBpJY9R7FbSb3Nu1CFG0cdAwdpTrC7F1fhB2ltH UOpKYQ3w1k7C1CNVqoknU/7ahsqGu991pcGqNaw65gDh401ZHbcnU9zquMCW+i0fvwXp M62tKmkwJK3uZSpUBbQ5XySonT9FSrLLgMJrza+FpPe8O2mZnn9A13xa3Z+1NNXTNoT1 A94JEUEUjD3e1F4NS5PaXNDNHAM07LfxsBxyVFhhyarsa8nkqnKszSJq2o637i78VPb+ 6QN2GOf6qSI4APsf+7JcB2uEwY7wQ2GkDVtw0OoEn0sj0P7YtPOBDOBh/6iqKKPas/OY yK8A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=3ChNBwgIDTM8GvsQiLMx/gWxK+I8pONrcq49Z7yse9I=; b=iPgM+EEyxkVns8dRj9Obfqz/kd0WrnwNVzccKtqF5Lj1Ktr6OcBpBeAXEzB6VKV/V5 Btb+5W14dEa03vhINg80g/4KWOknoyq9yen6AJTcvoDEw69/zDfcfJWAj+WXrvIJAAE6 e2xSGsq3QTU5OAnwLXfKQOfZ4ZoGN2VYBGWQtrv6q6LJ+P0LPk3x/12HJXrCsF+mb+ep m7x6Nl+7ojGOvyVqCC3tXfaGoWnN3w3MTxiCI2YSFxh7w7xRoufWlHY1r9AhIk2anujl HdDUVB3RlhwU/o1/4z0IMqgUPW2XEzKr/PNrwFGtfFGct0UbwqsR1pms0X900TEpBjxf Y9LA== X-Gm-Message-State: AMke39m4qqff/TGsc7FgOx6lNXswssRz+w5iW8ERvQ5CnWJtGLhgWAPVe2ahznD38VtBfIM+ALC31+ShhOzgeQ== X-Received: by 10.200.44.156 with SMTP id 28mr15882196qtw.48.1488436352569; Wed, 01 Mar 2017 22:32:32 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.168.202 with HTTP; Wed, 1 Mar 2017 22:32:32 -0800 (PST) Received: by 10.12.168.202 with HTTP; Wed, 1 Mar 2017 22:32:32 -0800 (PST) In-Reply-To: References: From: =?UTF-8?B?RGFuaWVsIFBvxYJhY3phxYRza2k=?= Date: Thu, 2 Mar 2017 07:32:32 +0100 Message-ID: Subject: Re: parallel processing of regions in coprocessor To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=001a11376fac10d8a90549b99858 --001a11376fac10d8a90549b99858 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I invoke my business logic which is similar to map reduce paradigm. Everything works. Only performance is problem that regions are not processed parallely. I'm thinking about some hack like invoking 4 times rpc from client when i have 4 regions 02.03.2017 00:43 "Ted Yu" napisa=C5=82(a): > To my knowledge, there is no support for this type of combination of map > reduce and coprocessor. > > On Wed, Mar 1, 2017 at 2:55 PM, Daniel Po=C5=82acza=C5=84ski > > wrote: > > > It is something like map reduce processing. > > I want to run map and combine phase inside in a coprocessor for every > > region separately, return partial results to the client. On the client > > invoke reduce phase and store result in another hbase table. > > > > 2017-03-01 23:26 GMT+01:00 Ted Yu : > > > > > Can you describe your use case in more detail ? > > > > > > What type of custom coprocessor are you loading to the region server = ? > > > > > > Thanks > > > > > > On Wed, Mar 1, 2017 at 2:24 PM, Daniel Po=C5=82acza=C5=84ski < > > dpolaczanski@gmail.com > > > > > > > wrote: > > > > > > > Hi, > > > > Let's assume that we have cluster consisting from one RegionServer > and > > > the > > > > RegionsServer contains one table consisting from 3 regions. > > > > > > > > I would like to process regions in coprocessor parallely. Is it > > > possible? > > > > > > > > I observed that currenlty it invokes coproprocessor with all the > > regions > > > > one by one. So it process at the beginig region1, when finished > process > > > > regions2 and ... > > > > > > > > Is it possible to change this behaviour? > > > > > > > > Regards > > > > > > > > > > --001a11376fac10d8a90549b99858--