From dev-return-12902-apmail-nifi-dev-archive=nifi.apache.org@nifi.apache.org Mon Jan 2 17:46:19 2017 Return-Path: X-Original-To: apmail-nifi-dev-archive@minotaur.apache.org Delivered-To: apmail-nifi-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B220819407 for ; Mon, 2 Jan 2017 17:46:19 +0000 (UTC) Received: (qmail 99116 invoked by uid 500); 2 Jan 2017 17:46:19 -0000 Delivered-To: apmail-nifi-dev-archive@nifi.apache.org Received: (qmail 99065 invoked by uid 500); 2 Jan 2017 17:46:19 -0000 Mailing-List: contact dev-help@nifi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@nifi.apache.org Delivered-To: mailing list dev@nifi.apache.org Received: (qmail 99054 invoked by uid 99); 2 Jan 2017 17:46:19 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Jan 2017 17:46:19 +0000 Received: from mail-qt0-f178.google.com (mail-qt0-f178.google.com [209.85.216.178]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 277E01A00A8 for ; Mon, 2 Jan 2017 17:46:19 +0000 (UTC) Received: by mail-qt0-f178.google.com with SMTP id c47so445518543qtc.2 for ; Mon, 02 Jan 2017 09:46:19 -0800 (PST) X-Gm-Message-State: AIkVDXJkGi/8egqSD1jYuQRtG69ATf7NVLJUPAdaaXzUEEw6dcD9GuFLrl9qtTlK7458WPd6almHWvSlMsAYbw== X-Received: by 10.200.45.211 with SMTP id q19mr44999562qta.115.1483379178376; Mon, 02 Jan 2017 09:46:18 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.165.5 with HTTP; Mon, 2 Jan 2017 09:46:18 -0800 (PST) In-Reply-To: References: From: Matt Burgess Date: Mon, 2 Jan 2017 12:46:18 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Example of GenerateTableFetch To: dev@nifi.apache.org Content-Type: text/plain; charset=UTF-8 Gary, I have an example template (as a Gist [1]) using GenerateTableFetch into a Remote Process Group set up to send the flow files (containing SQL statements to execute) back to the cluster to an Input Port (in a load-balanced manner), then on to ExecuteSQL. To increase parallelism, you can increase the number of nodes in the cluster. To increase concurrency, you can increase the Max Concurrent Tasks for the ExecuteSQL processor. Is this what you're looking for? If not please let me know and I will provide a more suitable example. Regards, Matt [1] https://gist.github.com/mattyb149/0d8dd39a7c824fc1e42fc444e09d55a0 On Fri, Dec 30, 2016 at 12:50 PM, Gary Vidal wrote: > All Devs, > > > Is there a good example of using GenerateTableFetch to ExecuteSQL > processor? I have not found an example of usage as well as how to pipe > content from processor to execute statement in another processor. > > Regards, > > Gary Vidal