nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bryan Bende <bbe...@gmail.com>
Subject Re: Amazon S3 Processor
Date Fri, 17 Jul 2015 04:15:43 GMT
Do we want a Jira ticket to start capturing design ideas for a registry? or
a wiki page?

I'm happy to capture some of the research I just did on spark-packages.


On Thu, Jul 16, 2015 at 10:41 PM, Joe Witt <joe.witt@gmail.com> wrote:

> Adam, Corey, Ryan
>
> You are all absolutely right in my opinion.  We should see how the
> spark registry works as that seems to be a similar/appropriate
> concept.
>
> It isn't just about sharing extensions but also templates themselves.
> I talk to people all the time who would be able to move much farther
> and faster if they could benefit from the awesome dataflow templates
> others already built.
>
> Joe
>
> On Thu, Jul 16, 2015 at 10:39 PM, Ryan Hendrickson
> <rhendrickson.work@gmail.com> wrote:
> > I agree with Adam.. Having a "community downloads" where you would get
> > groups of processor extensions would be nice.  Like Amazon Web Services
> has
> > the Community Marketplace.. Amazon has their AMI, CentOS their page,
> etc..
> > That way there's the official ones, and also the buyer beware ones.
> There
> > might be a "bare bones" nifi, a recommended nars download, and a "fully
> > loaded" version.
> >
> > To the point of my question though, thanks Bryan!  I will download those!
> >
> > On Thu, Jul 16, 2015 at 10:37 PM, Corey Flowers <cflowers@onyxpoint.com>
> > wrote:
> >
> >> I like, processor garden but I believe Brandon Devries owns the honor of
> >> the best name so far in my opinion, the narketplace! :)
> >>
> >> And +1 for sure!
> >>
> >>
> >>
> >>
> >>
> >> On Thursday, July 16, 2015, <estrada.adam@gmail.com> wrote:
> >>
> >>> All,
> >>>
> >>> This reiterates the previous notion of creating a repository
> specifically
> >>> for NiFi Processors. "Processor Garden" perhaps to mimic what the
> Wordpress
> >>> community has done with their themes and plugins? Just thinking out
> loud
> >>> here :)
> >>>
> >>> Adam
> >>>
> >>>
> >>> > On Jul 16, 2015, at 10:09 PM, Bryan Bende <bbende@gmail.com>
wrote:
> >>> >
> >>> > Ryan,
> >>> >
> >>> > You are right, what I was trying to say was that there is in fact an
> aws
> >>> > processor bundle, but it is not being included in the distribution
> right
> >>> > now. I'm assuming this was not intentional and we would want to
> correct
> >>> > this and have it included in the next release, I created a Jira:
> >>> >
> >>> > https://issues.apache.org/jira/browse/NIFI-770
> >>> >
> >>> > In the meantime, if you wanted to use those processors, you could
> >>> download
> >>> > the nar from the link I provided and place it in the nifi lib
> directory
> >>> and
> >>> > restart nifi, after that you should see them in the UI. The link was
> for
> >>> > the aws bundle that goes with nifi 0.1.0-incubating. I'm expecting
> there
> >>> > would be an 0.2.0-incubating version of that nar available through
> Maven
> >>> > central tomorrow, but not 100% sure about this.
> >>> >
> >>> > -Bryan
> >>> >
> >>> > On Thu, Jul 16, 2015 at 9:51 PM, Ryan Hendrickson <
> >>> > rhendrickson.work@gmail.com> wrote:
> >>> >
> >>> >> I pulled down the 0.2.0 version tonight... the processors weren't
in
> >>> the
> >>> >> gui/canvas list when I checked.
> >>> >>
> >>> >>
> >>> >>
> >>>
> https://www.apache.org/dyn/closer.cgi?path=/incubator/nifi/0.2.0-incubating/nifi-0.2.0-incubating-bin.tar.gz
> >>> >>
> >>> >>> On Thu, Jul 16, 2015 at 9:45 PM, Bryan Bende <bbende@gmail.com>
> >>> wrote:
> >>> >>>
> >>> >>> At first glance it looks like the assembly is not bringing
in the
> >>> >>> nifi-aws-bundle, but the bundle is available:
> >>> >>>
> >>> >>>
> >>> >>>
> >>>
> http://central.maven.org/maven2/org/apache/nifi/nifi-aws-nar/0.1.0-incubating/nifi-aws-nar-0.1.0-incubating.nar
> >>> >>>
> >>> >>> I assume the 0.2.0-incubating version of that would work tomorrow
> when
> >>> >>> the release is fully pushed out.
> >>> >>>
> >>> >>>> On Thu, Jul 16, 2015 at 9:27 PM, Joe Witt <joe.witt@gmail.com>
> >>> wrote:
> >>> >>>>
> >>> >>>> ...these are great points.  I feel a cm issue coming...
> >>> >>>>> On Jul 16, 2015 9:07 PM, <estrada.adam@gmail.com>
wrote:
> >>> >>>>>
> >>> >>>>> Ryan,
> >>> >>>>>
> >>> >>>>> I thought there was an S3 processor too! I also thought
I saw a
> SQS
> >>> >>>>> processor. Has anyone actually started porting the
Amazon SDK
> over?
> >>> Our
> >>> >>>>> inquiring minds want to know...
> >>> >>>>>
> >>> >>>>> Adam
> >>> >>>>>
> >>> >>>>>>> On Jul 16, 2015, at 9:04 PM, Ryan Hendrickson
<
> >>> >>>>>> rhendrickson.work@gmail.com> wrote:
> >>> >>>>>>
> >>> >>>>>> Hi all,
> >>> >>>>>>  I thought there was an Amazon S3 Processor.. I
dug around the
> Jira
> >>> >>>>>> Issues.. Looks like one was discussed:
> >>> >>>>>> https://issues.apache.org/jira/browse/NIFI-25
> >>> >>>>>>
> >>> >>>>>>  Although I don't see it in 0.2.0, or 0.1.0...
Am I missing
> >>> >>>> something
> >>> >>>>>> simple here, like an extra nar for extensions?
> >>> >>>>>>
> >>> >>>>>> Thanks,
> >>> >>>>>> Ryan
> >>> >>>>>>
> >>> >>>>>> --bcaec53d5dfbf617f5051b07c38e--
> >>> >>
> >>>
> >>
> >>
> >> --
> >> Corey Flowers
> >> Vice President, Onyx Point, Inc
> >> (410) 541-6699
> >> cflowers@onyxpoint.com
> >>
> >> -- This account not approved for unencrypted proprietary information --
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message