nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Phil H <gippyp...@gmail.com>
Subject Re: Ideal hardware for NiFi
Date Mon, 10 Sep 2018 10:05:53 GMT
Thanks for that. Sorry I should have been more specific - we have a flow
running already on non-dedicated hardware. Looking to identify any
limitations in NiFi/JVM that would limit how much parallelism it can take
advantage of

On Mon, 10 Sep 2018 at 14:32, Sivaprasanna <sivaprasanna246@gmail.com>
wrote:

> Phil,
>
> The hardware requirements are driven by the nature of the dataflow you are
> developing. If you're looking to play around with NiFi and gain some
> hands-on experience, go for a 4 core 8GB RAM i.e. any modern
> laptops/computer would do the job. In my case, where I'm having 100s of
> dataflows, I have it clustered with 3 nodes. Each having 16GB RAM and 4(8)
> cores. I went with SSDs of smaller size because my flows are involved in
> writing to object stores like Google Cloud Storage, Azure Blob and Amazon
> S3 and NoSQL DBs. Hope this helps.
>
> -
> Sivaprasanna
>
> On Mon, Sep 10, 2018 at 4:09 AM Phil H <gippyphil@gmail.com> wrote:
>
> > Hi all,
> >
> > I've been asked to spec some hardware for a NiFi installation. Does
> anyone
> > have any advice? My gut feel is lots of processor cores and RAM, with
> less
> > emphasis on storage (small fast disks). Are there any limitations on how
> > many cores the JRE/NiFi can actually make use of, or any other
> > considerations like that I should be aware of?
> >
> > Most likely will be pairs of servers in a cluster, but again any advice
> to
> > the contrary would be appreciated.
> >
> > Cheers,
> > Phil
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message