nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Moser <moser...@gmail.com>
Subject Re: SSD fatigue
Date Fri, 14 Dec 2018 22:00:37 GMT
Hello Phil,

When supporting an I/O intensive application such as NiFi at the enterprise
level, you have to plan for failures in your storage layer.  Disks are
going to fail and you only get to choose how that failure will affect your
system.  Here are some things to think about.

+ Use RAID for data redundancy, to mitigate possible data loss when a disk
fails.  Buy spares.
+ Buy larger SSDs because they have greater reserve capacity and larger TBW
endurance.
+ Not all SSDs are created equal.  Some SSDs are cheaper with less
endurance on purpose.  "You get what you pay for."
+ Use SMART to monitor your SSDs.  They will tell you when their end of
life is near.

Hope this helps,
-- Mike


On Thu, Dec 13, 2018 at 4:05 AM Phil H <gippyphil@gmail.com> wrote:

> Hi there,
>
> I have been reading some reports of people having significant SSD
> degredation after 100+Tb of writes, due to the chemistry of NAND gates (or
> something?!).  Based on my current NiFi disk I/O, I think that works out to
> less than 12 months of usage.
>
> What are other users with large scale NiFi systems thinking/doing about
> this?
>
> Thanks,
> Phil
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message