flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vijay Srinivasaraghavan <vijikar...@yahoo.com>
Subject State Backend
Date Thu, 03 Aug 2017 14:45:43 GMT
I would like to know if we have any latency requirements for choosing appropriate state backend? 
For example, if an HCFS implementation is used as Flink state backend (instead of stock HDFS),
are there any implications that one needs to know with respect to the performance?
- Frequency of read/write operations, random vs sequential reads- Load/Usage pattern (Frequent
small updates vs bulk operation)- RocksDB->HCFS (Is this kind of recommended option to
mitigate some of the challenges outlined above)- S3 Vs HDFS any performance numbers?
Appreciate any inputs on this.

View raw message