samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ethan Setnik" <>
Subject Yarn High Availability - Samza Compatibility Plans
Date Thu, 11 Sep 2014 20:55:37 GMT
Yarn 2.4.0 brings support for high availability configurations by specifying a cluster of
resource managers and a state store via zookeeper.

"When there are multiple RMs, the configuration (yarn-site.xml) used by clients and nodes
is expected to list all the RMs. Clients, ApplicationMasters (AMs) and NodeManagers (NMs)
try connecting to the RMs in a round-robin fashion until they hit the Active RM. If the Active
goes down, they resume the round-robin polling until they hit the "new" Active.”

Does Samza have any plans to support Yarn HA configurations?
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message