samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From QiShu <sh...@eefung.com>
Subject Re: Question about auto created Kafka topics
Date Fri, 15 Dec 2017 00:54:04 GMT
Hi Jacob Maes,
	Thanks for your help!
————————
Qi Shu 

 17/12/15 00:14,“Jacob Maes”<jacob.maes@gmail.com>:

    Samza has configurations for the replication factors used to create various
    topics. Here is how to set each one:
    
    *Checkpoint*
    task.checkpoint.replication.factor ->
    systems.<kafka-system>.default.stream.replication.factor
    -> 3
    
    Which means, if "task.checkpoint.replication.factor" is configured, it is
    used. Else if systems.<kafka-system>.default.stream.replication.factor is
    configured, it is used. Else use a default of 3.
    
    *Coordinator*
    job.coordinator.replication.factor ->
    systems.<kafka-system>.default.stream.replication.factor
    -> 3
    
    *Changelog*
    stores.<store-name>.changelog.replication.factor ->
    stores.default.changelog.replication.factor
    -> systems.<kafka-system>.default.stream.replication.factor -> 2
    
    *Intermediate streams *(for partitionBy operator in the high-level API)
    systems.<kafka-system>.default.stream.replication.factor -> 3
    
    None of them default to 1 replica, so I'm not sure why you're seeing only
    1. Does your job have any of the above properties set?
    
    What version of Samza is being used?
    
    -Jake
    
    On Thu, Dec 14, 2017 at 4:35 AM, QiShu <shuqi@eefung.com> wrote:
    
    > Hi,
    >
    >
    >
    >        Coordinator and checkpoint topic will be created automatically by
    > Samza when a task started, but these 2 topics only have one replica, how
    > can I set the num of replicas?
    >
    >
    >
    >        Thanks.
    >
    >
    >
    > ————————
    > QiShu
    >
    >
    >
    >
    



Mime
View raw message