cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aleksey Yeschenko (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-11529) Checking if an unlogged batch is local is inefficient
Date Mon, 11 Apr 2016 18:21:25 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235660#comment-15235660
] 

Aleksey Yeschenko commented on CASSANDRA-11529:
-----------------------------------------------

Committed as [c1b1d3bccf30a7ee1deb633d2bc2dfbd7b9c542f|https://github.com/apache/cassandra/commit/c1b1d3bccf30a7ee1deb633d2bc2dfbd7b9c542f]
to 2.1 and merged upwards into 2.2, 3.0, and trunk, thanks.

dtest PR merged.

> Checking if an unlogged batch is local is inefficient
> -----------------------------------------------------
>
>                 Key: CASSANDRA-11529
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-11529
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Coordination
>            Reporter: Paulo Motta
>            Assignee: Stefania
>            Priority: Critical
>             Fix For: 2.1.x, 2.2.x, 3.0.x, 3.x
>
>
> Based on CASSANDRA-11363 report I noticed that on CASSANDRA-9303 we introduced the following
check to avoid printing a {{WARN}} in case an unlogged batch statement is local:
> {noformat}
>              for (IMutation im : mutations)
>              {
>                  keySet.add(im.key());
>                  for (ColumnFamily cf : im.getColumnFamilies())
>                      ksCfPairs.add(String.format("%s.%s", cf.metadata().ksName, cf.metadata().cfName));
> +
> +                if (localMutationsOnly)
> +                    localMutationsOnly &= isMutationLocal(localTokensByKs, im);
>              }
>  
> +            // CASSANDRA-9303: If we only have local mutations we do not warn
> +            if (localMutationsOnly)
> +                return;
> +
>              NoSpamLogger.log(logger, NoSpamLogger.Level.WARN, 1, TimeUnit.MINUTES, unloggedBatchWarning,
>                               keySet.size(), keySet.size() == 1 ? "" : "s",
>                               ksCfPairs.size() == 1 ? "" : "s", ksCfPairs);
> {noformat}
> The {{isMutationLocal}} check uses {{StorageService.instance.getLocalRanges(mutation.getKeyspaceName())}},
which underneaths uses {{AbstractReplication.getAddressRanges}} to calculate local ranges.

> Recalculating this at every unlogged batch can be pretty inefficient, so we should at
the very least cache it every time the ring changes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message