From solr-user-return-120190-apmail-lucene-solr-user-archive=lucene.apache.org@lucene.apache.org Tue Jan 26 10:35:17 2016 Return-Path: X-Original-To: apmail-lucene-solr-user-archive@minotaur.apache.org Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7FA241728F for ; Tue, 26 Jan 2016 10:35:17 +0000 (UTC) Received: (qmail 70861 invoked by uid 500); 26 Jan 2016 10:35:11 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 70801 invoked by uid 500); 26 Jan 2016 10:35:11 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 70789 invoked by uid 99); 26 Jan 2016 10:35:10 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Jan 2016 10:35:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 5A9D5C2209 for ; Tue, 26 Jan 2016 10:35:10 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.9 X-Spam-Level: ** X-Spam-Status: No, score=2.9 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id G9u1_BNJA2B6 for ; Tue, 26 Jan 2016 10:35:02 +0000 (UTC) Received: from mail-yk0-f182.google.com (mail-yk0-f182.google.com [209.85.160.182]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 4526320E9B for ; Tue, 26 Jan 2016 10:35:01 +0000 (UTC) Received: by mail-yk0-f182.google.com with SMTP id k129so194892106yke.0 for ; Tue, 26 Jan 2016 02:35:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Lm6J2EGs26ghlNqQUvhEr9MQrpxfCZ56XZuLxibCSCc=; b=rGMsIPN6RXPLQnzftNABKO6xyrDyNseqcIk5xWpVF6Y2R5X81l/KEe0J74M1NWGVpp L1ff96ZKXHG7x6KSAh/l47DyAKYzMznFqYd84006+zZovxgTsX3YoRp+NNLQJYhBX8Il 9nd5SArIZhvXFSiU2Hu5/Ybo013ZfHAwFkmdMJqktQqsrUFhZGO1dVxFf0TqZFgL+skq UciSgoFBFNaSUSZrbuVKaxHGp6Wk4rXiTdtXWj10ZZmGUyaTiMKMiW0bWjaXX0ImjdLV 9YMwO1HNCXuW/QciB17B2n4PuSEEWdHOLuxTyVhVYudDg+t1YnitrTqkTc2gRlYtP0xy SiEg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=Lm6J2EGs26ghlNqQUvhEr9MQrpxfCZ56XZuLxibCSCc=; b=MZUZj3Gd4UFJ9RWJnZ59jRiuUwdBFtdeaPhyqNF3KkvgJgKU4G8qyI0UJpW6O6S7oF GH5REXpTE5DRrmum7Z/CcfOG5VFxZ1T5oUMGkdt6ZyKuCrz0/BDOaAE79b72bBzozvnW VNK9PskujT8I4/Au+Ls9Ast7Fcu5vHyl2DaK8iZnr1h6Rqk9asGqijlewlB1/5YVo3Xs bIllYiWnnU6NhwLHDHJWELrKGgpMhsryLEgjclLrTsAn3vqQg3P9fWeCYCbhfeEnEvMa KQe9rn52PPGfh7UaOU7BEb3ia2eBlV1v6YMpVC13G0Si2RCSwzyrLJsHAxtPjjwyOcR5 rqxw== X-Gm-Message-State: AG10YOQPBitZdmmzIxupMyNAGk6bT9eHY3bPt4K3f5DMsOOwxMdJTVKcyKhrTbazkAbqV6wjLMBJicp5BxBpKQ== MIME-Version: 1.0 X-Received: by 10.13.239.197 with SMTP id y188mr3705934ywe.39.1453804500348; Tue, 26 Jan 2016 02:35:00 -0800 (PST) Received: by 10.37.194.134 with HTTP; Tue, 26 Jan 2016 02:35:00 -0800 (PST) In-Reply-To: <1453225596707.88926@statsbiblioteket.dk> References: <569E436C.6020105@elyograg.org> <1453225596707.88926@statsbiblioteket.dk> Date: Tue, 26 Jan 2016 11:35:00 +0100 Message-ID: Subject: Re: Solr QTime explanation From: Damien Picard To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary=94eb2c03588cd0f751052a3a3c85 --94eb2c03588cd0f751052a3a3c85 Content-Type: text/plain; charset=UTF-8 Thank you, you are right ! It seems to be a congestion from our test tool. Regards, 2016-01-19 18:46 GMT+01:00 Toke Eskildsen : > Damien Picard wrote: > > Currently we have 4 Solr nodes, with 12Gb memory (heap) ; the collections > > are replicated (4 shards, 1 replica). > > This query mostly returns a QTime=4 and it takes around 20ms on the > client > > side to get the result. > > > We have to handle around 200 simultaneous connections. > > You are probably experiencing congestion. JMeter can visualize throughput. > Try experimenting with 10 to 100 concurrent threads in increments of 10 > threads and look at throughput underway. My guess is that throughput will > rise as you increase threads, until some point after which it will fall > again as the Solrs exceeds their peak performance point. You might end up > getting better performance by rate-limiting outside of SolrCloud. > > Also, what does 200 simultaneous connections mean? Is that 200 requests > per second? > > - Toke Eskildsen > -- Damien Picard Expert GWT Mob : 06 11 51 47 78 --94eb2c03588cd0f751052a3a3c85--