From users-return-315-apmail-trafficserver-users-archive=trafficserver.apache.org@trafficserver.apache.org Thu Sep 16 22:30:38 2010 Return-Path: Delivered-To: apmail-trafficserver-users-archive@www.apache.org Received: (qmail 77962 invoked from network); 16 Sep 2010 22:30:37 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 16 Sep 2010 22:30:37 -0000 Received: (qmail 85252 invoked by uid 500); 16 Sep 2010 22:30:37 -0000 Delivered-To: apmail-trafficserver-users-archive@trafficserver.apache.org Received: (qmail 85115 invoked by uid 500); 16 Sep 2010 22:30:37 -0000 Mailing-List: contact users-help@trafficserver.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@trafficserver.apache.org Delivered-To: mailing list users@trafficserver.apache.org Received: (qmail 85107 invoked by uid 99); 16 Sep 2010 22:30:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Sep 2010 22:30:36 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of pranavadesai@gmail.com designates 74.125.82.48 as permitted sender) Received: from [74.125.82.48] (HELO mail-ww0-f48.google.com) (74.125.82.48) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Sep 2010 22:30:30 +0000 Received: by wwb31 with SMTP id 31so178824wwb.5 for ; Thu, 16 Sep 2010 15:30:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=F1VomaijPcjwopoK5il6g1QH4LCQeYhz4rBcL4BvljA=; b=sdQZI1WXQjn+FAarkEUlNlrd8doKC1A75Bi6dHKT4hZwOe9SQn3AOmb5LpoLm/QCKb /iWb1rCkvaWkudnaAzsXmMtrdqh7TWGqhSKLLnIO7Kt9dfWWKn17p9SpPcQNoEjo60zt bKYh7VQ4aCPPstyjhqumqrHthjw5kMZ1MwZDM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=HZbK+plVe3q0ItdFX3X7Z2+SvWRT2it3hvLsNnycVzGvLfkBvJc52hUmXDOsz+2Xte tQMETmz9SlRlIHDJ8QTJ/rtMqPK+U3JjVLNksF7r2YJIMcdI9yZcdUwZxMaJvs10UDLx Oi/BJLLOm3S86nTz0M8BCmZY9XTVN38Lb1Q2Q= MIME-Version: 1.0 Received: by 10.227.134.206 with SMTP id k14mr3449128wbt.121.1284676209242; Thu, 16 Sep 2010 15:30:09 -0700 (PDT) Received: by 10.227.131.3 with HTTP; Thu, 16 Sep 2010 15:30:09 -0700 (PDT) In-Reply-To: <4C92861E.60005@apache.org> References: <4C92711F.5060008@apache.org> <4C92861E.60005@apache.org> Date: Thu, 16 Sep 2010 15:30:09 -0700 Message-ID: Subject: Re: errors and shutdown message in 2.1.2 under load From: Pranav Desai To: Leif Hedstrom Cc: users@trafficserver.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On Thu, Sep 16, 2010 at 2:03 PM, Leif Hedstrom wrote: > On 09/16/2010 02:45 PM, Pranav Desai wrote: > > On Thu, Sep 16, 2010 at 12:33 PM, Leif Hedstrom wrote: > > =A0On 09/16/2010 01:26 PM, Pranav Desai wrote: > > Hi! > > I am running a load test with some video files to see . I am using > curl-loader to generate the load. I have modified it to add a random > number to the URLs before sending so I can test with a single URL and > still stress the cache. The webserver is a lighttpd server with > rewrite rules to translate the random strings back to a common URL. > The URL is essentially a 15MB video file. I can provide more details > on the setup if needed. > > Ok, I've created https://issues.apache.org/jira/browse/TS-441 =A0 with th= is > information. If you can find a core file (or, run traffic_server under gd= b), > and get a stack trace, that would be very helpful. Also, when it crashes, > you might get a stack trace in /var/log/messages and/or one of the log fi= les > in the .../var/log/trafficserver =A0directory. > > Will do that. > > Is there an architecture diagram or doc some where that briefly > describes how the system works especially in terms of the roles of the > processes like traffic_manager and traffic_server and how they > interact, communicate. How the threads get the request, who runs the > event loop etc. Even a general block diagram would work for me. It > will of great help in understanding the system. > > > > > Well, the admin guide (http://trafficserver.apache.org/docs/v2/admin/) > should give some ideas on how the system overall runs (processes etc.), a= nd > the developers guide ( http://trafficserver.apache.org/docs/v2/sdk/) will > give some ideas how things works under the hood. > > That much said, I can tell you what the three processes does (big picture= ); > > traffic_cop - This process starts the traffic_manager process, and it's > primary task is to verify that the traffic_server process is responding t= o a > built-in health check. If it doesn't, traffic_cop will kill the > traffic_server process. > traffic_manager - This process is responsible for various "admin" tasks, = and > also implements the (defunct) WebUI. In addition, it binds the "listen" > port(s) that the server will accept requests on, and start the > traffic_server process. If this process dies (either crashes or killed by > traffic_cop), traffic_manager still has the ports bound, and will > immediately restart traffic_server. > traffic_server - This is the primary proxy server process. It will run > number of worker threads (net-threads), where n is configurable but > defaulted to something reasonable based on the number of CPUs. It also ru= ns > I/O threads, by default 4 threads per disk spindle (but this is also > configurable, and 4 is probably to small in many cases). In addition, the= re > are a few "helper" threads for things like logging etc. > That helps, I am looking at strace so its giving me some more info before I start looking into the code. I couldn't find the IO thread option but I guess its proxy.config.cache.threads_per_disk Thanks -- Pranav > Cheers, > > -- leif > >