From dev-return-22480-apmail-ignite-dev-archive=ignite.apache.org@ignite.apache.org Tue Jun 6 02:42:20 2017 Return-Path: X-Original-To: apmail-ignite-dev-archive@minotaur.apache.org Delivered-To: apmail-ignite-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E40AE1AF90 for ; Tue, 6 Jun 2017 02:42:20 +0000 (UTC) Received: (qmail 19289 invoked by uid 500); 6 Jun 2017 02:42:20 -0000 Delivered-To: apmail-ignite-dev-archive@ignite.apache.org Received: (qmail 19238 invoked by uid 500); 6 Jun 2017 02:42:20 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 19223 invoked by uid 99); 6 Jun 2017 02:42:20 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Jun 2017 02:42:20 +0000 Received: from mail-it0-f45.google.com (mail-it0-f45.google.com [209.85.214.45]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id C63571A0A97 for ; Tue, 6 Jun 2017 02:42:19 +0000 (UTC) Received: by mail-it0-f45.google.com with SMTP id m47so81073740iti.1 for ; Mon, 05 Jun 2017 19:42:19 -0700 (PDT) X-Gm-Message-State: AODbwcBH9fFe8s+PKQLOoYmc998JiF4NUhgVACtRnvetBuWzjnF+YWsd 1L8sYdU7d2wQD11lD/3Y8bSW9Zc2MU5m X-Received: by 10.107.37.206 with SMTP id l197mr13435737iol.162.1496716939099; Mon, 05 Jun 2017 19:42:19 -0700 (PDT) MIME-Version: 1.0 Received: by 10.50.82.105 with HTTP; Mon, 5 Jun 2017 19:41:38 -0700 (PDT) In-Reply-To: <20170606014625.GB16350@boudnik.org> References: <20170606014625.GB16350@boudnik.org> From: Dmitriy Setrakyan Date: Mon, 5 Jun 2017 19:41:38 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Fwd: Persistent Distributed Store Metrics To: dev@ignite.apache.org Cc: Konstantin Boudnik Content-Type: multipart/alternative; boundary="001a113f618a7c202c05514191c5" --001a113f618a7c202c05514191c5 Content-Type: text/plain; charset="UTF-8" On Mon, Jun 5, 2017 at 6:46 PM, Konstantin Boudnik wrote: > Wow, hold on - as far as I remember there was a VOTE to accept the > contribution of the code into the project _on a branch_. We haven't vetted > its > inclusion into the next release, We are still at the phase of getting > familiar > with the code. > Cos, the community has been vetting the inclusion of the new code for over 3 weeks already (the process and dates are documented here [2]). To be honest, I am not sure what the appropriate time frame should be, but I would think that a month would be a good check-in point. There is also an active stabilization thread for the persistence branch [3]. I encouraged the community to get involved and post any questions or concerns there as well. There is an upcoming in-memory computing conference that is coming up in June in Amsterdam [4], where there are many Ignite talks scheduled. It would be great to be able to talk about the persistence features of Ignite there as well. I would like to ask the community to mobilize with reviewing the donated code, so we could have something concrete to tell the audience on the conference. [2] http://incubator.apache.org/ip-clearance/persistent-distributed-store-ignite.html [3] http://apache-ignite-developers.2346864.n4.nabble.com/Persistent-Store-Stabilization-for-release-td18288.html [4] https://imcsummit.org/ > And from what I am seeing in the discussions like this [1], we need to be > extra careful. > I would keep the discussion in [1] separate from the persistence store. These are 2 unrelated issues. I will respond on [1] either today or tomorrow, but I agree in general that it should be fixed ASAP. > BTW, you have sent this email 9 days before the vote had happened! A bit > too > soon, if you ask me. > Cos, this email was sent 1 week after the initial donated code branch was presented to the community (see [2] above). The developers involved were eager to make it available to the users as soon as possible, but no code has been merged to the master branch yet. I would like to encourage everyone in the community to participate in the persistence branch coding discussions, like the one in this thread, and familiarize themselves with the code. > > [1] https://is.gd/UQCr51 > > Cos > > On Wed, May 17, 2017 at 11:16AM, Dmitriy Govorukhin wrote: > > Folk, > > > > As you know, ignite 2.1 will contain new module (pds), it will be > > provide ability to store data on disk. Let's discuss what type of > > metrics we need for this? > > I think it must be metrics per memory policy, per cache, checkpoint, > > and global metrics which will be aggregate all metrics. > > > > I did sketch. > > > > PersistentStoreMetrics.java > > > > public interface PersistentStoreMetrics { > > > > // Global metrics. > > > > public long getMemorySize(); > > > > public long getDiskSize(); > > > > public long getPagesInMemory(); > > > > public long getPagesSizeInMemory(); > > > > public long getPagesOnDisk(); > > > > public long getPagesSizeOnDisk(); > > > > public long getFreePages(); > > > > public long getFreePagesSize(); > > > > public long getDirtyPages(); > > > > public long getDirtyPagesSize(); > > > > public long walLog(); > > > > public long walLogSize(); > > > > // Frequency. > > > > public long getPagesRead(); > > > > public long getPagesWrite(); > > > > public long getFsync(); > > > > public long getWal(); > > > > public long getAverageWalFsyncTime(); > > > > // Per cache. > > > > public PersistentStoreCacheMetrics cache(String name); > > > > public PersistentStoreCacheMetrics cache(int cacheId); > > > > // For last checkpoint. > > > > public PersistentStoreCheckpointMetrics getLastCheckPoint(); > > } > > > > >>>>>>>>>>>>>>>>>>>>>>> > > > > PersistentStoreCacheMetrics.java > > > > public interface PersistentStoreCacheMetrics { > > > > public String name(); > > > > public double getFillFactor(); > > > > public double getFillFactor(int part); > > > > public long getMemorySize(); > > > > public long getDiskSize(); > > > > public long getPagesInMemory(); > > > > public long getPagesSizeInMemory(); > > > > public long getPagesOnDisk(); > > > > public long getPagesSizeOnDisk(); > > > > public long getFreePages(); > > > > public long getFreePagesSize(); > > > > public long getDirtyPages(); > > > > public long getDirtyPagesSize(); > > > > public long getPagesRead(); > > > > public long getPagesWritten(); > > } > > > > >>>>>>>>>>>>>>>>>>>>>>> > > > > PersistentStoreCheckpointMetrics.java > > > > public interface PersistentStoreCheckpointMetrics { > > > > public long getTotalPages(); > > > > //TODO Page type is internal? > > public long[] pagesType(); > > > > public long getExecutingTime(); > > > > public long getFsyncTime(); > > > > public long getPagesCopyOnWrite(); > > } > --001a113f618a7c202c05514191c5--