giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-505) Metrics Updates
Date Thu, 07 Feb 2013 01:35:13 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13573088#comment-13573088
] 

Hudson commented on GIRAPH-505:
-------------------------------

Integrated in Giraph-trunk-Commit #682 (See [https://builds.apache.org/job/Giraph-trunk-Commit/682/])
    GIRAPH-505: Metrics Updates (nitay) (Revision 8ed06fe5f736d135ca4a7fb208a20f5844c15781)

     Result = SUCCESS
nitay : http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=8ed06fe5f736d135ca4a7fb208a20f5844c15781
Files : 
* giraph-core/src/main/java/org/apache/giraph/graph/ComputeCallable.java
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/metrics/SuperstepMetricsRegistry.java
* giraph-core/src/main/java/org/apache/giraph/master/BspServiceMaster.java
* giraph-core/src/main/java/org/apache/giraph/metrics/GiraphMetrics.java
* giraph-core/src/main/java/org/apache/giraph/metrics/AggregatedMetrics.java
* giraph-core/src/main/java/org/apache/giraph/metrics/GiraphMetricsRegistry.java
* giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java
* giraph-core/src/main/java/org/apache/giraph/worker/EdgeInputSplitsCallable.java
* giraph-core/src/main/java/org/apache/giraph/comm/netty/NettyWorkerClientRequestProcessor.java
* giraph-core/src/main/java/org/apache/giraph/comm/netty/NettyWorkerClient.java
* giraph-core/src/main/java/org/apache/giraph/comm/requests/SendPartitionMutationsRequest.java
* giraph-core/src/main/java/org/apache/giraph/utils/MemoryUtils.java
* giraph-core/src/main/java/org/apache/giraph/worker/VertexInputSplitsCallable.java
* giraph-core/src/main/java/org/apache/giraph/metrics/WorkerSuperstepMetrics.java
* giraph-core/src/main/java/org/apache/giraph/metrics/MeterDesc.java
* giraph-core/src/main/java/org/apache/giraph/metrics/TimerDesc.java
* giraph-core/src/main/java/org/apache/giraph/worker/InputSplitsCallable.java
* giraph-core/src/main/java/org/apache/giraph/comm/netty/ByteCounter.java
* giraph-core/src/main/java/org/apache/giraph/graph/GraphTaskManager.java
* giraph-core/src/main/java/org/apache/giraph/metrics/MetricNames.java

                
> Metrics Updates
> ---------------
>
>                 Key: GIRAPH-505
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-505
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Nitay Joffe
>            Assignee: Nitay Joffe
>         Attachments: GIRAPH-505.patch
>
>
> This patch adds the following:
> 1) Per-superstep, per-request-type counters. For example a counter for how many "SendPartitionMutationRequest"
messages are sent.
> 2) Per-superstep counters and gauges for how many requests are handled locally vs. sent
across network.
> 3) Add some helpers like MetricNames and MeterDesc to centralize definitions of metrics
used in Giraph all in one place.
> 4) Better input loading metrics. Track total edges/vertices loaded and overall rate regardless
of how many threads are involved. Updates the log/status message to look like (with 10 threads)
e.g:
> readEdgeInputSplit: Loaded 619000000 edges at 3578098.2516499613 edges/sec Memory (free/total/max)
= 61174.90400695801M/120832.0M/120832.0M 
> This is much clearer for the user and more informative.
> https://reviews.apache.org/r/9341/

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message