spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yxzhao <yxz...@ualr.edu>
Subject Re: Measure the Total Network I/O, Cpu and Memory Consumed by Spark Job
Date Mon, 14 Apr 2014 15:13:35 GMT
Thanks very much.



On Mon, Apr 14, 2014 at 9:53 AM, dachuan [via Apache Spark User List] <
ml-node+s1001560n4214h75@n3.nabble.com> wrote:

> I haven't tried before, but it seems Ganglia could be the tool.
>
>
> On Wed, Apr 2, 2014 at 6:40 PM, yxzhao <[hidden email]<http://user/SendEmail.jtp?type=node&node=4214&i=0>
> > wrote:
>
>> Hi All,
>>
>>       I am intrested in measure the total network I/O, cpu and memory
>> consumed by Spark job. I tried to find the related information in logs and
>> Web UI. But there seems no sufficient information. Could anyone give me
>> any
>> suggestion?
>>       Thanks very much in advance.
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Measure-the-Total-Network-I-O-Cpu-and-Memory-Consumed-by-Spark-Job-tp3668.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>
>
>
> --
> Dachuan Huang
> Cellphone: 614-390-7234
> 2015 Neil Avenue
> Ohio State University
> Columbus, Ohio
> U.S.A.
> 43210
>
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/Measure-the-Total-Network-I-O-Cpu-and-Memory-Consumed-by-Spark-Job-tp3668p4214.html
>  To unsubscribe from Measure the Total Network I/O, Cpu and Memory
> Consumed by Spark Job, click here<http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=3668&code=eXh6aGFvQHVhbHIuZWR1fDM2Njh8LTY0Mjc0NDkzMQ==>
> .
> NAML<http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Measure-the-Total-Network-I-O-Cpu-and-Memory-Consumed-by-Spark-Job-tp3668p4216.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Mime
View raw message