spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Liu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-16332) the history server of spark2.0-preview (may-24 build) consumes more than 1000% cpu
Date Sat, 16 Jul 2016 20:06:20 GMT

     [ https://issues.apache.org/jira/browse/SPARK-16332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Peter Liu updated SPARK-16332:
------------------------------
    Attachment: graycol.gif


Hi Sean,

I have a general question:

Is there a limit for reporting issues?

I was able to create the current two issue tickets with a link under "my
open issues" tab (using this JIRA service) "Try modifying your search
criteria or creating a new issue".

However, this link "creating a new issue" has now disappeared under "my
open issues" tab.

Thanks for any information/help.

Best Regards,

Peter G. Liu
STG Power System Performance
IBM Toronto Lab
Phone:  905-413-3132
email: gliu@ca.ibm.com



From:	"Sean Owen (JIRA)" <jira@apache.org>
To:	Gang L Liu/Toronto/IBM@IBMCA
Date:	06/30/2016 04:00 PM
Subject:	[jira] [Commented] (SPARK-16332) the history server of
            spark2.0-preview (may-24 build) consumes more than 1000% cpu




    [
https://issues.apache.org/jira/browse/SPARK-16332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357759#comment-15357759
 ]

Sean Owen commented on SPARK-16332:
-----------------------------------

I'm not sure that's an issue per se. It might consume a lot at startup, or
when processing lots of events. Or if under GC load. Without more detail
it's hard to say that's a problem.

1000% cpu
----------------------------------------------------------------------------------

E5-2699 ) and ppc platform IBM Power8 Habanero (Model: 8348-21C), Red Hat
Enterprise Linux Server release 7.2 (Maipo), Spark2.0.0-preview (May-24,
2016)
build) consumes more than 1000% cpu without the spark standalone cluster
(of 6 nodes) being under load.
instance of the Spark history server of spark2.0-preview consumes 2000% cpu
(as seen with "top" on linux 3.10)
issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)




> the history server of spark2.0-preview (may-24 build) consumes more than 1000% cpu
> ----------------------------------------------------------------------------------
>
>                 Key: SPARK-16332
>                 URL: https://issues.apache.org/jira/browse/SPARK-16332
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.0.0
>         Environment: this is seen on both x86 (Intel(R) Xeon(R), E5-2699 ) and ppc platform
IBM Power8 Habanero (Model: 8348-21C), Red Hat Enterprise Linux Server release 7.2 (Maipo),
Spark2.0.0-preview (May-24, 2016)
>            Reporter: Peter Liu
>         Attachments: graycol.gif
>
>
> the JVM instance of the Spark history server of spark2.0-preview (may-24 build) consumes
more than 1000% cpu without the spark standalone cluster (of 6 nodes) being under load. 
> When under load (1TB input data for a SQL query scenario), the JVM instance of the Spark
history server of spark2.0-preview consumes 2000% cpu (as seen with "top" on linux 3.10)
> Note: can't see a proper Component selection here, surely not a Web GUI issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message