From issues-return-229304-apmail-flink-issues-archive=flink.apache.org@flink.apache.org Tue Apr 30 12:56:02 2019 Return-Path: X-Original-To: apmail-flink-issues-archive@minotaur.apache.org Delivered-To: apmail-flink-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by minotaur.apache.org (Postfix) with SMTP id 09DF018B41 for ; Tue, 30 Apr 2019 12:56:01 +0000 (UTC) Received: (qmail 81945 invoked by uid 500); 30 Apr 2019 12:56:01 -0000 Delivered-To: apmail-flink-issues-archive@flink.apache.org Received: (qmail 81910 invoked by uid 500); 30 Apr 2019 12:56:01 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 81899 invoked by uid 99); 30 Apr 2019 12:56:01 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Apr 2019 12:56:01 +0000 Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id BB2D5E28E1 for ; Tue, 30 Apr 2019 12:56:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 6FFC124597 for ; Tue, 30 Apr 2019 12:56:00 +0000 (UTC) Date: Tue, 30 Apr 2019 12:56:00 +0000 (UTC) From: "Nico Kruber (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-10317) Configure Metaspace size by default MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/FLINK-10317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830265#comment-16830265 ] Nico Kruber commented on FLINK-10317: ------------------------------------- I'm actually unsure whether we should set a default now, It seems I was mistaken by thinking that GC is only triggered if {{MaxMetaspaceSize}} is set, but it seems that this is not true and indeed first GC starts with {{MetaspaceSize}} and then depending on the GC itself. Therefore, setting {{MaxMetaspaceSize}} would ease troubleshooting by failing earlier in case of class loader leaks but wouldn't solve anything on its own. > Configure Metaspace size by default > ----------------------------------- > > Key: FLINK-10317 > URL: https://issues.apache.org/jira/browse/FLINK-10317 > Project: Flink > Issue Type: Bug > Components: Deployment / Scripts > Affects Versions: 1.5.3, 1.6.0, 1.7.0 > Reporter: Stephan Ewen > Priority: Major > Fix For: 1.7.3, 1.6.5 > > Attachments: Screen Shot 2019-01-07 at 10.08.39.png, Screen Shot 2019-01-07 at 10.08.47.png, Screenshot 2018-12-18 at 12.14.11.png > > > We should set the size of the JVM Metaspace to a sane default, like {{-XX:MaxMetaspaceSize=256m}}. > If not set, the JVM offheap memory will grow indefinitely with repeated classloading and Jitting, eventually exceeding allowed memory on docker/yarn or similar setups. > It is hard to come up with a good default, however, I believe the error messages one gets when metaspace is too small are easy to understand (and easy to take action), while it is very hard to figure out why the memory footprint keeps growing steadily and infinitely. -- This message was sent by Atlassian JIRA (v7.6.3#76005)