From user-return-69205-apmail-spark-user-archive=spark.apache.org@spark.apache.org Tue Apr 18 21:26:25 2017 Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 708FE18D60 for ; Tue, 18 Apr 2017 21:26:25 +0000 (UTC) Received: (qmail 75777 invoked by uid 500); 18 Apr 2017 21:26:18 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 75638 invoked by uid 500); 18 Apr 2017 21:26:18 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 75628 invoked by uid 99); 18 Apr 2017 21:26:18 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Apr 2017 21:26:18 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 5339AC39CC for ; Tue, 18 Apr 2017 21:26:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.813 X-Spam-Level: ** X-Spam-Status: No, score=2.813 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, KAM_LINKBAIT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, URI_HEX=1.313] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id PL4m4sw6sMuv for ; Tue, 18 Apr 2017 21:26:17 +0000 (UTC) Received: from mwork.nabble.com (mwork.nabble.com [162.253.133.43]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 034475F576 for ; Tue, 18 Apr 2017 21:26:16 +0000 (UTC) Received: from mben.nabble.com (unknown [162.253.133.72]) by mwork.nabble.com (Postfix) with ESMTP id BCD983AEFC4CF for ; Tue, 18 Apr 2017 14:26:16 -0700 (MST) Date: Tue, 18 Apr 2017 14:26:16 -0700 (MST) From: gae123 To: user@spark.apache.org Message-ID: <1492550776768-28611.post@n3.nabble.com> Subject: Spark 2.1.0 hanging while writing a table in HDFS in parquet format MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit I have put more details and stack traces here: http://stackoverflow.com/questions/43462638/emr-spark-2-1-0-process-get-stuck-at-at-org-apache-spark-unsafe-platform-copymem Any suggestions would be very much appreciated. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-2-1-0-hanging-while-writing-a-table-in-HDFS-in-parquet-format-tp28611.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscribe@spark.apache.org