spark-user mailing list archives: January 2018

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Rohit Karlupia Re: Spark on EMR suddenly stalling Mon, 01 Jan, 15:41
M Singh Re: Spark on EMR suddenly stalling Mon, 01 Jan, 16:12
puneetloya mesos cluster dispatcher Mon, 01 Jan, 21:49
Hyukjin Kwon Re: Custom line/record delimiter Tue, 02 Jan, 01:54
sk skk Re: Custom line/record delimiter Tue, 02 Jan, 01:57
Jeroen Miller Re: Spark on EMR suddenly stalling Tue, 02 Jan, 07:50
Jeroen Miller Re: Spark on EMR suddenly stalling Tue, 02 Jan, 07:53
Gourav Sengupta Re: Spark on EMR suddenly stalling Tue, 02 Jan, 10:14
Anton Puzanov Current way of using functions.window with Java Tue, 02 Jan, 14:05
Lalwani, Jayesh Re: Converting binary files Wed, 03 Jan, 02:48
Lalwani, Jayesh Unclosed NingWSCLient holds up a Spark appication Wed, 03 Jan, 03:00
Jason Heo [Spark SQL] How to run a custom meta query for `ANALYZE TABLE` Wed, 03 Jan, 04:17
Jörn Franke Re: [Spark SQL] How to run a custom meta query for `ANALYZE TABLE` Wed, 03 Jan, 06:22
John Zhuge Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Wed, 03 Jan, 06:57
Jacek Laskowski Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Wed, 03 Jan, 13:46
M Singh Apache Spark - Question about Structured Streaming Sink addBatch dataframe size Wed, 03 Jan, 17:53
Marcelo Vanzin Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Wed, 03 Jan, 17:59
Tathagata Das Re: Apache Spark - Question about Structured Streaming Sink addBatch dataframe size Wed, 03 Jan, 22:27
John Zhuge Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Thu, 04 Jan, 02:46
Marcelo Vanzin Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Thu, 04 Jan, 03:53
John Zhuge Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Thu, 04 Jan, 04:18
William Briggs Structured Streaming + Kafka - Corrupted Checkpoint Offsets / Commits Thu, 04 Jan, 17:08
Marcelo Vanzin Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Thu, 04 Jan, 17:16
M Singh Re: Apache Spark - Question about Structured Streaming Sink addBatch dataframe size Thu, 04 Jan, 21:49
Shixiong(Ryan) Zhu Re: Structured Streaming + Kafka - Corrupted Checkpoint Offsets / Commits Thu, 04 Jan, 21:53
Jacek Laskowski Re: Apache Spark - Question about Structured Streaming Sink addBatch dataframe size Thu, 04 Jan, 22:19
Anu B Nair Java heap space OutOfMemoryError in pyspark spark-submit (spark version:2.2) Fri, 05 Jan, 06:08
Gevorg Hari Spark MLlib Question - Online Scoring of PipelineModel Fri, 05 Jan, 18:23
M Singh Re: Apache Spark - Question about Structured Streaming Sink addBatch dataframe size Fri, 05 Jan, 19:35
Md. Rezaul Karim Reinforcement Learning with Spark Sat, 06 Jan, 01:04
Hien Luu RE: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sat, 06 Jan, 19:42
Fawze Abujaber Re: Spark job failing on jackson dependencies Sat, 06 Jan, 20:50
Jules Damji Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sun, 07 Jan, 00:16
akshay naidu Is Apache Spark-2.2.1 compatible with Hadoop-3.0.0 Sun, 07 Jan, 04:23
Raj Adyanthaya Re: Is Apache Spark-2.2.1 compatible with Hadoop-3.0.0 Sun, 07 Jan, 20:50
Xilang Yan Limit the block size of data received by spring streaming receiver Mon, 08 Jan, 02:36
Saisai Shao Re: Is Apache Spark-2.2.1 compatible with Hadoop-3.0.0 Mon, 08 Jan, 03:17
Tomasz Dudek Reverse MinMaxScaler in SparkML Mon, 08 Jan, 09:10
Irtiza Ali Spark Monitoring using Jolokia Mon, 08 Jan, 13:55
Maximiliano Felice Re: Spark Monitoring using Jolokia Mon, 08 Jan, 14:14
Christopher Piggott binaryFiles() on directory full of directories Mon, 08 Jan, 15:03
Bogdan Cojocar Spark structured streaming time series forecasting Mon, 08 Jan, 15:04
Pralabh Kumar PIG to Spark Mon, 08 Jan, 15:25
akshay naidu Re: Is Apache Spark-2.2.1 compatible with Hadoop-3.0.0 Mon, 08 Jan, 16:52
Josh Rosen Re: Is Apache Spark-2.2.1 compatible with Hadoop-3.0.0 Mon, 08 Jan, 18:17
Christopher Piggott Spark MakeRDD preferred workers Mon, 08 Jan, 20:51
Thakrar, Jayesh Re: Spark Monitoring using Jolokia Mon, 08 Jan, 20:57
Nathan Kronenfeld select with more than 5 typed columns Mon, 08 Jan, 23:01
Felix Cheung Re: Is Apache Spark-2.2.1 compatible with Hadoop-3.0.0 Mon, 08 Jan, 23:33
Jeff Zhang Re: PIG to Spark Tue, 09 Jan, 04:50
Gourav Sengupta Re: Spark Monitoring using Jolokia Tue, 09 Jan, 13:18
Gourav Sengupta Re: PIG to Spark Tue, 09 Jan, 13:31
Uchoa, Rodrigo [SPARK-CORE] JVM Properties passed as -D, not being found inside UDAF classes Tue, 09 Jan, 13:59
Nan Zhu Palantir replease under org.apache.spark? Tue, 09 Jan, 17:42
Nan Zhu Re: Palantir replease under org.apache.spark? Tue, 09 Jan, 17:58
Sean Owen Re: Palantir replease under org.apache.spark? Tue, 09 Jan, 18:10
Andrew Ash Re: Palantir replease under org.apache.spark? Tue, 09 Jan, 19:27
Jhon Anderson Cardenas Diaz Spark UI stdout/stderr links point to executors internal address Tue, 09 Jan, 22:13
Tathagata Das Re: Spark structured streaming time series forecasting Tue, 09 Jan, 22:23
Jhon Anderson Cardenas Diaz How to create security filter for Spark UI in Spark on YARN Tue, 09 Jan, 22:23
Alex Nastetsky Dataset API inconsistencies Wed, 10 Jan, 00:45
Michael Armbrust Re: Dataset API inconsistencies Wed, 10 Jan, 09:48
Selvam Raman Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Wed, 10 Jan, 11:58
Liana Napalkova py4j.protocol.Py4JJavaError: An error occurred while calling o794.parquet Wed, 10 Jan, 16:58
Joel D No Tasks have reported metrics yet Wed, 10 Jan, 18:00
Timur Shenkao Re: py4j.protocol.Py4JJavaError: An error occurred while calling o794.parquet Wed, 10 Jan, 19:07
Dongjoon Hyun Vectorized ORC Reader in Apache Spark 2.3 with Apache ORC 1.4.1. Wed, 10 Jan, 19:14
Liana Napalkova Re: py4j.protocol.Py4JJavaError: An error occurred while calling o794.parquet Wed, 10 Jan, 20:04
Felix Cheung Re: py4j.protocol.Py4JJavaError: An error occurred while calling o794.parquet Thu, 11 Jan, 00:43
Yuval Itzchakov Regression in Spark SQL UI Tab in Spark 2.2.1 Thu, 11 Jan, 13:50
Sara Galindo Martínez Logback + Spark 2.2.0 Thu, 11 Jan, 15:02
Steve Loughran Re: Palantir replease under org.apache.spark? Thu, 11 Jan, 19:59
sk skk Timestamp changing while writing Fri, 12 Jan, 00:48
강민우 Is there alternative HiveStoragePredicateHandler#decomposePredicate? Fri, 12 Jan, 05:43
NinjaYali Using Logistic regression with SGD in Spark ML Fri, 12 Jan, 21:23
daniel williams flatMapGroupsWithState not timing out (spark 2.2.1) Fri, 12 Jan, 22:36
Tathagata Das Re: flatMapGroupsWithState not timing out (spark 2.2.1) Fri, 12 Jan, 23:39
sk skk Spark preserve timestamp Sat, 13 Jan, 00:21
Tathagata Das Re: flatMapGroupsWithState not timing out (spark 2.2.1) Sat, 13 Jan, 00:22
Jacek Laskowski Re: Inner join with the table itself Mon, 15 Jan, 10:09
Gengliang Wang Re: Inner join with the table itself Mon, 15 Jan, 10:27
Fernando Pereira End of Stream errors in shuffle Mon, 15 Jan, 10:32
abdul.h.huss...@bt.com [Spark DataFrame]: Passing DataFrame to custom method results in NullPointerException Mon, 15 Jan, 11:56
Michael Shtelma Re: Inner join with the table itself Mon, 15 Jan, 14:26
pratyush04 Re: End of Stream errors in shuffle Mon, 15 Jan, 14:30
Saravanan Nagarajan 3rd party hadoop input formats for EDI formats Mon, 15 Jan, 18:01
Matt Hicks [Spark ML] Positive-Only Training Classification in Scala Mon, 15 Jan, 18:21
Jörn Franke Re: 3rd party hadoop input formats for EDI formats Mon, 15 Jan, 18:42
Jörn Franke Re: [Spark ML] Positive-Only Training Classification in Scala Mon, 15 Jan, 19:04
Georg Heiler Re: [Spark ML] Positive-Only Training Classification in Scala Mon, 15 Jan, 19:55
Matt Hicks Re: [Spark ML] Positive-Only Training Classification in Scala Mon, 15 Jan, 19:56
Georg Heiler Re: [Spark ML] Positive-Only Training Classification in Scala Mon, 15 Jan, 20:07
Jacek Laskowski Re: Inner join with the table itself Mon, 15 Jan, 21:33
Bryan Cutler Re: Timestamp changing while writing Mon, 15 Jan, 21:57
kant kodali can HDFS be a streaming source like Kafka in Spark 2.2.0? Mon, 15 Jan, 22:41
Ted Yu Re: Broken SQL Visualization? Mon, 15 Jan, 23:07
Gerard Maas Re: can HDFS be a streaming source like Kafka in Spark 2.2.0? Mon, 15 Jan, 23:45
Manuel Sopena Ballesteros spark-submit can find python? Mon, 15 Jan, 23:53
Manuel Sopena Ballesteros RE: spark-submit can find python? Tue, 16 Jan, 00:02
kant kodali Re: can HDFS be a streaming source like Kafka in Spark 2.2.0? Tue, 16 Jan, 00:20
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
May 2019252
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137