spark-user mailing list archives: March 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Dylan Guedes Re: Multiple Kafka Spark Streaming Dataframe Join query Wed, 14 Mar, 19:07
Eirik Thorsnes ORC native in Spark 2.3, with zlib, gives java.nio.BufferUnderflowException during read Fri, 23 Mar, 15:03
Fawze Abujaber Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Thu, 22 Mar, 04:48
Fawze Abujaber Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Fri, 23 Mar, 04:33
Fawze Abujaber Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Fri, 23 Mar, 16:24
Fawze Abujaber Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Sun, 25 Mar, 07:40
Fawze Abujaber Spark logs compression Mon, 26 Mar, 16:17
Fawze Abujaber Re: Spark logs compression Mon, 26 Mar, 17:02
Fawze Abujaber Re: Spark logs compression Mon, 26 Mar, 17:10
Fawze Abujaber Re: Spark logs compression Mon, 26 Mar, 17:48
Fawze Abujaber Re: Spark logs compression Mon, 26 Mar, 18:01
Fawze Abujaber Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Tue, 27 Mar, 02:23
Fawze Abujaber Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Tue, 27 Mar, 03:50
Felix Cheung Re: Question on Spark-kubernetes integration Sat, 03 Mar, 05:32
Felix Cheung Re: Question on Spark-kubernetes integration Sat, 03 Mar, 05:46
Felix Cheung Re: broken UI in 2.3? Wed, 07 Mar, 05:10
Felix Cheung Re: How to start practicing Python Spark Streaming in Linux? Thu, 15 Mar, 04:59
Felix Cheung Re: Custom metrics sink Sat, 17 Mar, 00:17
Felix Cheung Re: [Spark R]: Linear Mixed-Effects Models in Spark R Tue, 27 Mar, 04:18
Femi Anthony Re: Spark Application stuck Wed, 14 Mar, 08:49
Femi Anthony Re: How to run spark shell using YARN Wed, 14 Mar, 09:03
Femi Anthony Re: How to run spark shell using YARN Wed, 14 Mar, 09:46
Femi Anthony Re: Insufficient memory for Java Runtime Wed, 14 Mar, 10:06
Femi Anthony Re: Sparklyr and idle executors Fri, 16 Mar, 07:09
FireFly Issue with using Generalized Linear Regression for Logistic Regression modeling Fri, 09 Mar, 17:22
Florian Dewes Sparklyr and idle executors Thu, 15 Mar, 17:47
Florian Dewes Re: Sparklyr and idle executors Fri, 16 Mar, 07:49
GabeChurch Bisecting Kmeans Linkage Matrix Output (Cluster Indices) Wed, 14 Mar, 16:07
Gauthier Feuillen Local dirs Mon, 26 Mar, 20:08
Gauthier Feuillen Re: Local dirs Mon, 26 Mar, 20:10
Gauthier Feuillen Re: Class cast exception while using Data Frames Mon, 26 Mar, 20:41
Geoff Von Allmen Structured Streaming: distinct (Spark 2.2) Mon, 19 Mar, 19:04
Geoff Von Allmen Re: select count * doesnt seem to respect update mode in Kafka Structured Streaming? Mon, 19 Mar, 20:57
Geoff Von Allmen Re: select count * doesnt seem to respect update mode in Kafka Structured Streaming? Tue, 20 Mar, 13:09
Georg Heiler Upgrades of streaming jobs Thu, 08 Mar, 20:11
Georg Heiler Re: Multiple Kafka Spark Streaming Dataframe Join query Wed, 14 Mar, 14:54
Gerard Maas Re: Spark StreamingContext Question Wed, 07 Mar, 09:32
Gerard Maas Re: Scala - Spark for beginners Sun, 18 Mar, 15:30
Gourav Dutta Re: Writing a DataFrame is taking too long and huge space Fri, 09 Mar, 12:40
Gourav Sengupta Re: Issues with large schema tables Thu, 08 Mar, 15:01
Gourav Sengupta Re: what is the right syntax for self joins in Spark 2.3.0 ? Thu, 08 Mar, 17:18
Gourav Sengupta Re: Rest API for Spark2.3 submit on kubernetes(version 1.8.*) cluster Wed, 21 Mar, 14:32
Gourav Sengupta Re: Rest API for Spark2.3 submit on kubernetes(version 1.8.*) cluster Thu, 22 Mar, 00:27
Gourav Sengupta closure issues: wholeTextFiles Tue, 27 Mar, 22:58
Gourav Sengupta Re: Running out of space on /tmp file system while running spark job on yarn because of size of blockmgr folder Wed, 28 Mar, 05:37
Gourav Sengupta Re: Running out of space on /tmp file system while running spark job on yarn because of size of blockmgr folder Wed, 28 Mar, 09:22
Gourav Sengupta Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Sat, 31 Mar, 18:41
Guillermo Ortiz Spark Streaming reading many topics with Avro Fri, 02 Mar, 17:20
Guillermo Ortiz Connection SparkStreaming with SchemaRegistry Fri, 09 Mar, 11:37
Guillermo Ortiz Testing with spark-base-test Wed, 28 Mar, 11:08
Gurusamy Thirupathy Hive to Oracle using Spark - Type(Date) conversion issue Mon, 19 Mar, 02:34
Gurusamy Thirupathy Re: Hive to Oracle using Spark - Type(Date) conversion issue Tue, 20 Mar, 02:45
Gurusamy Thirupathy Re: Hive to Oracle using Spark - Type(Date) conversion issue Wed, 21 Mar, 03:08
Hien Luu Re: Writing custom Structured Streaming receiver Sun, 04 Mar, 01:31
Hien Luu Re: Writing custom Structured Streaming receiver Sun, 04 Mar, 17:44
Holden Karau Live Streamed Code Review today at 11am Pacific Fri, 09 Mar, 17:28
Holden Karau Re: Live Streamed Code Review today at 11am Pacific Fri, 09 Mar, 23:54
Holden Karau Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Thu, 22 Mar, 04:38
Huiliang Zhang Resource manage inside map function Sat, 31 Mar, 00:54
Hyukjin Kwon Re: [PySpark SQL] sql function to_date and to_timestamp return the same data type Mon, 19 Mar, 05:47
Igor Makhlin In spark streaming application how to distinguish between normal and abnormal termination of application? Sat, 31 Mar, 10:59
Jacek Laskowski NPE in Subexpression Elimination optimization Fri, 16 Mar, 14:56
Jacek Laskowski Re: NPE in Subexpression Elimination optimization Sun, 18 Mar, 17:21
Jacek Laskowski Re: Run spark 2.2 on yarn as usual java application Mon, 19 Mar, 06:16
Jean Georges Perrin Re: What's the best way to have Spark a service? Thu, 15 Mar, 11:20
Jenna Hoole Spark on K8s resource staging server timeout Tue, 27 Mar, 17:48
Jenna Hoole Re: Spark on K8s resource staging server timeout Thu, 29 Mar, 17:36
Jenna Hoole Re: Spark on K8s resource staging server timeout Thu, 29 Mar, 20:44
Jeremy Liu [Spark R] Proposal: Exposing RBackend in RRunner Tue, 27 Mar, 17:04
Jone Zhang SparkStraming job break with shuffle file not found Wed, 28 Mar, 12:21
Jordan Pilat Spark UI Streaming batch time interval does not match batch interval Mon, 12 Mar, 21:22
Jorge Machado HadoopDelegationTokenProvider Wed, 21 Mar, 14:32
Jorge Machado Re: Spark Druid Ingestion Thu, 22 Mar, 07:24
Jorge Machado Re: Is there a mutable dataframe spark structured streaming 2.3.0? Thu, 22 Mar, 09:08
Jorge Machado Spark and Accumulo Delegation tokens Fri, 23 Mar, 06:29
Jorge Machado Re: Spark and Accumulo Delegation tokens Fri, 23 Mar, 07:10
Josh Goldsborough Re: Rest API for Spark2.3 submit on kubernetes(version 1.8.*) cluster Wed, 21 Mar, 23:09
Josh Goldsborough [Spark R]: Linear Mixed-Effects Models in Spark R Mon, 26 Mar, 20:46
Jules Damji Re: Calling Pyspark functions in parallel Mon, 19 Mar, 13:46
Junfeng Chen CachedKafkaConsumer: CachedKafkaConsumer is not running in UninterruptibleThread warning Tue, 06 Mar, 09:53
Junfeng Chen Re: CachedKafkaConsumer: CachedKafkaConsumer is not running in UninterruptibleThread warning Wed, 07 Mar, 01:11
Junfeng Chen Reading kafka and save to parquet problem Thu, 08 Mar, 01:33
Junfeng Chen Re: Reading kafka and save to parquet problem Thu, 08 Mar, 01:51
Junfeng Chen DataSet save to parquet partition problem Fri, 09 Mar, 05:55
Junfeng Chen Queries with streaming sources must be executed with writeStream.start();; Tue, 27 Mar, 07:37
Junfeng Chen [Spark Java] Add new column in DataSet based on existed column Wed, 28 Mar, 07:16
Kamalanathan Venkatesan Need config params while doing rdd.foreach or map Thu, 22 Mar, 09:18
Keith Chapman Can I get my custom spark strategy to run last? Fri, 02 Mar, 01:20
Keith Chapman Re: Running out of space on /tmp file system while running spark job on yarn because of size of blockmgr folder Mon, 19 Mar, 17:07
Keith Chapman Re: Running out of space on /tmp file system while running spark job on yarn because of size of blockmgr folder Mon, 19 Mar, 17:38
Keith Chapman Re: Running out of space on /tmp file system while running spark job on yarn because of size of blockmgr folder Mon, 26 Mar, 19:15
Kevin Peng spark jdbc postgres query results don't match those of postgres query Thu, 29 Mar, 15:04
KhajaAsmath Mohammed Dynamic allocation Spark Stremaing Tue, 06 Mar, 19:55
KhajaAsmath Mohammed Transaction Examplefor spark streaming in Spark2.2 Fri, 23 Mar, 01:59
Koert Kuipers change spark default for a setting without overriding user Fri, 16 Mar, 22:43
Koert Kuipers all spark settings end up being system properties Fri, 30 Mar, 18:41
Koert Kuipers Re: all spark settings end up being system properties Fri, 30 Mar, 18:48
Kurt Fehlhauer Re: EDI (Electronic Data Interchange) parser on Spark Tue, 13 Mar, 14:01
Lalwani, Jayesh Question on Spark-kubernetes integration Fri, 02 Mar, 16:08
Lalwani, Jayesh Incompatibility in LZ4 dependencies Thu, 08 Mar, 17:36
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Sep 202178
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137