spark-user mailing list archives: July 2020

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Re: Question about 'maxOffsetsPerTrigger'
Jungtaek Lim   Re: Question about 'maxOffsetsPerTrigger' Wed, 01 Jul, 00:09
ivo.kn...@t-online.de Running Apache Spark Streaming on the GraalVM Native Image Wed, 01 Jul, 07:56
Pasha Finkelshteyn   Re: Running Apache Spark Streaming on the GraalVM Native Image Wed, 01 Jul, 14:04
Umesh Bansal upsert dataframe to kudu Wed, 01 Jul, 13:04
Umesh Bansal   upsert dataframe to kudu Mon, 06 Jul, 16:54
Amit Sharma Truncate table Wed, 01 Jul, 14:47
Russell Spitzer   Re: Truncate table Wed, 01 Jul, 15:18
Sam Elamin REST Structured Steaming Sink Wed, 01 Jul, 18:21
Jungtaek Lim   Re: REST Structured Steaming Sink Wed, 01 Jul, 21:21
Holden Karau     Re: REST Structured Steaming Sink Thu, 02 Jul, 00:54
Burak Yavuz       Re: REST Structured Steaming Sink Thu, 02 Jul, 01:12
Holden Karau         Re: REST Structured Steaming Sink Thu, 02 Jul, 01:16
Andrew Melo         Re: REST Structured Steaming Sink Thu, 02 Jul, 01:40
Burak Yavuz           Re: REST Structured Steaming Sink Thu, 02 Jul, 02:30
Sam Elamin             Re: REST Structured Steaming Sink Fri, 03 Jul, 09:25
Fwd: Announcing ApacheCon @Home 2020
Felix Cheung   Fwd: Announcing ApacheCon @Home 2020 Thu, 02 Jul, 04:15
Spark streaming with Kafka
dwgw   Spark streaming with Kafka Thu, 02 Jul, 09:32
dwgw   Spark streaming with Kafka Thu, 02 Jul, 09:35
Jungtaek Lim     Re: Spark streaming with Kafka Fri, 03 Jul, 03:31
dwgw       Re: Spark streaming with Kafka Fri, 03 Jul, 05:36
Re: File Not Found: /tmp/spark-events in Spark 3.0
Xin Jinhan   Re: File Not Found: /tmp/spark-events in Spark 3.0 Thu, 02 Jul, 12:39
Zero     Re: File Not Found: /tmp/spark-events in Spark 3.0 Thu, 02 Jul, 13:19
ArtemisDev       Re: File Not Found: /tmp/spark-events in Spark 3.0 Sun, 05 Jul, 14:33
Xin Jinhan   Re: File Not Found: /tmp/spark-events in Spark 3.0 Thu, 02 Jul, 13:03
Eric Beabes Failure Threshold in Spark Structured Streaming? Thu, 02 Jul, 16:24
Jungtaek Lim   Re: Failure Threshold in Spark Structured Streaming? Fri, 03 Jul, 03:03
Terry Kim Hyperspace v0.1 is now open-sourced! Thu, 02 Jul, 17:56
Terry Kim Announcing .NET for Apache Spark™ 0.12 Thu, 02 Jul, 19:17
dwgw Spark streaming with Confluent kafka Fri, 03 Jul, 08:44
Gabor Somogyi   Re: Spark streaming with Confluent kafka Fri, 03 Jul, 18:57
Amit Sharma Cassandra raw deletion Sat, 04 Jul, 14:44
Alex Ott   Re: Cassandra raw deletion Sat, 04 Jul, 16:32
Antonin Delpeuch (lists) RDD-like API for entirely local workflows? Sat, 04 Jul, 15:16
Stephen Boesch   Re: RDD-like API for entirely local workflows? Sat, 04 Jul, 15:38
Juan Martín Guillén   Re: RDD-like API for entirely local workflows? Sat, 04 Jul, 15:49
Antonin Delpeuch (lists)     Re: RDD-like API for entirely local workflows? Sat, 04 Jul, 16:09
Juan Martín Guillén       Re: RDD-like API for entirely local workflows? Sat, 04 Jul, 17:19
Antonin Delpeuch (lists)         Re: RDD-like API for entirely local workflows? Sat, 04 Jul, 17:45
KhajaAsmath Mohammed Spark structured streaming -Kafka - deployment / monitor and restart Sun, 05 Jul, 12:28
Gabor Somogyi   Re: Spark structured streaming -Kafka - deployment / monitor and restart Sun, 05 Jul, 17:52
Jungtaek Lim     Re: Spark structured streaming -Kafka - deployment / monitor and restart Sun, 05 Jul, 23:22
KhajaAsmath Mohammed       Re: Spark structured streaming -Kafka - deployment / monitor and restart Mon, 06 Jul, 16:40
Jungtaek Lim         Re: Spark structured streaming -Kafka - deployment / monitor and restart Mon, 06 Jul, 20:31
Daniel de Oliveira Mantovani How To Access Hive 2 Through JDBC Using Kerberos Mon, 06 Jul, 10:09
Gabor Somogyi   Re: How To Access Hive 2 Through JDBC Using Kerberos Mon, 06 Jul, 11:09
Daniel de Oliveira Mantovani     Re: How To Access Hive 2 Through JDBC Using Kerberos Mon, 06 Jul, 22:03
Daniel de Oliveira Mantovani       Re: How To Access Hive 2 Through JDBC Using Kerberos Thu, 09 Jul, 16:28
Jeff Evans         Re: How To Access Hive 2 Through JDBC Using Kerberos Thu, 09 Jul, 19:52
Daniel de Oliveira Mantovani           Re: How To Access Hive 2 Through JDBC Using Kerberos Fri, 17 Jul, 11:08
Teja Is it possible to use Hadoop 3.x and Hive 3.x using spark 2.4? Mon, 06 Jul, 11:01
Sean Owen   Re: Is it possible to use Hadoop 3.x and Hive 3.x using spark 2.4? Mon, 06 Jul, 13:16
Daniel de Oliveira Mantovani     Re: Is it possible to use Hadoop 3.x and Hive 3.x using spark 2.4? Mon, 06 Jul, 22:31
Eric Beabes Load distribution in Structured Streaming Mon, 06 Jul, 20:52
Re: java.lang.ClassNotFoundException for s3a comitter
Stephen Coy   Re: java.lang.ClassNotFoundException for s3a comitter Tue, 07 Jul, 02:41
Steve Loughran     Re: java.lang.ClassNotFoundException for s3a comitter Tue, 21 Jul, 11:01
Gourav Sengupta       Re: java.lang.ClassNotFoundException for s3a comitter Tue, 21 Jul, 11:18
Stephen Coy When does SparkContext.defaultParallelism have the correct value? Tue, 07 Jul, 03:35
Sean Owen   Re: When does SparkContext.defaultParallelism have the correct value? Tue, 07 Jul, 14:07
iamabug how to disable hivemetastore connection Tue, 07 Jul, 08:30
daniel123 ANALYZE command not supported on Spark 2.3.2? Tue, 07 Jul, 12:56
ldazaa11 [Announcement] Cloud data lake conference with heavy focus on open source Tue, 07 Jul, 16:59
Ashley Hoff   Re: [Announcement] Cloud data lake conference with heavy focus on open source Wed, 08 Jul, 00:16
Lucio Daza     Re: [Announcement] Cloud data lake conference with heavy focus on open source Wed, 08 Jul, 10:13
Dark Crusader Mocking pyspark read writes Tue, 07 Jul, 18:06
Jörn Franke   Re: Mocking pyspark read writes Tue, 07 Jul, 18:12
Sricheta Ruj Implementing TableProvider in Spark 3.0 Thu, 09 Jul, 04:17
Richard Xin   Re: Implementing TableProvider in Spark 3.0 Thu, 09 Jul, 04:27
Julian Jiang com.fasterxml.jackson.databind.JsonMappingException: Scala module 2.9.6 requires Jackson Databind version >= 2.9.0 and < 2.10.0 Thu, 09 Jul, 11:07
Sean Owen   Re: com.fasterxml.jackson.databind.JsonMappingException: Scala module 2.9.6 requires Jackson Databind version >= 2.9.0 and < 2.10.0 Thu, 09 Jul, 13:30
Michal Sankot Strange WholeStageCodegen UI values Thu, 09 Jul, 16:54
Bobby Evans   Re: Strange WholeStageCodegen UI values Thu, 09 Jul, 21:14
Sean Owen     Re: Strange WholeStageCodegen UI values Thu, 09 Jul, 21:47
Michal Sankot       Re: Strange WholeStageCodegen UI values Fri, 10 Jul, 14:08
sparksql 2.4.0 java.lang.NoClassDefFoundError: com/esotericsoftware/minlog/Log
Ivan Petrov   sparksql 2.4.0 java.lang.NoClassDefFoundError: com/esotericsoftware/minlog/Log Thu, 09 Jul, 18:43
Ivan Petrov     Re: sparksql 2.4.0 java.lang.NoClassDefFoundError: com/esotericsoftware/minlog/Log Thu, 09 Jul, 18:45
Ivan Petrov   sparksql 2.4.0 java.lang.NoClassDefFoundError: com/esotericsoftware/minlog/Log Thu, 09 Jul, 22:42
Varshney, Vaibhav [Spark 3.0 Kubernetes] Does Spark 3.0 support production deployment Thu, 09 Jul, 20:01
Sean Owen   Re: [Spark 3.0 Kubernetes] Does Spark 3.0 support production deployment Thu, 09 Jul, 20:20
Varshney, Vaibhav     RE: [Spark 3.0 Kubernetes] Does Spark 3.0 support production deployment Thu, 09 Jul, 20:30
Prashant Sharma       Re: [Spark 3.0 Kubernetes] Does Spark 3.0 support production deployment Fri, 10 Jul, 05:56
Varshney, Vaibhav         RE: [Spark 3.0 Kubernetes] Does Spark 3.0 support production deployment Fri, 10 Jul, 15:59
Prashant Sharma           Re: [Spark 3.0 Kubernetes] Does Spark 3.0 support production deployment Sun, 12 Jul, 08:21
Re: Blog : Apache Spark Window Functions
Anwar AliKhan   Re: Blog : Apache Spark Window Functions Fri, 10 Jul, 03:50
Anwar AliKhan     Re: Blog : Apache Spark Window Functions Mon, 13 Jul, 17:55
Patrick McCarthy Building Spark 3.0.0 for Hive 1.2 Fri, 10 Jul, 13:17
KhajaAsmath Mohammed Application Upgrade - structured streaming Fri, 10 Jul, 14:40
Re: Metrics Problem
Bryan Jeffrey   Re: Metrics Problem Fri, 10 Jul, 17:49
Diwakar Dhanuskodi Spark yarn cluster Sat, 11 Jul, 16:57
Juan Martín Guillén   Re: Spark yarn cluster Sat, 11 Jul, 17:25
Diwakar Dhanuskodi     Re: Spark yarn cluster Sat, 11 Jul, 17:40
Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues)
Bartosz Konieczny   Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Sun, 12 Jul, 04:46
Rachana Srivastava     Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Mon, 13 Jul, 05:58
Stergios Papadimitriou announcing SpakLab, a JShell based interface to Spark with a MATLAB like enviroment Sun, 12 Jul, 13:43
Phillip Henry Lazy Spark Structured Streaming Sun, 12 Jul, 15:55
Phillip Henry   Re: Lazy Spark Structured Streaming Mon, 27 Jul, 11:09
Jungtaek Lim     Re: Lazy Spark Structured Streaming Mon, 27 Jul, 22:41
Mukhtaj Khan Issue in parallelization of CNN model using spark Mon, 13 Jul, 11:10
Juan Martín Guillén   Re: Issue in parallelization of CNN model using spark Mon, 13 Jul, 14:09
Sean Owen   Re: Issue in parallelization of CNN model using spark Mon, 13 Jul, 14:18
Anwar AliKhan     Re: Issue in parallelization of CNN model using spark Mon, 13 Jul, 23:34
Mukhtaj Khan       Re: Issue in parallelization of CNN model using spark Fri, 17 Jul, 11:05
Anwar AliKhan     Re: Issue in parallelization of CNN model using spark Tue, 14 Jul, 01:58
Patrick McCarthy       Re: Issue in parallelization of CNN model using spark Tue, 14 Jul, 13:29
Anwar AliKhan         Re: Issue in parallelization of CNN model using spark Tue, 14 Jul, 14:45
Sean Owen           Re: Issue in parallelization of CNN model using spark Tue, 14 Jul, 14:52
Anwar AliKhan             Re: Issue in parallelization of CNN model using spark Tue, 14 Jul, 15:41
ArtemisDev org.apache.spark.deploy.yarn.ExecutorLauncher not found when running Spark 3.0 on Hadoop Mon, 13 Jul, 20:31
godlumen   Re:org.apache.spark.deploy.yarn.ExecutorLauncher not found when running Spark 3.0 on Hadoop Tue, 14 Jul, 06:10
ArtemisDev Using Spark UI with Running Spark on Hadoop Yarn Mon, 13 Jul, 20:51
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Sep 202093
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137