spark-user mailing list archives: July 2020

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Zero Re: File Not Found: /tmp/spark-events in Spark 3.0 Thu, 02 Jul, 13:19
Suat Toksöz Guidance Mon, 27 Jul, 07:24
Suat Toksöz Apache Spark + Python + Pyspark + Kaola Mon, 27 Jul, 07:28
Suat Toksöz Re: Apache Spark- Help with email library Mon, 27 Jul, 08:55
Suat Toksöz test Mon, 27 Jul, 08:56
Juan Martín Guillén Re: RDD-like API for entirely local workflows? Sat, 04 Jul, 15:49
Juan Martín Guillén Re: RDD-like API for entirely local workflows? Sat, 04 Jul, 17:19
Juan Martín Guillén Re: Spark yarn cluster Sat, 11 Jul, 17:25
Juan Martín Guillén Re: Issue in parallelization of CNN model using spark Mon, 13 Jul, 14:09
Dávid Szakállas Secrets in Spark apps Mon, 27 Jul, 12:42
Jörn Franke Re: Mocking pyspark read writes Tue, 07 Jul, 18:12
Jörn Franke Re: Are there some pitfalls in my spark structured streaming code which causes slow response after several hours running? Sat, 18 Jul, 15:13
Alex Ott Re: Cassandra raw deletion Sat, 04 Jul, 16:32
Amit Sharma Truncate table Wed, 01 Jul, 14:47
Amit Sharma Cassandra raw deletion Sat, 04 Jul, 14:44
Amit Sharma Future timeout Fri, 17 Jul, 13:10
Amit Sharma Garbage collection issue Fri, 17 Jul, 18:34
Amit Sharma Re: Future timeout Mon, 20 Jul, 18:19
Amit Sharma Re: Garbage collection issue Mon, 20 Jul, 18:20
Amit Sharma spark exception Fri, 24 Jul, 12:39
Amit Sharma how to copy from one cassandra cluster to another Tue, 28 Jul, 11:23
Andrew Melo Re: REST Structured Steaming Sink Thu, 02 Jul, 01:40
Andrew Melo PySpark aggregation w/pandas_udf Thu, 16 Jul, 05:52
Andrew Melo Re: Spark DataFrame Creation Wed, 22 Jul, 22:03
Ankur Mittal Spark Compatibility with Java 11 Tue, 14 Jul, 12:15
Ankur Mittal Re: Spark Compatibility with Java 11 Tue, 14 Jul, 13:42
Antonin Delpeuch (lists) RDD-like API for entirely local workflows? Sat, 04 Jul, 15:16
Antonin Delpeuch (lists) Re: RDD-like API for entirely local workflows? Sat, 04 Jul, 16:09
Antonin Delpeuch (lists) Re: RDD-like API for entirely local workflows? Sat, 04 Jul, 17:45
Anwar AliKhan Re: Blog : Apache Spark Window Functions Fri, 10 Jul, 03:50
Anwar AliKhan Re: Blog : Apache Spark Window Functions Mon, 13 Jul, 17:55
Anwar AliKhan Re: Issue in parallelization of CNN model using spark Mon, 13 Jul, 23:34
Anwar AliKhan Re: Issue in parallelization of CNN model using spark Tue, 14 Jul, 01:58
Anwar AliKhan Re: Issue in parallelization of CNN model using spark Tue, 14 Jul, 14:45
Anwar AliKhan Re: Issue in parallelization of CNN model using spark Tue, 14 Jul, 15:41
Anwar AliKhan Re: Kotlin Spark API Tue, 14 Jul, 18:17
ArtemisDev Re: File Not Found: /tmp/spark-events in Spark 3.0 Sun, 05 Jul, 14:33
ArtemisDev org.apache.spark.deploy.yarn.ExecutorLauncher not found when running Spark 3.0 on Hadoop Mon, 13 Jul, 20:31
ArtemisDev Using Spark UI with Running Spark on Hadoop Yarn Mon, 13 Jul, 20:51
ArtemisDev Re: Spark UI Mon, 20 Jul, 14:00
Ashika Umanga Spark 3.0 with Hadoop 2.6 HDFS/Hive Mon, 20 Jul, 03:07
Ashika Umanga Spark 3 connect to Hive 1.2 Wed, 22 Jul, 07:24
Ashika Umanga Re: Spark 3 connect to Hive 1.2 Sun, 26 Jul, 13:00
Ashika Umanga Umagiliya Re: Spark 3.0 with Hadoop 2.6 HDFS/Hive Mon, 20 Jul, 05:24
Ashley Hoff Re: [Announcement] Cloud data lake conference with heavy focus on open source Wed, 08 Jul, 00:16
Ashley Hoff Re: test Mon, 27 Jul, 09:57
Bartosz Konieczny Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Sun, 12 Jul, 04:46
Ben Smith Using pyspark with Spark 2.4.3 a MultiLayerPerceptron model givens inconsistent outputs if a large amount of data is fed into it and at least one of the model outputs is fed to a Python UDF. Fri, 17 Jul, 09:24
Ben Smith Re: Using pyspark with Spark 2.4.3 a MultiLayerPerceptron model givens inconsistent outputs if a large amount of data is fed into it and at least one of the model outputs is fed to a Python UDF. Mon, 20 Jul, 11:52
Ben Smith Re: Using pyspark with Spark 2.4.3 a MultiLayerPerceptron model givens inconsistent outputs if a large amount of data is fed into it and at least one of the model outputs is fed to a Python UDF. Tue, 21 Jul, 08:09
Bobby Evans Re: Strange WholeStageCodegen UI values Thu, 09 Jul, 21:14
Bredenkamp, Ben B http://spark.apache.org/docs/2.3.0/api/python/pyspark.sql.html#module-pyspark.sql.functions, v2.3.0.2.6.5.0-292 Fri, 24 Jul, 13:28
Bredenkamp, Ben B Re: http://spark.apache.org/docs/2.3.0/api/python/pyspark.sql.html#module-pyspark.sql.functions, v2.3.0.2.6.5.0-292 Fri, 24 Jul, 13:38
Bryan Jeffrey Re: Metrics Problem Fri, 10 Jul, 17:49
Bulldog20630405 spark job delay when starting Tue, 21 Jul, 22:39
Burak Yavuz Re: REST Structured Steaming Sink Thu, 02 Jul, 01:12
Burak Yavuz Re: REST Structured Steaming Sink Thu, 02 Jul, 02:30
DB Tsai Re: Spark 3.0 with Hadoop 2.6 HDFS/Hive Mon, 20 Jul, 05:04
DB Tsai Re: Spark 3.0 with Hadoop 2.6 HDFS/Hive Mon, 20 Jul, 06:03
Daniel Stojanov Why can window functions only have fixed window sizes? Wed, 15 Jul, 11:48
Daniel de Oliveira Mantovani How To Access Hive 2 Through JDBC Using Kerberos Mon, 06 Jul, 10:09
Daniel de Oliveira Mantovani Re: How To Access Hive 2 Through JDBC Using Kerberos Mon, 06 Jul, 22:03
Daniel de Oliveira Mantovani Re: Is it possible to use Hadoop 3.x and Hive 3.x using spark 2.4? Mon, 06 Jul, 22:31
Daniel de Oliveira Mantovani Re: How To Access Hive 2 Through JDBC Using Kerberos Thu, 09 Jul, 16:28
Daniel de Oliveira Mantovani Re: How To Access Hive 2 Through JDBC Using Kerberos Fri, 17 Jul, 11:08
Daniel de Oliveira Mantovani Is possible to give options when reading semistructured files using SQL Syntax? Tue, 28 Jul, 10:21
Dark Crusader Mocking pyspark read writes Tue, 07 Jul, 18:06
Dark Crusader Mock spark reads and writes Tue, 14 Jul, 17:18
Davide Curcio “Pyspark.zip does not exist” using Spark in cluster mode with Yarn Thu, 16 Jul, 16:54
Davide Curcio Kafka with Spark Streaming work on local but it doesn't work in Standalone mode Fri, 24 Jul, 10:07
Debabrata Ghosh Refreshing static data with streaming data at regular Intervals Tue, 21 Jul, 10:17
Deepak Sharma Write to same hdfs dir from multiple spark jobs Wed, 29 Jul, 12:36
Dhaval Patel Re: Future timeout Tue, 21 Jul, 10:37
Diwakar Dhanuskodi Spark yarn cluster Sat, 11 Jul, 16:57
Diwakar Dhanuskodi Re: Spark yarn cluster Sat, 11 Jul, 17:40
Eric Beabes Failure Threshold in Spark Structured Streaming? Thu, 02 Jul, 16:24
Eric Beabes Load distribution in Structured Streaming Mon, 06 Jul, 20:52
Felipe Gutierrez How to monitor the throughput and latency of the combineByKey transformation in Spark 3? Mon, 20 Jul, 13:48
Felix Cheung Fwd: Announcing ApacheCon @Home 2020 Thu, 02 Jul, 04:15
Gabor Somogyi Re: Spark streaming with Confluent kafka Fri, 03 Jul, 18:57
Gabor Somogyi Re: Spark structured streaming -Kafka - deployment / monitor and restart Sun, 05 Jul, 17:52
Gabor Somogyi Re: How To Access Hive 2 Through JDBC Using Kerberos Mon, 06 Jul, 11:09
Gabor Somogyi Re: Kafka with Spark Streaming work on local but it doesn't work in Standalone mode Fri, 24 Jul, 13:19
German Schiavon Matteo Re: Tab delimited csv import and empty columns Thu, 30 Jul, 12:01
Gourav Sengupta Re: java.lang.ClassNotFoundException for s3a comitter Tue, 21 Jul, 11:18
Haijia Zhou Does Spark support column scan pruning for array of structs? Mon, 20 Jul, 12:22
Holden Karau Re: REST Structured Steaming Sink Thu, 02 Jul, 00:54
Holden Karau Re: REST Structured Steaming Sink Thu, 02 Jul, 01:16
Hulio andres Re: “Pyspark.zip does not exist” using Spark in cluster mode with Yarn Thu, 16 Jul, 21:57
Hulio andres Re: File not found exceptions on S3 while running spark jobs Fri, 17 Jul, 05:27
Hulio andres Re: File not found exceptions on S3 while running spark jobs Fri, 17 Jul, 19:41
Hyukjin Kwon Re: [PSA] Python 2, 3.4 and 3.5 are now dropped Tue, 14 Jul, 02:47
Ivan Petrov sparksql 2.4.0 java.lang.NoClassDefFoundError: com/esotericsoftware/minlog/Log Thu, 09 Jul, 18:43
Ivan Petrov Re: sparksql 2.4.0 java.lang.NoClassDefFoundError: com/esotericsoftware/minlog/Log Thu, 09 Jul, 18:45
Ivan Petrov sparksql 2.4.0 java.lang.NoClassDefFoundError: com/esotericsoftware/minlog/Log Thu, 09 Jul, 22:42
Ivan Petrov scala RDD[MyCaseClass] to Dataset[MyCaseClass] perfomance Mon, 13 Jul, 22:25
Ivan Petrov Re: scala RDD[MyCaseClass] to Dataset[MyCaseClass] perfomance Mon, 13 Jul, 23:16
James Yuan Re: [Spark ML] existence of Matrix Factorization ALS algorithm's log version Wed, 29 Jul, 16:10
JasonLee Re: Spark 3.0.0 spark.read.json never completes Fri, 17 Jul, 14:37
Jeff Evans Re: How To Access Hive 2 Through JDBC Using Kerberos Thu, 09 Jul, 19:52
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Aug 202058
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137