spark-user mailing list archives: June 2021

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Gourav Sengupta Petastorm vs horovod vs tensorflowonspark vs spark_tensorflow_distributor Tue, 01 Jun, 21:58
Sean Owen   Re: Petastorm vs horovod vs tensorflowonspark vs spark_tensorflow_distributor Sat, 05 Jun, 19:00
Gourav Sengupta     Re: Petastorm vs horovod vs tensorflowonspark vs spark_tensorflow_distributor Mon, 07 Jun, 20:02
Re: Missing module spark-hadoop-cloud in Maven central
Stephen Coy   Re: Missing module spark-hadoop-cloud in Maven central Tue, 01 Jun, 23:56
Steve Loughran     Re: Missing module spark-hadoop-cloud in Maven central Wed, 02 Jun, 19:05
Dongjoon Hyun     Re: Missing module spark-hadoop-cloud in Maven central Tue, 22 Jun, 02:34
Dongjoon Hyun [ANNOUNCE] Apache Spark 3.1.2 released Wed, 02 Jun, 00:58
郑瑞峰   回复:[ANNOUNCE] Apache Spark 3.1.2 released Wed, 02 Jun, 02:18
Hyukjin Kwon   Re: [ANNOUNCE] Apache Spark 3.1.2 released Wed, 02 Jun, 04:28
Xiao Li     Re: [ANNOUNCE] Apache Spark 3.1.2 released Wed, 02 Jun, 05:29
Takeshi Yamamuro       Re: [ANNOUNCE] Apache Spark 3.1.2 released Wed, 02 Jun, 05:45
Jacek Laskowski   Re: [ANNOUNCE] Apache Spark 3.1.2 released Wed, 02 Jun, 10:07
Re: S3 Access Issues - Spark
Badrinath Patchikolla   Re: S3 Access Issues - Spark Wed, 02 Jun, 07:25
Re: [apache spark] Does Spark 2.4.8 have issues with ServletContextHandler
Kanchan Kauthale   Re: [apache spark] Does Spark 2.4.8 have issues with ServletContextHandler Wed, 02 Jun, 11:35
Daniel de Oliveira Mantovani     Re: [apache spark] Does Spark 2.4.8 have issues with ServletContextHandler Mon, 14 Jun, 16:57
Subash Prabanantham Kube estimate for Spark Thu, 03 Jun, 09:50
Mich Talebzadeh   Re: Kube estimate for Spark Thu, 03 Jun, 10:05
Femi Anthony     Re: Kube estimate for Spark Thu, 03 Jun, 13:43
Re: Reading Large File in Pyspark
Gourav Sengupta   Re: Reading Large File in Pyspark Thu, 03 Jun, 10:12
Zhun Wang Questions about `CreateViewCommand` Thu, 03 Jun, 10:32
Sivabalan [Spark SQL][Intermediate][How to] Custom transformation to datasource V2 write apis Fri, 04 Jun, 01:21
ranju goel RepartitionByCassandraReplica API Support on K8s Fri, 04 Jun, 08:19
Kiran Biswal class KafkaCluster related errors Sun, 06 Jun, 19:57
Mich Talebzadeh   Re: class KafkaCluster related errors Mon, 07 Jun, 08:04
Kiran Biswal     Re: class KafkaCluster related errors Mon, 07 Jun, 09:08
Mich Talebzadeh       Re: class KafkaCluster related errors Mon, 07 Jun, 09:58
Mich Talebzadeh         Re: class KafkaCluster related errors Tue, 08 Jun, 14:26
Mich Talebzadeh           Re: class KafkaCluster related errors Fri, 11 Jun, 08:09
Mich Talebzadeh             Re: class KafkaCluster related errors Sun, 13 Jun, 07:48
Mich Talebzadeh               Re: class KafkaCluster related errors Thu, 17 Jun, 14:30
Mich Talebzadeh                 Re: class KafkaCluster related errors Thu, 17 Jun, 16:39
kushagra deep Max of multiple columns of a row in spark Sun, 06 Jun, 21:13
kushagra deep   Re: Max of multiple columns of a row in spark Sun, 06 Jun, 21:21
Gourav Sengupta addPyFile error: NotADirectoryError: [Errno 20] Not a directory Mon, 07 Jun, 20:21
Artemis User Problem in Restoring ML Pipeline with UDF Tue, 08 Jun, 15:49
Sean Owen   Re: Problem in Restoring ML Pipeline with UDF Tue, 08 Jun, 16:10
Sean Owen Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 01:26
Tom Barber   Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 01:00
Tom Barber     Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 01:52
Sean Owen       Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 02:04
Tom Barber     Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 02:01
Lalwani, Jayesh       Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 02:29
Tom Barber         Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 09:54
Tom Barber           Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 11:01
Tom Barber             Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 11:29
Sean Owen               Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 13:07
Tom Barber                 Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 14:21
Mich Talebzadeh                   Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 14:44
Tom Barber                     Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 14:47
Sean Owen                       Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 14:59
Tom Barber                         Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 15:11
Tom Barber                           Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 15:17
Sam                             Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 15:25
Tom Barber                               Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 15:37
Tom Barber                                 Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 15:49
Chris Martin                             Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 16:13
Tom Barber                               Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 16:16
Chris Martin                                 Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 16:49
Tom Barber                                   Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 17:32
Tom Barber                                     Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 17:42
Mich Talebzadeh                                       Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 17:54
Tom Barber                                         Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 17:55
Sean Owen                                       Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 18:47
Tom Barber                                         Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 18:49
Tom Barber                                           Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 18:59
Sean Owen                                             Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 19:03
Tom Barber                                               Re: Distributing a FlatMap across a Spark Cluster Wed, 09 Jun, 19:08
Tom Barber                                                 Re: Distributing a FlatMap across a Spark Cluster Wed, 23 Jun, 10:38
Tom Barber                                                   Re: Distributing a FlatMap across a Spark Cluster Wed, 23 Jun, 10:44
Tom Barber                                                     Re: Distributing a FlatMap across a Spark Cluster Wed, 23 Jun, 13:18
Tom Barber                                                       Re: Distributing a FlatMap across a Spark Cluster Wed, 23 Jun, 17:27
N, Bharath Spark Standalone Authentication and Encryption Wed, 09 Jun, 14:10
Re: NoSuchMethodError: org.apache.spark.network.util.AbstractFileRegion.transferred
mirkel   Re: NoSuchMethodError: org.apache.spark.network.util.AbstractFileRegion.transferred Wed, 09 Jun, 23:34
Muhammed Favas Apply window function on data consumed from Kafka topic Thu, 10 Jun, 09:56
Muhammed Favas   RE: Apply window function on data consumed from Kafka topic Tue, 15 Jun, 06:38
German Schiavon     Re: Apply window function on data consumed from Kafka topic Tue, 15 Jun, 06:50
Battula, Brahma Reddy Spark-sql can replace Hive ? Thu, 10 Jun, 10:57
ayan guha   Re: Spark-sql can replace Hive ? Thu, 10 Jun, 11:04
Battula, Brahma Reddy     Re: Spark-sql can replace Hive ? Thu, 10 Jun, 11:08
Mich Talebzadeh       Re: Spark-sql can replace Hive ? Thu, 10 Jun, 14:42
Battula, Brahma Reddy         Re: Spark-sql can replace Hive ? Tue, 15 Jun, 17:00
Mich Talebzadeh           Re: Spark-sql can replace Hive ? Tue, 15 Jun, 17:05
Battula, Brahma Reddy             Migrating from hive to spark Thu, 17 Jun, 07:17
Mich Talebzadeh               Re: Migrating from hive to spark Thu, 17 Jun, 07:45
Himanshu Soni Need help to create database and integration woth Spark App in local machine Sat, 12 Jun, 09:07
Reed Villanueva sparkml random forest classifier not learning (at all) compared to H2O implementation (on same data)? Mon, 14 Jun, 01:29
Reed Villanueva   Re: sparkml random forest classifier not learning (at all) compared to H2O implementation (on same data)? Mon, 14 Jun, 04:11
david.szakal...@gmail.com Missing stack function from SQL functions API Mon, 14 Jun, 09:13
Khalid Mammadov   Re: Missing stack function from SQL functions API Tue, 15 Jun, 11:10
Amit Joshi Does Rollups work with spark structured streaming with state. Tue, 15 Jun, 06:49
Amit Joshi   Fwd: Does Rollups work with spark structured streaming with state. Wed, 16 Jun, 15:36
Mich Talebzadeh     Re: Does Rollups work with spark structured streaming with state. Wed, 16 Jun, 18:06
Amit Joshi       Re: Does Rollups work with spark structured streaming with state. Thu, 17 Jun, 06:44
Mich Talebzadeh         Re: Does Rollups work with spark structured streaming with state. Thu, 17 Jun, 07:37
Amit Joshi           Re: Does Rollups work with spark structured streaming with state. Thu, 17 Jun, 17:39
Mich Talebzadeh             Re: Does Rollups work with spark structured streaming with state. Thu, 17 Jun, 18:13
Reed Villanueva What happens if a random forest max bins is set too high? Tue, 15 Jun, 06:50
Reed Villanueva   Re: What happens if a random forest max bins is set too high? Wed, 16 Jun, 06:21
Reed Villanueva Why does sparkml random forest classifier not support maxBins < number of total categorical values? Wed, 16 Jun, 06:22
Sean Owen   Re: Why does sparkml random forest classifier not support maxBins < number of total categorical values? Wed, 16 Jun, 12:39
Zilvinas Saltys Spark PROCESS_LOCAL vs RACK_LOCAL, stage not scheduling tasks Wed, 16 Jun, 14:07
Zilvinas Saltys   Re: Spark PROCESS_LOCAL vs RACK_LOCAL, stage not scheduling tasks Wed, 16 Jun, 15:12
rajat kumar Moving millions of file using spark Wed, 16 Jun, 14:48
Molotch   Re: Moving millions of file using spark Wed, 16 Jun, 15:01
Sachit Murarka Small file problem Wed, 16 Jun, 18:24
Boris Litvak   RE: Small file problem Thu, 17 Jun, 07:16
apacheyi Is there a way to embed the SparkHistoryServer in my existing service? Wed, 16 Jun, 21:16
Anshul Kala Insert into table with one the value is derived from DB function using spark Fri, 18 Jun, 19:46
Mich Talebzadeh   Re: Insert into table with one the value is derived from DB function using spark Fri, 18 Jun, 20:28
Anshul Kala     Re: Insert into table with one the value is derived from DB function using spark Fri, 18 Jun, 20:52
Mich Talebzadeh       Re: Insert into table with one the value is derived from DB function using spark Fri, 18 Jun, 21:14
ayan guha         Re: Insert into table with one the value is derived from DB function using spark Sat, 19 Jun, 09:14
Mich Talebzadeh         Re: Insert into table with one the value is derived from DB function using spark Sat, 19 Jun, 18:32
Sebastian Piu           Re: Insert into table with one the value is derived from DB function using spark Sat, 19 Jun, 19:01
Mich Talebzadeh             Re: Insert into table with one the value is derived from DB function using spark Sun, 20 Jun, 09:23
Unsubscribe
Sunil Prabhakara   Unsubscribe Sat, 19 Jun, 07:31
Arnaud Wolf   Unsubscribe Sun, 20 Jun, 14:13
gvss     Re: Unsubscribe Sun, 20 Jun, 14:16
yiling       RE: Unsubscribe Sun, 20 Jun, 16:34
Alun ap Rhisiart         Re: Unsubscribe Sun, 20 Jun, 16:38
Manikant Goutam   Unsubscribe Mon, 21 Jun, 06:08
Sandeep Varma unsubscribe Sun, 20 Jun, 03:13
Siva Tarun Ponnada Scheduling Time > Processing Time Sun, 20 Jun, 19:03
Mohamadreza Rostami   Re: Scheduling Time > Processing Time Sun, 20 Jun, 20:04
hatef alipoor how Spark achieves memory fairness between tasks? Mon, 21 Jun, 09:17
Reminia Scarlet Long schedule delay time of one spark task Mon, 21 Jun, 15:05
sarutak   Re: Long schedule delay time of one spark task Mon, 21 Jun, 17:01
Reminia Scarlet     Re: Long schedule delay time of one spark task Tue, 22 Jun, 04:17
Eric Richardson CVEs Mon, 21 Jun, 22:27
Sean Owen   Re: CVEs Mon, 21 Jun, 22:43
Eric Richardson     Re: CVEs Mon, 21 Jun, 23:40
Holden Karau       Re: CVEs Mon, 21 Jun, 23:50
Sean Owen         Re: CVEs Mon, 21 Jun, 23:52
Eric Richardson           Re: CVEs Tue, 22 Jun, 00:45
Sean Owen       Re: CVEs Mon, 21 Jun, 23:51
ranju goel Any Other Options other than Spark IN Query Tue, 22 Jun, 11:00
Chetan Khatri Usage of DropDuplicate in Spark Tue, 22 Jun, 16:52
Sachit Murarka   Re: Usage of DropDuplicate in Spark Tue, 22 Jun, 17:15
Chetan Khatri     Re: Usage of DropDuplicate in Spark Tue, 22 Jun, 17:16
Chetan Khatri       Re: Usage of DropDuplicate in Spark Tue, 22 Jun, 17:23
Johnny Burns Performance Problems Migrating to S3A Committers Tue, 22 Jun, 22:41
Artemis User   Re: Performance Problems Migrating to S3A Committers Wed, 23 Jun, 20:03
Re: Spark on Kubernetes scheduler variety
Mich Talebzadeh   Re: Spark on Kubernetes scheduler variety Wed, 23 Jun, 15:26
Klaus Ma     Re: Spark on Kubernetes scheduler variety Thu, 24 Jun, 01:52
Mich Talebzadeh       Re: Spark on Kubernetes scheduler variety Thu, 24 Jun, 07:59
John Zhuge       Re: Spark on Kubernetes scheduler variety Thu, 24 Jun, 08:06
Holden Karau       Re: Spark on Kubernetes scheduler variety Thu, 24 Jun, 15:56
Lalwani, Jayesh     Re: Spark on Kubernetes scheduler variety Thu, 24 Jun, 15:25
Mich Talebzadeh     Re: Spark on Kubernetes scheduler variety Thu, 24 Jun, 16:22
Message list1 · 2 · Next »Thread · Author · Date
Box list
Oct 202177
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137