spark-user mailing list archives: December 2020

Site index · List index
Message list« Previous · 1 · 2Thread · Author · Date
act_coder Find difference between two dataframes in spark structured streaming Thu, 17 Dec, 04:29
Vikas Garg Getting error message Thu, 17 Dec, 08:01
Patrick McCarthy   Re: Getting error message Thu, 17 Dec, 18:20
Vikas Garg     Re: Getting error message Thu, 17 Dec, 18:26
Patrick McCarthy       Re: Getting error message Thu, 17 Dec, 18:41
Vikas Garg         Re: Getting error message Thu, 17 Dec, 18:45
Patrick McCarthy           Re: Getting error message Thu, 17 Dec, 19:00
Vikas Garg             Re: Getting error message Thu, 17 Dec, 19:01
Issue while installing dependencies Python Spark
Sachit Murarka   Issue while installing dependencies Python Spark Thu, 17 Dec, 15:31
Patrick McCarthy     Re: Issue while installing dependencies Python Spark Thu, 17 Dec, 15:54
Sachit Murarka       Re: Issue while installing dependencies Python Spark Fri, 18 Dec, 20:03
Patrick McCarthy         Re: Issue while installing dependencies Python Spark Fri, 18 Dec, 20:32
Artemis User     Re: Issue while installing dependencies Python Spark Thu, 17 Dec, 21:42
bannya [Spark Structured Streaming] Not working while worker node is on different machine Fri, 18 Dec, 03:20
lec ssmi   Re: [Spark Structured Streaming] Not working while worker node is on different machine Thu, 24 Dec, 01:25
疯狂的哈丘 Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true Fri, 18 Dec, 05:38
Mich Talebzadeh   Re: Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true Fri, 18 Dec, 18:53
Mich Talebzadeh     Re: Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true Fri, 18 Dec, 22:45
Vikas Garg Convert Seq[Any] to Seq[String] Fri, 18 Dec, 14:36
Sean Owen   Re: Convert Seq[Any] to Seq[String] Fri, 18 Dec, 14:43
Vikas Garg     Re: Convert Seq[Any] to Seq[String] Fri, 18 Dec, 14:46
Roland Johann       Re: Convert Seq[Any] to Seq[String] Sat, 19 Dec, 08:58
Re: How to submit a job via REST API?
Daniel de Oliveira Mantovani   Re: How to submit a job via REST API? Fri, 18 Dec, 17:55
john washington Column-level encryption in Spark SQL Sat, 19 Dec, 01:25
疯狂的哈丘 回复:Re: Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true Sat, 19 Dec, 07:51
Mich Talebzadeh   Re: Re: Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true Sat, 19 Dec, 08:42
Jay Spark 3 + Delta 0.7.0 Hive Metastore Integration Question Sat, 19 Dec, 18:02
Matt Proetsch   Re: Spark 3 + Delta 0.7.0 Hive Metastore Integration Question Sat, 19 Dec, 22:21
Jay     Re: Spark 3 + Delta 0.7.0 Hive Metastore Integration Question Sun, 20 Dec, 06:30
Jay       Re: Spark 3 + Delta 0.7.0 Hive Metastore Integration Question Sun, 20 Dec, 09:49
Mich Talebzadeh Spark 3.0.1 fails to insert into Hive Parquet table but Spark 2.11.12 used to work Sat, 19 Dec, 20:27
Mich Talebzadeh   Re: Spark 3.0.1 fails to insert into Hive Parquet table but Spark 2.11.12 used to work Mon, 21 Dec, 10:44
S3-SQS vs Auto Loader With Apache Spark Structured Streaming
Rachana Srivastava   S3-SQS vs Auto Loader With Apache Spark Structured Streaming Sun, 20 Dec, 14:40
Bhatta, Ramesha Avoid re-creating __spark_conf__5678XXXX.zip in /tmp for each application submit and copy under application specific .staging directory Mon, 21 Dec, 03:44
bigel_p providing a list parameter for sum function Mon, 21 Dec, 06:11
nick.gustafson   Re: providing a list parameter for sum function Mon, 21 Dec, 16:31
沈俊 No matter how many instances and cores configured for spark on k8s, only one executor is reading file Mon, 21 Dec, 09:29
Sean Owen   Re: No matter how many instances and cores configured for spark on k8s, only one executor is reading file Mon, 21 Dec, 13:53
沈俊     Re: No matter how many instances and cores configured for spark on k8s, only one executor is reading file Tue, 22 Dec, 03:10
rajat kumar Kubernetes spark insufficient cpu error Mon, 21 Dec, 15:43
Moser, Michael [Spark Streaming] support of non-timebased windows and lag function Tue, 22 Dec, 08:23
Artemis User Integrating multiple streaming sources Tue, 22 Dec, 14:57
Artemis User   Re: Integrating multiple streaming sources Tue, 22 Dec, 15:06
Bimal Chandra Naresh delta lake implementation issue in large data set Tue, 22 Dec, 16:10
Gourav Sengupta   Re: delta lake implementation issue in large data set Tue, 22 Dec, 19:32
Kohki Nishio DataSourceV2 with ordering pushdown Tue, 22 Dec, 20:36
abby37 Printing Logs in map-partition Wed, 23 Dec, 04:12
lec ssmi   Re: Printing Logs in map-partition Wed, 23 Dec, 06:43
abby37     Re: Printing Logs in map-partition Sun, 27 Dec, 18:57
David Morin Spark 3.0.1 Structured streaming - checkpoints fail Wed, 23 Dec, 16:07
Lalwani, Jayesh   Re: Spark 3.0.1 Structured streaming - checkpoints fail Wed, 23 Dec, 16:48
David Morin     Re: Spark 3.0.1 Structured streaming - checkpoints fail Wed, 23 Dec, 17:48
David Morin       Re: Spark 3.0.1 Structured streaming - checkpoints fail Wed, 23 Dec, 21:15
Jungtaek Lim         Re: Spark 3.0.1 Structured streaming - checkpoints fail Wed, 23 Dec, 22:29
David Morin           Re: Spark 3.0.1 Structured streaming - checkpoints fail Thu, 24 Dec, 01:01
Mich Talebzadeh Using UDF based on Numpy functions in Spark SQL Wed, 23 Dec, 20:51
Peyman Mohajerian   Re: Using UDF based on Numpy functions in Spark SQL Wed, 23 Dec, 21:31
Mich Talebzadeh     Re: Using UDF based on Numpy functions in Spark SQL Wed, 23 Dec, 22:21
Sean Owen   Re: Using UDF based on Numpy functions in Spark SQL Wed, 23 Dec, 23:50
Mich Talebzadeh     Re: Using UDF based on Numpy functions in Spark SQL Thu, 24 Dec, 09:16
Sean Owen       Re: Using UDF based on Numpy functions in Spark SQL Thu, 24 Dec, 13:47
Mich Talebzadeh         Re: Using UDF based on Numpy functions in Spark SQL Thu, 24 Dec, 14:12
Sean Owen           Re: Using UDF based on Numpy functions in Spark SQL Thu, 24 Dec, 14:13
Mich Talebzadeh             Re: Using UDF based on Numpy functions in Spark SQL Sat, 26 Dec, 14:58
lec ssmi Jdbc Hook in Spark Batch Application Thu, 24 Dec, 02:50
Gabor Somogyi   Re: Jdbc Hook in Spark Batch Application Thu, 24 Dec, 16:16
lec ssmi     Re: Jdbc Hook in Spark Batch Application Fri, 25 Dec, 01:34
Gabor Somogyi       Re: Jdbc Hook in Spark Batch Application Fri, 25 Dec, 08:30
Mich Talebzadeh   Re: Jdbc Hook in Spark Batch Application Fri, 25 Dec, 09:09
Arwin Tio Using Streaming Listener in a Structured Streaming job Mon, 28 Dec, 23:16
石鹏磊 why there are two execution for one sql in SQL web ui? Tue, 29 Dec, 02:49
Shiao-An Yuan Correctness bug on Shuffle+Repartition scenario Tue, 29 Dec, 14:00
Sean Owen   Re: Correctness bug on Shuffle+Repartition scenario Tue, 29 Dec, 14:52
Shiao-An Yuan     Re: Correctness bug on Shuffle+Repartition scenario Wed, 30 Dec, 02:30
Sean Owen       Re: Correctness bug on Shuffle+Repartition scenario Wed, 30 Dec, 02:52
Saloni Mehta [Spark Streaming] Why is ZooKeeper LeaderElection Agent not being called by Spark Master? Tue, 29 Dec, 16:43
LInda hackkanan About Wed, 30 Dec, 02:32
LInda hackkanan   About The Big Picture Thu, 31 Dec, 11:30
Patrik Iselind Question on bucketing vs sorting Thu, 31 Dec, 10:30
Peyman Mohajerian   Re: Question on bucketing vs sorting Thu, 31 Dec, 15:15
Patrik Iselind     Re: Question on bucketing vs sorting Thu, 31 Dec, 18:21
Peyman Mohajerian       Re: Question on bucketing vs sorting Thu, 31 Dec, 19:27
LInda hackkanan Apache Spark is left out by Airbus Thu, 31 Dec, 18:18
Message list« Previous · 1 · 2Thread · Author · Date
Box list
Sep 202191
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137