spark-user mailing list archives: January 2021

Site index · List index
Message list« Previous · 1 · 2Thread · Author · Date
Marco Wong RDD filter in for loop gave strange results Wed, 20 Jan, 13:00
Jacek Laskowski   Re: RDD filter in for loop gave strange results Wed, 20 Jan, 14:29
Sean Owen   Re: RDD filter in for loop gave strange results Wed, 20 Jan, 15:00
Zhu Jingnan     Re: RDD filter in for loop gave strange results Wed, 20 Jan, 15:46
Sean Owen       Re: RDD filter in for loop gave strange results Wed, 20 Jan, 15:50
Marco Wong         Re: RDD filter in for loop gave strange results Wed, 20 Jan, 15:54
Sean Owen           Re: RDD filter in for loop gave strange results Wed, 20 Jan, 16:01
Yuri Oleynikov (יורי אולייניקוב   Re: RDD filter in for loop gave strange results Wed, 20 Jan, 15:43
Marco Firrincieli Spark RDD + HBase: adoption trend Wed, 20 Jan, 13:44
Jacek Laskowski   Re: Spark RDD + HBase: adoption trend Wed, 20 Jan, 14:14
Sean Owen   Re: Spark RDD + HBase: adoption trend Wed, 20 Jan, 15:50
gshen Structured Streaming Spark 3.0.1 Wed, 20 Jan, 20:45
gshen   Re: Structured Streaming Spark 3.0.1 Wed, 20 Jan, 22:17
German Schiavon     Re: Structured Streaming Spark 3.0.1 Thu, 21 Jan, 05:38
Jungtaek Lim       Re: Structured Streaming Spark 3.0.1 Thu, 21 Jan, 05:52
Gabor Somogyi         Re: Structured Streaming Spark 3.0.1 Thu, 21 Jan, 08:18
Gabor Somogyi           Re: Structured Streaming Spark 3.0.1 Thu, 21 Jan, 13:22
gshen         Re: Structured Streaming Spark 3.0.1 Thu, 21 Jan, 19:08
Jungtaek Lim           Re: Structured Streaming Spark 3.0.1 Thu, 21 Jan, 20:17
gshen             Re: Structured Streaming Spark 3.0.1 Thu, 21 Jan, 21:33
Gabor Somogyi               Re: Structured Streaming Spark 3.0.1 Fri, 22 Jan, 06:21
unsubscribe
l...@china-inv.cn   unsubscribe Thu, 21 Jan, 00:05
Aironman DirtDiver   unsubscribe Thu, 21 Jan, 19:56
Andrew Milkowski   unsubscribe Sun, 24 Jan, 11:51
heri wijayanto   unsubscribe Wed, 27 Jan, 00:02
Anurag Kaushik   unsubscribe Wed, 27 Jan, 13:48
srinivasarao daruna Spark job stuck after read and not starting next stage Thu, 21 Jan, 02:56
German Schiavon   Re: Spark job stuck after read and not starting next stage Thu, 21 Jan, 04:59
Sachit Murarka Query on entrypoint.sh Kubernetes spark Thu, 21 Jan, 09:39
Jacek Laskowski   Re: Query on entrypoint.sh Kubernetes spark Thu, 21 Jan, 11:20
Eric Beabes Only one Active task in Spark Structured Streaming application Thu, 21 Jan, 11:12
Jacek Laskowski   Re: Only one Active task in Spark Structured Streaming application Thu, 21 Jan, 11:25
Jungtaek Lim     Re: Only one Active task in Spark Structured Streaming application Thu, 21 Jan, 11:48
Eric Beabes       Re: Only one Active task in Spark Structured Streaming application Thu, 21 Jan, 12:22
Sean Owen   Re: Only one Active task in Spark Structured Streaming application Thu, 21 Jan, 12:25
Eric Beabes     Re: Only one Active task in Spark Structured Streaming application Thu, 21 Jan, 17:18
Lalwani, Jayesh       Re: Only one Active task in Spark Structured Streaming application Thu, 21 Jan, 17:36
Re: Column-level encryption in Spark SQL
Jacek Laskowski   Re: Column-level encryption in Spark SQL Thu, 21 Jan, 11:43
Mich Talebzadeh     Re: Column-level encryption in Spark SQL Thu, 21 Jan, 13:52
Gourav Sengupta       Re: Column-level encryption in Spark SQL Thu, 21 Jan, 14:38
Divyanshu Kumar Facing memory leak with Pyarrow enabled and toPandas() Thu, 21 Jan, 12:15
Gourav Sengupta   Re: Facing memory leak with Pyarrow enabled and toPandas() Fri, 22 Jan, 08:47
Riccardo Ferrari Pyspark How to groupBy -> fit Thu, 21 Jan, 15:19
Sean Owen   Re: Pyspark How to groupBy -> fit Thu, 21 Jan, 16:28
Mich Talebzadeh     Re: Pyspark How to groupBy -> fit Thu, 21 Jan, 16:58
Riccardo Ferrari     Re: Pyspark How to groupBy -> fit Thu, 21 Jan, 19:51
Sean Owen       Re: Pyspark How to groupBy -> fit Thu, 21 Jan, 20:05
Filip Spark structured streaming - efficient way to do lots of aggregations on the same input files Thu, 21 Jan, 15:36
Jacek Laskowski   Re: Spark structured streaming - efficient way to do lots of aggregations on the same input files Fri, 22 Jan, 10:35
Filip     Re: Spark structured streaming - efficient way to do lots of aggregations on the same input files Fri, 22 Jan, 14:28
jelmer Using same rdd from two threads Fri, 22 Jan, 13:58
Sean Owen   Re: Using same rdd from two threads Fri, 22 Jan, 14:34
jelmer     Re: Using same rdd from two threads Sun, 24 Jan, 11:41
Marshall Markham K8S spark-submit Loses Successful Driver Completion Fri, 22 Jan, 22:22
rajat kumar Thread spilling sort issue with single task Tue, 26 Jan, 10:20
German Schiavon   Re: Thread spilling sort issue with single task Tue, 26 Jan, 10:27
rajat kumar     Re: Thread spilling sort issue with single task Tue, 26 Jan, 10:29
German Schiavon       Re: Thread spilling sort issue with single task Tue, 26 Jan, 10:43
Синий Андрей Apache Spark Tue, 26 Jan, 12:41
Pasha Finkelshteyn   Re: Apache Spark Tue, 26 Jan, 13:20
Gourav Sengupta     Re: Apache Spark Tue, 26 Jan, 13:40
Sean Owen     Re: Apache Spark Tue, 26 Jan, 14:00
Ivan Petrov       Re: Apache Spark Tue, 26 Jan, 15:28
Lalwani, Jayesh   Re: Apache Spark Tue, 26 Jan, 17:21
Maxim Gekk     Re: Apache Spark Tue, 26 Jan, 19:07
Синий Андрей       RE: Apache Spark Wed, 27 Jan, 03:16
Lavelle, Shawn Odd NoClassDefFoundError exception Tue, 26 Jan, 15:25
Dharmin Siddesh J Unsubscribe Wed, 27 Jan, 02:16
Brett Spark Spark Standalone - Spark application "Stuck" doesn't launch an executor on an available worker Wed, 27 Jan, 17:43
Mich Talebzadeh   Re: Spark Standalone - Spark application "Stuck" doesn't launch an executor on an available worker Wed, 27 Jan, 18:54
Mich Talebzadeh Connecting to Hive on -premise from Spark in Cloud using JDBC driver for Hive Wed, 27 Jan, 18:47
badrinath patchikolla   Re: Connecting to Hive on -premise from Spark in Cloud using JDBC driver for Hive Thu, 28 Jan, 08:15
Mich Talebzadeh     Re: Connecting to Hive on -premise from Spark in Cloud using JDBC driver for Hive Thu, 28 Jan, 22:09
lsn24 Spark 3.0 upgrade non compatible table error Fri, 29 Jan, 00:57
Bode, Meikel, NMA-CFD Strange behavior with "bigger" JSON file Fri, 29 Jan, 03:19
Arpan Bhandari Spark SQL query Fri, 29 Jan, 07:28
Sachit Murarka   Re: Spark SQL query Fri, 29 Jan, 15:06
Arpan Bhandari     Re: Spark SQL query Fri, 29 Jan, 15:45
Sachit Murarka       Re: Spark SQL query Sun, 31 Jan, 13:05
Mich Talebzadeh   Re: Spark SQL query Sun, 31 Jan, 17:39
How to modify a field in a nested struct using pyspark
Felix Kizhakkel Jose   How to modify a field in a nested struct using pyspark Fri, 29 Jan, 16:30
Adam Binford     Re: How to modify a field in a nested struct using pyspark Fri, 29 Jan, 17:35
Felix Kizhakkel Jose       Re: How to modify a field in a nested struct using pyspark Fri, 29 Jan, 18:01
Adam Binford         Re: How to modify a field in a nested struct using pyspark Fri, 29 Jan, 18:14
Jeff Evans           Re: How to modify a field in a nested struct using pyspark Fri, 29 Jan, 18:22
Felix Kizhakkel Jose             Re: How to modify a field in a nested struct using pyspark Sat, 30 Jan, 02:11
Felix Kizhakkel Jose   How to modify a field in a nested struct using pyspark Fri, 29 Jan, 17:03
Sachit Murarka EOF Exception Spark Structured Streams - Kubernetes Sun, 31 Jan, 13:08
Message list« Previous · 1 · 2Thread · Author · Date
Box list
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137