spark-user mailing list archives: January 2021

Site index · List index
Message list« Previous · 1 · 2 · 3 · Next »Thread · Author · Date
Jeff Evans Re: How to modify a field in a nested struct using pyspark Fri, 29 Jan, 18:22
Jungtaek Lim Re: Data source v2 streaming sinks does not support Update mode Wed, 13 Jan, 06:04
Jungtaek Lim Re: Data source v2 streaming sinks does not support Update mode Wed, 13 Jan, 07:53
Jungtaek Lim Re: Data source v2 streaming sinks does not support Update mode Mon, 18 Jan, 23:50
Jungtaek Lim Re: Data source v2 streaming sinks does not support Update mode Mon, 18 Jan, 23:59
Jungtaek Lim Re: Structured Streaming Spark 3.0.1 Thu, 21 Jan, 05:52
Jungtaek Lim Re: Only one Active task in Spark Structured Streaming application Thu, 21 Jan, 11:48
Jungtaek Lim Re: Structured Streaming Spark 3.0.1 Thu, 21 Jan, 20:17
Koert Kuipers understanding spark shuffle file re-use better Wed, 13 Jan, 16:38
Lalwani, Jayesh Re: Spark DF does not rename the column Mon, 04 Jan, 18:09
Lalwani, Jayesh Re: Only one Active task in Spark Structured Streaming application Thu, 21 Jan, 17:36
Lalwani, Jayesh Re: Apache Spark Tue, 26 Jan, 17:21
Lavelle, Shawn Odd NoClassDefFoundError exception Tue, 26 Jan, 15:25
Luca Canali RE: Understanding Executors UI Wed, 06 Jan, 08:59
Luca Canali RE: Understanding Executors UI Fri, 08 Jan, 20:59
Marco Firrincieli Spark RDD + HBase: adoption trend Wed, 20 Jan, 13:44
Marco Wong RDD filter in for loop gave strange results Wed, 20 Jan, 13:00
Marco Wong Re: RDD filter in for loop gave strange results Wed, 20 Jan, 15:54
Marshall Markham K8S spark-submit Loses Successful Driver Completion Fri, 22 Jan, 22:22
Maxim Gekk Re: Apache Spark Tue, 26 Jan, 19:07
Mich Talebzadeh Spark DF does not rename the column Mon, 04 Jan, 18:05
Mich Talebzadeh Re: Spark DF does not rename the column Mon, 04 Jan, 18:16
Mich Talebzadeh Re: Spark DF does not rename the column Tue, 05 Jan, 11:55
Mich Talebzadeh A question on extrapolation of a nonlinear curve fit beyond x value Tue, 05 Jan, 12:03
Mich Talebzadeh Re: A question on extrapolation of a nonlinear curve fit beyond x value Tue, 05 Jan, 15:18
Mich Talebzadeh Re: A question on extrapolation of a nonlinear curve fit beyond x value Tue, 05 Jan, 15:38
Mich Talebzadeh Re: A question on extrapolation of a nonlinear curve fit beyond x value Tue, 05 Jan, 17:00
Mich Talebzadeh PyCharm, Running spark-submit calling jars and a package at run time Fri, 08 Jan, 14:11
Mich Talebzadeh Re: PyCharm, Running spark-submit calling jars and a package at run time Fri, 08 Jan, 16:13
Mich Talebzadeh Re: PyCharm, Running spark-submit calling jars and a package at run time Fri, 08 Jan, 16:41
Mich Talebzadeh Re: PyCharm, Running spark-submit calling jars and a package at run time Fri, 08 Jan, 17:15
Mich Talebzadeh Re: PyCharm, Running spark-submit calling jars and a package at run time Fri, 08 Jan, 17:32
Mich Talebzadeh Re: PyCharm, Running spark-submit calling jars and a package at run time Sat, 09 Jan, 01:46
Mich Talebzadeh Adding third party specific jars to Spark Thu, 14 Jan, 16:51
Mich Talebzadeh PySpark, setting spark conf values in a function and catching for errors Fri, 15 Jan, 23:52
Mich Talebzadeh Re: Running pyspark job from virtual environment Sun, 17 Jan, 17:02
Mich Talebzadeh Re: Running pyspark job from virtual environment Sun, 17 Jan, 18:18
Mich Talebzadeh Re: Correctness bug on Shuffle+Repartition scenario Sun, 17 Jan, 23:17
Mich Talebzadeh Re: Issue with executer Wed, 20 Jan, 12:37
Mich Talebzadeh Re: Column-level encryption in Spark SQL Thu, 21 Jan, 13:52
Mich Talebzadeh Re: Pyspark How to groupBy -> fit Thu, 21 Jan, 16:58
Mich Talebzadeh Connecting to Hive on -premise from Spark in Cloud using JDBC driver for Hive Wed, 27 Jan, 18:47
Mich Talebzadeh Re: Spark Standalone - Spark application "Stuck" doesn't launch an executor on an available worker Wed, 27 Jan, 18:54
Mich Talebzadeh Re: Connecting to Hive on -premise from Spark in Cloud using JDBC driver for Hive Thu, 28 Jan, 22:09
Mich Talebzadeh Re: Spark SQL query Sun, 31 Jan, 17:39
Michal Monselise Extending GraphFrames without running into serialization issues Tue, 05 Jan, 19:08
Pasha Finkelshteyn Re: Apache Spark Tue, 26 Jan, 13:20
Peter Podlovics subscribe user@spark.apache.org Tue, 19 Jan, 17:29
Pradyumn Agrawal Spark 3.0.1 not connecting with Hive 2.1.1 Thu, 07 Jan, 07:40
Pradyumn Agrawal Re: Spark 3.0.1 not connecting with Hive 2.1.1 Sat, 09 Jan, 17:53
Pradyumn Agrawal Re: Spark 3.0.1 not connecting with Hive 2.1.1 Sun, 10 Jan, 06:59
Pradyumn Agrawal Re: Spark 3.0.1 not connecting with Hive 2.1.1 Tue, 12 Jan, 17:40
Prashant Sharma Re: Error while running Spark on K8s Mon, 04 Jan, 12:15
Prashant Sharma Re: Error while running Spark on K8s Mon, 04 Jan, 13:14
Prashant Sharma Re: Suggestion on Spark 2.4.7 vs Spark 3 for Kubernetes Tue, 05 Jan, 09:38
Rahul Kumar Insertable records in Datasource v2. Thu, 14 Jan, 02:06
Rahul Kumar Re: Insertable records in Datasource v2. Fri, 15 Jan, 00:37
Ramki Ram Library to read health care EDI files in pyspark Wed, 06 Jan, 20:33
Renganathan M How Spark Framework works a Compiler Sun, 03 Jan, 09:52
Riccardo Ferrari Re: PyCharm, Running spark-submit calling jars and a package at run time Fri, 08 Jan, 15:50
Riccardo Ferrari Re: PyCharm, Running spark-submit calling jars and a package at run time Fri, 08 Jan, 16:38
Riccardo Ferrari Pyspark How to groupBy -> fit Thu, 21 Jan, 15:19
Riccardo Ferrari Re: Pyspark How to groupBy -> fit Thu, 21 Jan, 19:51
Sachit Murarka Error while running Spark on K8s Mon, 04 Jan, 11:55
Sachit Murarka Re: Error while running Spark on K8s Mon, 04 Jan, 12:48
Sachit Murarka Suggestion on Spark 2.4.7 vs Spark 3 for Kubernetes Mon, 04 Jan, 19:10
Sachit Murarka Re: Suggestion on Spark 2.4.7 vs Spark 3 for Kubernetes Tue, 05 Jan, 18:48
Sachit Murarka HPA - Kubernetes for Spark Sun, 10 Jan, 19:22
Sachit Murarka Re: HPA - Kubernetes for Spark Mon, 11 Jan, 03:54
Sachit Murarka Spark 3.0.1 giving warning while running with Java 11 Fri, 15 Jan, 05:24
Sachit Murarka Re: Spark 3.0.1 giving warning while running with Java 11 Fri, 15 Jan, 09:22
Sachit Murarka Re: Issue with executer Wed, 20 Jan, 12:07
Sachit Murarka Query on entrypoint.sh Kubernetes spark Thu, 21 Jan, 09:39
Sachit Murarka Re: Spark SQL query Fri, 29 Jan, 15:06
Sachit Murarka Re: Spark SQL query Sun, 31 Jan, 13:05
Sachit Murarka EOF Exception Spark Structured Streams - Kubernetes Sun, 31 Jan, 13:08
Sandish Kumar HN Re: HPA - Kubernetes for Spark Sun, 10 Jan, 20:47
Sean Owen Re: How Spark Framework works a Compiler Sun, 03 Jan, 16:23
Sean Owen Re: A question on extrapolation of a nonlinear curve fit beyond x value Tue, 05 Jan, 14:43
Sean Owen Re: A question on extrapolation of a nonlinear curve fit beyond x value Tue, 05 Jan, 15:22
Sean Owen Re: A question on extrapolation of a nonlinear curve fit beyond x value Tue, 05 Jan, 15:41
Sean Owen Re: Extending GraphFrames without running into serialization issues Tue, 05 Jan, 21:25
Sean Owen Re: Does Spark dynamic allocation work with more than one workers? Thu, 07 Jan, 14:43
Sean Owen Re: PyCharm, Running spark-submit calling jars and a package at run time Fri, 08 Jan, 16:27
Sean Owen Re: PyCharm, Running spark-submit calling jars and a package at run time Fri, 08 Jan, 17:18
Sean Owen Re: Customizing K-Means for Anomaly Detection Tue, 12 Jan, 19:11
Sean Owen Re: Spark 3.0.1 giving warning while running with Java 11 Fri, 15 Jan, 05:27
Sean Owen Re: Correctness bug on Shuffle+Repartition scenario Sun, 17 Jan, 20:26
Sean Owen Re: subscribe user@spark.apache.org Tue, 19 Jan, 18:29
Sean Owen Re: RDD filter in for loop gave strange results Wed, 20 Jan, 15:00
Sean Owen Re: Spark RDD + HBase: adoption trend Wed, 20 Jan, 15:50
Sean Owen Re: RDD filter in for loop gave strange results Wed, 20 Jan, 15:50
Sean Owen Re: RDD filter in for loop gave strange results Wed, 20 Jan, 16:01
Sean Owen Re: Only one Active task in Spark Structured Streaming application Thu, 21 Jan, 12:25
Sean Owen Re: Pyspark How to groupBy -> fit Thu, 21 Jan, 16:28
Sean Owen Re: Pyspark How to groupBy -> fit Thu, 21 Jan, 20:05
Sean Owen Re: Using same rdd from two threads Fri, 22 Jan, 14:34
Sean Owen Re: Apache Spark Tue, 26 Jan, 14:00
Shiao-An Yuan Re: Correctness bug on Shuffle+Repartition scenario Sun, 17 Jan, 12:21
Shiao-An Yuan Re: Correctness bug on Shuffle+Repartition scenario Mon, 18 Jan, 02:35
Message list« Previous · 1 · 2 · 3 · Next »Thread · Author · Date
Box list
Sep 202191
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137