spark-user mailing list archives: February 2021

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Re: EOF Exception Spark Structured Streams - Kubernetes
Sachit Murarka   Re: EOF Exception Spark Structured Streams - Kubernetes Mon, 01 Feb, 04:52
Prashant Sharma     Re: EOF Exception Spark Structured Streams - Kubernetes Mon, 01 Feb, 08:27
Sachit Murarka       Re: EOF Exception Spark Structured Streams - Kubernetes Tue, 02 Feb, 04:31
Aaron.K.Math...@wellsfargo.com.INVALID Java/Spark Mon, 01 Feb, 15:08
Sean Owen   Re: Java/Spark Mon, 01 Feb, 15:13
Aaron.K.Math...@wellsfargo.com.INVALID     RE: Java/Spark Mon, 01 Feb, 16:01
Sean Owen       Re: Java/Spark Mon, 01 Feb, 16:04
Re: Spark SQL query
Arpan Bhandari   Re: Spark SQL query Mon, 01 Feb, 15:38
Sachit Murarka     Re: Spark SQL query Mon, 01 Feb, 16:40
Arpan Bhandari       Re: Spark SQL query Mon, 01 Feb, 16:46
Sachit Murarka         Re: Spark SQL query Mon, 01 Feb, 17:11
Arpan Bhandari           Re: Spark SQL query Tue, 02 Feb, 04:54
Arpan Bhandari   Re: Spark SQL query Mon, 01 Feb, 15:40
Mich Talebzadeh     Re: Spark SQL query Mon, 01 Feb, 23:00
Arpan Bhandari       Re: Spark SQL query Tue, 02 Feb, 04:58
Mich Talebzadeh         Re: Spark SQL query Tue, 02 Feb, 14:24
Arpan Bhandari           Re: Spark SQL query Tue, 02 Feb, 14:41
Mich Talebzadeh             Re: Spark SQL query Tue, 02 Feb, 15:04
Arpan Bhandari               Re: Spark SQL query Tue, 02 Feb, 15:13
Mich Talebzadeh                 Re: Spark SQL query Tue, 02 Feb, 19:58
Arpan Bhandari                   Re: Spark SQL query Wed, 03 Feb, 05:04
Mich Talebzadeh                     Re: Spark SQL query Wed, 03 Feb, 09:46
Arpan Bhandari                       Re: Spark SQL query Wed, 03 Feb, 10:11
Mich Talebzadeh                         Re: Spark SQL query Wed, 03 Feb, 11:32
Re: Implementing TableProvider in Spark 3.0
Rahul Kumar   Re: Implementing TableProvider in Spark 3.0 Tue, 02 Feb, 02:31
Rahul Kumar Spark 3 datasource v2: Can't extract user provided schema Dataframewriter save operation Tue, 02 Feb, 19:29
David Morin S3a Committer Tue, 02 Feb, 20:26
Henoc   Re: S3a Committer Tue, 02 Feb, 20:41
David Morin     Re: S3a Committer Tue, 02 Feb, 20:47
Boris Litvak   RE: S3a Committer Wed, 03 Feb, 06:43
YoungKun Min     Re: S3a Committer Wed, 03 Feb, 07:34
Gourav Sengupta       Re: S3a Committer Wed, 03 Feb, 08:58
Artemis User Exception on Avro Schema Object Serialization Tue, 02 Feb, 20:31
Sean Owen   Re: Exception on Avro Schema Object Serialization Tue, 02 Feb, 20:36
Artemis User     Re: Exception on Avro Schema Object Serialization Tue, 02 Feb, 20:49
Mich Talebzadeh Assertion of return value of dataframe in pytest Wed, 03 Feb, 15:12
Mich Talebzadeh   Re: Assertion of return value of dataframe in pytest Wed, 03 Feb, 16:50
Sofia’s World     Re: Assertion of return value of dataframe in pytest Wed, 03 Feb, 18:11
Mich Talebzadeh       Re: Assertion of return value of dataframe in pytest Wed, 03 Feb, 18:43
James Yu Poor performance caused by coalesce to 1 Wed, 03 Feb, 18:54
Silvio Fiorito   Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 19:05
Stéphane Verlet   Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 19:06
Sean Owen   Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 19:07
Mich Talebzadeh     Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 19:26
James Yu   Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 19:19
Gourav Sengupta     Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 20:53
Silvio Fiorito     Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 21:27
xgong [Spark on Kubernetes] Spark Application dependency management Question. Thu, 04 Feb, 00:04
yinghua...@163.com Flink 1.11.3从Kafka提取数据到Hive问题求助 Thu, 04 Feb, 00:32
Akshat Bordia Large Scheduler Delay Causing Performance Issue in Spark Application Thu, 04 Feb, 16:57
Re: Spark Event Log Forwarding and Offset Tracking
Raymond Tan   Re: Spark Event Log Forwarding and Offset Tracking Thu, 04 Feb, 17:14
Dávid Szakállas Exporting all Executor Metrics in Prometheus format in K8s cluster Thu, 04 Feb, 20:29
Erica Lin Databricks Spark Parallelism and Shuffle Partitions Thu, 04 Feb, 22:27
Subhash Sriram   Re: Databricks Spark Parallelism and Shuffle Partitions Thu, 04 Feb, 22:44
Re: Data source v2 streaming sinks does not support Update mode
Eric Beabes   Re: Data source v2 streaming sinks does not support Update mode Fri, 05 Feb, 00:34
Soheil Pourbafrani Converting RelationalGroupedDataSet to DataFrame Sat, 06 Feb, 22:45
Stephane Verlet   Re: Converting RelationalGroupedDataSet to DataFrame Sun, 07 Feb, 19:39
galliaproject Introducing Gallia: a Scala+Spark library for data manipulation Mon, 08 Feb, 17:23
galliaproject   Re: Introducing Gallia: a Scala+Spark library for data manipulation Tue, 16 Feb, 19:42
shahab Getting : format(target_id, ".", name), value) .. error Mon, 08 Feb, 20:43
Terry Kim Announcing Hyperspace v0.4.0 - an indexing subsystem for Apache Spark™ Mon, 08 Feb, 20:50
Mich Talebzadeh Testing ETL with Spark using Pytest Tue, 09 Feb, 15:17
Jerry Vinokurov   Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 15:47
Mich Talebzadeh     Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 16:14
Jerry Vinokurov       Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 16:34
Mich Talebzadeh         Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 17:37
Sofia’s World           Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 18:09
Mich Talebzadeh             Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 18:33
Rishabh Jain Issue with accessing S3 from EKS spark pod Tue, 09 Feb, 16:46
Vladimir Prus   Re: Issue with accessing S3 from EKS spark pod Tue, 09 Feb, 17:14
Rishabh Jain     Re: Issue with accessing S3 from EKS spark pod Wed, 10 Feb, 08:43
Vladimir Prus       Re: Issue with accessing S3 from EKS spark pod Wed, 10 Feb, 08:56
Rishabh Jain         Re: Issue with accessing S3 from EKS spark pod Wed, 10 Feb, 17:50
Ranju Jain Spark Kubernetes 3.0.1 | podcreationTimeout not working Wed, 10 Feb, 13:02
Jacek Laskowski   Re: Spark Kubernetes 3.0.1 | podcreationTimeout not working Wed, 10 Feb, 17:27
Attila Zsolt Piros     Re: Spark Kubernetes 3.0.1 | podcreationTimeout not working Fri, 12 Feb, 10:47
unsubscribe
Ricardo Sardenberg   unsubscribe Wed, 10 Feb, 15:41
Roland Johann   unsubscribe Fri, 26 Feb, 19:27
javaguy Java Spark as an application server cache Wed, 10 Feb, 20:48
Kuttaiah Robin How to handle spark state which is growing too big even with timeout set. Thu, 11 Feb, 08:00
Jungtaek Lim   Re: How to handle spark state which is growing too big even with timeout set. Mon, 15 Feb, 03:58
Abhishek Gupta Trigger on GroupStateTimeout with no new data in group Thu, 11 Feb, 12:56
Re: understanding spark shuffle file re-use better
Attila Zsolt Piros   Re: understanding spark shuffle file re-use better Thu, 11 Feb, 15:38
Attila Zsolt Piros     Re: understanding spark shuffle file re-use better Fri, 12 Feb, 10:13
Mandloi87       Re: understanding spark shuffle file re-use better Thu, 18 Feb, 18:21
Unsubscribe
Sunil Prabhakara   Unsubscribe Fri, 12 Feb, 05:10
Jonathan Hodges   Unsubscribe Sat, 20 Feb, 16:37
Roland Johann   Unsubscribe Wed, 24 Feb, 18:54
act_coder Spark structured streaming with periodical persist and unpersist Fri, 12 Feb, 06:16
Does Spark 3.0 support parquet predicate pushdown for array of structures
Haijia Zhou   Does Spark 3.0 support parquet predicate pushdown for array of structures Mon, 15 Feb, 03:56
[SPARK-SQL] Does Spark 3.0 support parquet predicate pushdown for array of structs?
Haijia Zhou   [SPARK-SQL] Does Spark 3.0 support parquet predicate pushdown for array of structs? Mon, 15 Feb, 04:23
Re: K8S spark-submit Loses Successful Driver Completion
Attila Zsolt Piros   Re: K8S spark-submit Loses Successful Driver Completion Mon, 15 Feb, 16:00
HARSH TAKKAR Using Custom Scala Spark ML Estimator in PySpark Tue, 16 Feb, 05:22
Mich Talebzadeh   Re: Using Custom Scala Spark ML Estimator in PySpark Tue, 16 Feb, 08:36
Sean Owen   Re: Using Custom Scala Spark ML Estimator in PySpark Tue, 16 Feb, 14:55
HARSH TAKKAR     Re: Using Custom Scala Spark ML Estimator in PySpark Tue, 16 Feb, 16:25
VenkateshDurai Using DataFrame to Read Avro files Tue, 16 Feb, 06:22
Jahar Tyagi vm.swappiness value for Spark on Kubernetes Tue, 16 Feb, 11:27
Sean Owen   Re: vm.swappiness value for Spark on Kubernetes Tue, 16 Feb, 14:07
aupres KafkaUtils module not found on spark 3 pyspark Wed, 17 Feb, 07:19
Jungtaek Lim   Re: KafkaUtils module not found on spark 3 pyspark Wed, 17 Feb, 08:01
Ivan Petrov Spark SQL Dataset and BigDecimal Wed, 17 Feb, 12:48
Takeshi Yamamuro   Re: Spark SQL Dataset and BigDecimal Wed, 17 Feb, 23:33
Ivan Petrov     Re: Spark SQL Dataset and BigDecimal Thu, 18 Feb, 09:39
Khalid Mammadov       Re: Spark SQL Dataset and BigDecimal Thu, 18 Feb, 23:27
Rathore, Yashasvini [Spark SQL] - Not able to consume Kafka topics Thu, 18 Feb, 11:01
Jungtaek Lim   Re: [Spark SQL] - Not able to consume Kafka topics Fri, 19 Feb, 04:53
Rathore, Yashasvini   [Spark SQL] - Not able to consume Kafka topics Fri, 19 Feb, 09:02
Grégory Dugernier PySpark registerJavaUDAF doesn't accept UDAF Aggregator (Spark 3) Thu, 18 Feb, 11:29
Message list1 · 2 · Next »Thread · Author · Date
Box list
Jul 2021124
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137