spark-user mailing list archives: December 2018

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Chris Teoh Re: Convert RDD[Iterrable[MyCaseClass]] to RDD[MyCaseClass] Sat, 01 Dec, 10:09
Chris Teoh Re: Convert RDD[Iterrable[MyCaseClass]] to RDD[MyCaseClass] Sat, 01 Dec, 11:17
Kappaganthu, Sivaram (CORP) unsubscribe Sat, 01 Dec, 16:48
Abdeali Kothari PicklingError - Can't pickle py4j.protocol.Py4JJavaError - it's not the same object Sun, 02 Dec, 12:53
JF Chen "failed to get records for spark-executor after polling for ***" error Mon, 03 Dec, 09:32
Gabor Somogyi Re: "failed to get records for spark-executor after polling for ***" error Mon, 03 Dec, 10:11
Kappaganthu, Sivaram (CORP) unsubscribe Mon, 03 Dec, 10:31
James Starks Re: Convert RDD[Iterrable[MyCaseClass]] to RDD[MyCaseClass] Mon, 03 Dec, 12:53
Chang.Wu Executor launched but no tasks is submitted Mon, 03 Dec, 13:11
James Starks Parallel read parquet file, write to postgresql Mon, 03 Dec, 13:40
Shahab Yunus Re: Convert RDD[Iterrable[MyCaseClass]] to RDD[MyCaseClass] Mon, 03 Dec, 15:01
Shahab Yunus Re: Parallel read parquet file, write to postgresql Mon, 03 Dec, 15:06
Antoine DUBOIS Using spark and mesos container with host_path volume Mon, 03 Dec, 15:44
Gerard Maas Re: Convert RDD[Iterrable[MyCaseClass]] to RDD[MyCaseClass] Mon, 03 Dec, 16:48
pmatpadi How to preserve event order per key in Structured Streaming Repartitioning By Key? Mon, 03 Dec, 22:22
Nirmal Manoharan Spark Structured streaming - dropDuplicates with watermark Tue, 04 Dec, 05:00
Junior Alvarez unsubscribe Tue, 04 Dec, 08:02
Conrad Lee Re: Job hangs in blocked task in final parquet write stage Tue, 04 Dec, 08:45
GmailLiang Unsubscribe Tue, 04 Dec, 12:41
Hans Fischer Recommended Node Usage Tue, 04 Dec, 20:17
subramgr [Spark Structured Streaming] Dynamically changing maxOffsetsPerTrigger Tue, 04 Dec, 21:44
Luciano Resende [ANNOUNCE] Apache Bahir 2.3.0 Released Tue, 04 Dec, 22:57
Luciano Resende [ANNOUNCE] Apache Bahir 2.3.1 Released Tue, 04 Dec, 22:57
Luciano Resende [ANNOUNCE] Apache Bahir 2.3.2 Released Tue, 04 Dec, 22:57
Affan Syed OData compliant API for Spark Wed, 05 Dec, 05:14
JF Chen how to change temp directory when spark write data ? Wed, 05 Dec, 08:11
Sandip Mehta Re: how to change temp directory when spark write data ? Wed, 05 Dec, 10:28
JF Chen Re: how to change temp directory when spark write data ? Wed, 05 Dec, 13:50
Jean Georges Perrin Re: OData compliant API for Spark Wed, 05 Dec, 13:50
kant kodali How to track batch jobs in spark ? Wed, 05 Dec, 21:41
Priya Matpadi Re: How to track batch jobs in spark ? Wed, 05 Dec, 23:06
Mark Hamstra Re: How to track batch jobs in spark ? Wed, 05 Dec, 23:11
Alchemist Spark Streaming job is missing Streaming tab from the UI on Ambari Thu, 06 Dec, 03:54
Affan Syed Re: OData compliant API for Spark Thu, 06 Dec, 08:21
Abhijeet Kumar Join happening after watermark time Thu, 06 Dec, 08:41
mengmeng.m...@mathartsys.com how to register UDF when scala code invoke python Thu, 06 Dec, 09:04
kant kodali Re: How to track batch jobs in spark ? Thu, 06 Dec, 10:40
Alchemist How to fix spark streaming missing tab Thu, 06 Dec, 13:20
Thakrar, Jayesh Re: How to track batch jobs in spark ? Thu, 06 Dec, 15:40
Gourav Sengupta Re: How to track batch jobs in spark ? Thu, 06 Dec, 22:13
Gourav Sengupta Re: How to fix spark streaming missing tab Thu, 06 Dec, 22:18
sparkuser99 Spark Core - Embed in other application Fri, 07 Dec, 00:23
salemi Spark Structured Streaming - DF shows only one column with list of byte array Fri, 07 Dec, 03:05
conner In the future, will Spark support capacity scheduler in standalone mode? Fri, 07 Dec, 07:36
朱 婧迪 how to register UDF when scala code invoke python Fri, 07 Dec, 08:56
David Markovitz Run SQL on files directly Sat, 08 Dec, 17:39
Subhash Sriram Re: Run SQL on files directly Sat, 08 Dec, 20:37
David Markovitz RE: Run SQL on files directly Sat, 08 Dec, 21:55
Abdeali Kothari Identifying cause of exception in PySpark Mon, 10 Dec, 03:40
Abhijeet Kumar Why does join use rows that were sent after watermark of 20 seconds? Mon, 10 Dec, 11:53
lsn24 Spark Sql group by less performant Tue, 11 Dec, 00:28
15313776907 Re: Spark Sql group by less performant Tue, 11 Dec, 01:09
Abhijeet Kumar Re: Why does join use rows that were sent after watermark of 20 seconds? Tue, 11 Dec, 05:52
Jungtaek Lim Re: Why does join use rows that were sent after watermark of 20 seconds? Tue, 11 Dec, 06:16
Georg Heiler Re: Spark Sql group by less performant Tue, 11 Dec, 07:44
Conrad Lee Re: Job hangs in blocked task in final parquet write stage Tue, 11 Dec, 08:05
Chunpeng Wang SGD for pyspark Tue, 11 Dec, 16:29
Andrew Melo Questions about caching Tue, 11 Dec, 17:13
Andrés Ivaldi Spark version performance Wed, 12 Dec, 01:57
JF Chen How to set Spark Streaming batch start time? Wed, 12 Dec, 02:00
Kamran khan Re: How to set Spark Streaming batch start time? Wed, 12 Dec, 02:33
Andrés Ivaldi Re: Spark Core - Embed in other application Wed, 12 Dec, 02:53
Holden Karau Re: How to preserve event order per key in Structured Streaming Repartitioning By Key? Wed, 12 Dec, 04:58
Laurent Thiebaud Kalman filter with spark Thu, 13 Dec, 12:56
Steven Stetzler Problem running Spark on Kubernetes: Certificate error Thu, 13 Dec, 21:48
Matt Cheah Re: Problem running Spark on Kubernetes: Certificate error Fri, 14 Dec, 00:59
lk_spark how to generate a larg dataset paralleled Fri, 14 Dec, 02:38
Jean Georges Perrin Re: how to generate a larg dataset paralleled Fri, 14 Dec, 03:10
lk_spark Re: Re: how to generate a larg dataset paralleled Fri, 14 Dec, 04:04
Gezim Sejdiu SANSA 0.5 (Scalable Semantic Analytics Stack) Released Fri, 14 Dec, 08:28
15313776907 Re: how to generate a larg dataset paralleled Fri, 14 Dec, 08:39
lk_spark Re: Re: how to generate a larg dataset paralleled Fri, 14 Dec, 10:06
Davide.Mandrini Re: Driver Memory taken up by BlockManager Fri, 14 Dec, 10:19
albamoro Continuous Processing roadmap Fri, 14 Dec, 11:07
Kalvin Chau Structured Streaming on Kubernetes Performance Fri, 14 Dec, 17:33
李斌松 spark2.4 arrow enabled true,error log not returned Sat, 15 Dec, 06:39
big data Maven dependecy problem about spark-streaming-kafka_2.11:1.6.3 Mon, 17 Dec, 07:03
Laurent Thiebaud Mllib / kalman Mon, 17 Dec, 13:59
robin.e...@xense.co.uk Mllib / kalman Mon, 17 Dec, 14:37
Soheil Pourbafrani Spark App Write nothing on HDFS Mon, 17 Dec, 18:08
Nikhil Goyal Need help with SparkSQL Query Mon, 17 Dec, 21:03
Patrick McCarthy Re: Need help with SparkSQL Query Mon, 17 Dec, 21:07
Ramandeep Singh Nanda Re: Need help with SparkSQL Query Mon, 17 Dec, 21:11
Nirav Patel Spark 2.2.1 - Operation not allowed: alter table replace columns Mon, 17 Dec, 23:10
shyla deshpande How to clean up logs-dirs and local-dirs of running spark streaming in yarn cluster mode Tue, 18 Dec, 00:42
Yuta Morisawa How to update structured streaming apps gracefully Tue, 18 Dec, 02:56
Alexander Chermenin State size on joining two streams Tue, 18 Dec, 08:58
Mich Talebzadeh Spark Scala reading from Google Cloud BigQuery table throws error Tue, 18 Dec, 10:26
Jörn Franke Re: Spark Scala reading from Google Cloud BigQuery table throws error Tue, 18 Dec, 11:16
Devender Yadav Add column value in the dataset on the basis of a condition Tue, 18 Dec, 13:47
Shahab Yunus Re: Add column value in the dataset on the basis of a condition Tue, 18 Dec, 14:55
Shahab Yunus Re: Add column value in the dataset on the basis of a condition Tue, 18 Dec, 14:57
Devender Yadav Re: Add column value in the dataset on the basis of a condition Tue, 18 Dec, 15:17
Etienne Chauchot Re: [Apache Beam] Custom DataSourceV2 instanciation: parameters passing and Encoders Tue, 18 Dec, 16:09
Priya Matpadi Re: How to update structured streaming apps gracefully Tue, 18 Dec, 17:29
vincent gromakowski Re: How to update structured streaming apps gracefully Tue, 18 Dec, 17:45
Reza Safi Re: Questions about caching Tue, 18 Dec, 18:42
shyla deshpande Re: How to clean up logs-dirs and local-dirs of running spark streaming in yarn cluster mode Tue, 18 Dec, 19:10
Mich Talebzadeh Re: Spark Scala reading from Google Cloud BigQuery table throws error Tue, 18 Dec, 19:46
swastik mittal Read Time from a remote data source Tue, 18 Dec, 20:20
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Dec 201962
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137