spark-user mailing list archives: October 2019

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
张 帅 Question About Spark Streaming Kafka Executor Memory Sat, 12 Oct, 06:19
Jörn Franke Re: Spark Cluster over yarn cluster monitoring Sun, 27 Oct, 07:01
Akshay Bhardwaj Re: driver crashesneed to find out why driver keeps crashing Wed, 23 Oct, 10:09
Alastair Green Re: graphx vs graphframes Thu, 17 Oct, 08:19
Alessandro Solimando Re: Recover RFormula Column Names Tue, 29 Oct, 09:26
Alessandro Solimando Re: Recover RFormula Column Names Wed, 30 Oct, 09:13
Amit Sharma Driver vs master Mon, 07 Oct, 23:33
Amit Sharma Re: Driver vs master Tue, 08 Oct, 00:20
Amit Sharma spark streaming exception Thu, 10 Oct, 19:49
Amit Sharma Re: spark streaming exception Thu, 17 Oct, 15:08
Andre Piwoni Semantics of Manual Offset Commit for Kafka Spark Streaming Mon, 14 Oct, 23:00
Andrew Melo Re: Driver vs master Mon, 07 Oct, 23:45
Andrew Melo Re: Driver vs master Tue, 08 Oct, 01:11
Andrew Melo Re: Driver vs master Tue, 08 Oct, 01:52
Andrew Redd Fwd: Recover RFormula Column Names Mon, 28 Oct, 20:00
Andrew Redd Re: Recover RFormula Column Names Tue, 29 Oct, 12:49
Aniket Khandelwal Re: issue with regexp_replace Sat, 26 Oct, 19:12
Anton Ippolitov [YarnShuffleService] Consistent OOMs when enabling Spark transport encryption Mon, 28 Oct, 10:09
Antoni Ivanov RE: Question About Spark Streaming Kafka Executor Memory Mon, 14 Oct, 06:43
Ashish Mittal Problem of how to retrieve file from HDFS Tue, 08 Oct, 13:58
Bin Chen How to avoid spark executor fetching jars in Local mode Fri, 11 Oct, 08:05
Chetan Khatri Spark - configuration setting doesn't work Thu, 17 Oct, 13:59
Chetan Khatri Re: Control Sqoop job from Spark job Thu, 17 Oct, 14:06
Chetan Khatri Spark Cluster over yarn cluster monitoring Thu, 17 Oct, 14:11
Chetan Khatri Re: Spark - configuration setting doesn't work Sun, 27 Oct, 05:27
Chetan Khatri Re: Spark Cluster over yarn cluster monitoring Sun, 27 Oct, 05:27
Chetan Khatri Re: Spark - configuration setting doesn't work Tue, 29 Oct, 07:33
Chetan Khatri Re: Spark Cluster over yarn cluster monitoring Tue, 29 Oct, 07:34
Debabrata Ghosh Need help regarding logging / log4j.properties Thu, 31 Oct, 02:25
Dennis Suhari Best practise local vs distributed python Tue, 08 Oct, 15:48
Dhaval Modi Re: Convert a line of String into column Sat, 05 Oct, 08:30
Gabor Somogyi Re: Issue : KafkaConsumer cache hitting max capacity of 64, removing consumer for CacheKey Mon, 21 Oct, 13:32
Georg Heiler Re: [pyspark 2.4.3] nested windows function performance Mon, 21 Oct, 15:09
Holden Karau Re: Loop through Dataframes Mon, 07 Oct, 00:40
Isabelle Phan Delete checkpointed data for a single dataset? Wed, 23 Oct, 18:43
Jack Kolokasis Calculate Task Memory Usage Fri, 11 Oct, 19:20
Jae Yoon Yoo redirectToLog: new-bee question Thu, 10 Oct, 23:48
Jeff Evans Deleting columns within nested arrays/structs? Tue, 29 Oct, 21:37
Jeff Zhang Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 14:37
Jochen Hebbrecht Spark job fails because of timeout to Driver Fri, 04 Oct, 14:07
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 15:00
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 15:16
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 17:27
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 17:31
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Sun, 06 Oct, 16:08
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Sun, 06 Oct, 16:09
Joe Naegele Low-level behavior of Exchange Wed, 30 Oct, 15:44
Jungtaek Lim Re: apache-spark Structured Stateful Streaming with window / SPARK-21641 Wed, 16 Oct, 07:24
Jungtaek Lim Re: pyspark - memory leak leading to OOM after submitting 100 jobs? Mon, 21 Oct, 01:23
Jungtaek Lim Re: SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Wed, 23 Oct, 13:38
Jungtaek Lim Re: SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Wed, 23 Oct, 22:10
Jungtaek Lim Re: SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Thu, 24 Oct, 07:11
KhajaAsmath Mohammed Loop through Dataframes Sun, 06 Oct, 21:42
Lian Jiang pandas_udf throws "Unsupported class file major version 56" Mon, 07 Oct, 16:55
Lian Jiang Re: pandas_udf throws "Unsupported class file major version 56" Mon, 07 Oct, 19:19
Manuel Sopena Ballesteros driver crashesneed to find out why driver keeps crashing Mon, 21 Oct, 05:46
Mich Talebzadeh Re: org.apache.spark.util.SparkUncaughtExceptionHandler Thu, 10 Oct, 21:04
Michael Cotterell CFP: 4th Workshop on Open Science in Big Data (part of IEEE BigData 2019) Sat, 19 Oct, 14:53
Nicolas Paris Re: graphx vs graphframes Thu, 17 Oct, 21:03
Nicolas Paris Re: pyspark - memory leak leading to OOM after submitting 100 jobs? Thu, 31 Oct, 21:03
Nikhil Goyal Understanding deploy mode config Thu, 03 Oct, 04:19
Nimmi Cv org.apache.spark.util.SparkUncaughtExceptionHandler Thu, 10 Oct, 20:39
Paul Wais pyspark - memory leak leading to OOM after submitting 100 jobs? Sun, 20 Oct, 10:18
Paul Wais Re: pyspark - memory leak leading to OOM after submitting 100 jobs? Thu, 31 Oct, 18:02
Prudhvi Chennuru (CONT) Re: [External Sender] Spark Executor pod not getting created on kubernetes cluster Tue, 01 Oct, 13:01
Prudhvi Chennuru (CONT) Re: [External Sender] Spark Executor pod not getting created on kubernetes cluster Tue, 01 Oct, 14:31
Prudhvi Chennuru (CONT) Re: [External Sender] Spark Executor pod not getting created on kubernetes cluster Tue, 01 Oct, 15:35
Prudhvi Chennuru (CONT) MultiObjectDeleteException Tue, 29 Oct, 13:46
Rao, Abhishek (Nokia - IN/Bangalore) RE: [External Sender] Spark Executor pod not getting created on kubernetes cluster Mon, 07 Oct, 13:29
Reminia Scarlet SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Wed, 23 Oct, 12:57
Reminia Scarlet Re: SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Wed, 23 Oct, 14:21
Reminia Scarlet Re: SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Thu, 24 Oct, 06:14
Richard Reitmeyer apache-spark Structured Stateful Streaming with window / SPARK-21641 Tue, 15 Oct, 21:36
Rishi Shah [pyspark 2.4.3] nested windows function performance Sun, 20 Oct, 04:56
Rishi Shah Re: [pyspark 2.4.3] nested windows function performance Mon, 21 Oct, 11:58
Roland Johann Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 15:14
Roland Johann Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 15:37
Roland Johann Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 17:32
Roland Johann Re: Need help regarding logging / log4j.properties Thu, 31 Oct, 06:37
Sanjay Meetup Link for Bangalore is broken Fri, 18 Oct, 12:52
Shuo Chen question about spark sql join pruning Tue, 08 Oct, 10:58
Shyam P Issue : KafkaConsumer cache hitting max capacity of 64, removing consumer for CacheKey Mon, 21 Oct, 12:42
Spico Florin [Spark Streaming] Apply multiple ML pipelines(Models) to the same stream Thu, 31 Oct, 09:16
Sriram Ganesh Monitor executor and task memory getting used Mon, 21 Oct, 11:45
Sriram Ganesh Re: Monitor executor and task memory getting used Mon, 21 Oct, 12:12
Sriram Ganesh Re: Monitor executor and task memory getting used Thu, 24 Oct, 09:28
Vincent,Wei (send this email to unsubscribe) Thu, 10 Oct, 03:49
Wenchen Fan Re: A question about broadcast nest loop join Wed, 23 Oct, 12:54
Wenchen Fan Re: Re: A question about broadcast nest loop join Thu, 24 Oct, 05:13
Xiao Li Happy Diwali everyone!!! Mon, 28 Oct, 02:35
Zhang Victor 回复: Question About Spark Streaming Kafka Executor Memory Mon, 14 Oct, 09:05
Zhu, Luke Re: Use our own metastore with Spark SQL Tue, 15 Oct, 02:05
amit kumar singh convert josn string in spark sql Wed, 16 Oct, 12:13
amit kumar singh issue with regexp_replace Sat, 26 Oct, 11:16
ayan guha Re: Convert a line of String into column Sat, 05 Oct, 19:30
ayan guha Re: Driver vs master Tue, 08 Oct, 01:49
ayan guha Fwd: Delta with intelligent upsett Thu, 31 Oct, 21:14
francexo83 [Spark Sql] Direct write on hive and s3 while executing a CTAS on spark sql Thu, 24 Oct, 14:21
hamishberri...@tutanota.com Convert a line of String into column Tue, 01 Oct, 21:48
hemant singh Re: Spark - configuration setting doesn't work Sun, 27 Oct, 11:54
Message list1 · 2 · Next »Thread · Author · Date
Box list
Nov 201973
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137