spark-user mailing list archives: October 2019

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
manish gupta Spark Executor pod not getting created on kubernetes cluster Tue, 01 Oct, 05:43
Prudhvi Chennuru (CONT) Re: [External Sender] Spark Executor pod not getting created on kubernetes cluster Tue, 01 Oct, 13:01
manish gupta Re: [External Sender] Spark Executor pod not getting created on kubernetes cluster Tue, 01 Oct, 14:25
Prudhvi Chennuru (CONT) Re: [External Sender] Spark Executor pod not getting created on kubernetes cluster Tue, 01 Oct, 14:31
manish gupta Re: [External Sender] Spark Executor pod not getting created on kubernetes cluster Tue, 01 Oct, 15:07
Prudhvi Chennuru (CONT) Re: [External Sender] Spark Executor pod not getting created on kubernetes cluster Tue, 01 Oct, 15:35
manish gupta Re: [External Sender] Spark Executor pod not getting created on kubernetes cluster Tue, 01 Oct, 15:49
hamishberri...@tutanota.com Convert a line of String into column Tue, 01 Oct, 21:48
Nikhil Goyal Understanding deploy mode config Thu, 03 Oct, 04:19
Jochen Hebbrecht Spark job fails because of timeout to Driver Fri, 04 Oct, 14:07
Jeff Zhang Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 14:37
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 15:00
Roland Johann Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 15:14
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 15:16
Roland Johann Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 15:37
igor cabral uchoa Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 15:42
jcdauchy Spark on kubernetes : missing spark.kubernetes.driver.request.cores parameter ? Fri, 04 Oct, 15:52
jcdauchy Re: Spark on kubernetes : missing spark.kubernetes.driver.request.cores parameter ? Fri, 04 Oct, 16:12
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 17:27
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 17:31
Roland Johann Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 17:32
igor cabral uchoa Re: Spark job fails because of timeout to Driver Fri, 04 Oct, 17:51
Dhaval Modi Re: Convert a line of String into column Sat, 05 Oct, 08:30
ayan guha Re: Convert a line of String into column Sat, 05 Oct, 19:30
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Sun, 06 Oct, 16:08
Jochen Hebbrecht Re: Spark job fails because of timeout to Driver Sun, 06 Oct, 16:09
KhajaAsmath Mohammed Loop through Dataframes Sun, 06 Oct, 21:42
Holden Karau Re: Loop through Dataframes Mon, 07 Oct, 00:40
Rao, Abhishek (Nokia - IN/Bangalore) RE: [External Sender] Spark Executor pod not getting created on kubernetes cluster Mon, 07 Oct, 13:29
Lian Jiang pandas_udf throws "Unsupported class file major version 56" Mon, 07 Oct, 16:55
Lian Jiang Re: pandas_udf throws "Unsupported class file major version 56" Mon, 07 Oct, 19:19
Amit Sharma Driver vs master Mon, 07 Oct, 23:33
Andrew Melo Re: Driver vs master Mon, 07 Oct, 23:45
Amit Sharma Re: Driver vs master Tue, 08 Oct, 00:20
Andrew Melo Re: Driver vs master Tue, 08 Oct, 01:11
ayan guha Re: Driver vs master Tue, 08 Oct, 01:49
Andrew Melo Re: Driver vs master Tue, 08 Oct, 01:52
Shuo Chen question about spark sql join pruning Tue, 08 Oct, 10:58
Ashish Mittal Problem of how to retrieve file from HDFS Tue, 08 Oct, 13:58
Dennis Suhari Best practise local vs distributed python Tue, 08 Oct, 15:48
Vincent,Wei (send this email to unsubscribe) Thu, 10 Oct, 03:49
Amit Sharma spark streaming exception Thu, 10 Oct, 19:49
Nimmi Cv org.apache.spark.util.SparkUncaughtExceptionHandler Thu, 10 Oct, 20:39
Mich Talebzadeh Re: org.apache.spark.util.SparkUncaughtExceptionHandler Thu, 10 Oct, 21:04
Jae Yoon Yoo redirectToLog: new-bee question Thu, 10 Oct, 23:48
Bin Chen How to avoid spark executor fetching jars in Local mode Fri, 11 Oct, 08:05
Jack Kolokasis Calculate Task Memory Usage Fri, 11 Oct, 19:20
张 帅 Question About Spark Streaming Kafka Executor Memory Sat, 12 Oct, 06:19
Antoni Ivanov RE: Question About Spark Streaming Kafka Executor Memory Mon, 14 Oct, 06:43
pratik4891 Spark pipeRDD vs ML Mon, 14 Oct, 08:07
Zhang Victor 回复: Question About Spark Streaming Kafka Executor Memory Mon, 14 Oct, 09:05
xweb Use our own metastore with Spark SQL Mon, 14 Oct, 16:24
puneetloya Re: Spark 2.4.3 - Structured Streaming - high on Storage Memory Mon, 14 Oct, 22:59
Andre Piwoni Semantics of Manual Offset Commit for Kafka Spark Streaming Mon, 14 Oct, 23:00
Zhu, Luke Re: Use our own metastore with Spark SQL Tue, 15 Oct, 02:05
Richard Reitmeyer apache-spark Structured Stateful Streaming with window / SPARK-21641 Tue, 15 Oct, 21:36
Jungtaek Lim Re: apache-spark Structured Stateful Streaming with window / SPARK-21641 Wed, 16 Oct, 07:24
amit kumar singh convert josn string in spark sql Wed, 16 Oct, 12:13
Alastair Green Re: graphx vs graphframes Thu, 17 Oct, 08:19
Chetan Khatri Spark - configuration setting doesn't work Thu, 17 Oct, 13:59
Chetan Khatri Re: Control Sqoop job from Spark job Thu, 17 Oct, 14:06
Chetan Khatri Spark Cluster over yarn cluster monitoring Thu, 17 Oct, 14:11
Amit Sharma Re: spark streaming exception Thu, 17 Oct, 15:08
Nicolas Paris Re: graphx vs graphframes Thu, 17 Oct, 21:03
melin li Orc upgrade to 1.6 to support zstd Fri, 18 Oct, 10:03
Sanjay Meetup Link for Bangalore is broken Fri, 18 Oct, 12:52
Michael Cotterell CFP: 4th Workshop on Open Science in Big Data (part of IEEE BigData 2019) Sat, 19 Oct, 14:53
Rishi Shah [pyspark 2.4.3] nested windows function performance Sun, 20 Oct, 04:56
Paul Wais pyspark - memory leak leading to OOM after submitting 100 jobs? Sun, 20 Oct, 10:18
Jungtaek Lim Re: pyspark - memory leak leading to OOM after submitting 100 jobs? Mon, 21 Oct, 01:23
Manuel Sopena Ballesteros driver crashesneed to find out why driver keeps crashing Mon, 21 Oct, 05:46
melin li Spark 3.0 yarn does not support cdh5 Mon, 21 Oct, 07:02
melin li Re: Spark 3.0 yarn does not support cdh5 Mon, 21 Oct, 07:03
Sriram Ganesh Monitor executor and task memory getting used Mon, 21 Oct, 11:45
Rishi Shah Re: [pyspark 2.4.3] nested windows function performance Mon, 21 Oct, 11:58
Sriram Ganesh Re: Monitor executor and task memory getting used Mon, 21 Oct, 12:12
Shyam P Issue : KafkaConsumer cache hitting max capacity of 64, removing consumer for CacheKey Mon, 21 Oct, 12:42
peter 答复: Issue : KafkaConsumer cache hitting max capacity of 64, removing consumer for CacheKey Mon, 21 Oct, 13:12
Gabor Somogyi Re: Issue : KafkaConsumer cache hitting max capacity of 64, removing consumer for CacheKey Mon, 21 Oct, 13:32
Georg Heiler Re: [pyspark 2.4.3] nested windows function performance Mon, 21 Oct, 15:09
vibhatha Streaming Reduction on a stream of Arrays Mon, 21 Oct, 21:15
zhangliyun A question about broadcast nest loop join Wed, 23 Oct, 10:02
Akshay Bhardwaj Re: driver crashesneed to find out why driver keeps crashing Wed, 23 Oct, 10:09
Wenchen Fan Re: A question about broadcast nest loop join Wed, 23 Oct, 12:54
Reminia Scarlet SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Wed, 23 Oct, 12:57
Jungtaek Lim Re: SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Wed, 23 Oct, 13:38
manish gupta Spark executor pods not getting killed after task completion Wed, 23 Oct, 13:49
manishgupta88 RE: [External Sender] Spark Executor pod not getting created on kubernetes cluster Wed, 23 Oct, 13:50
Reminia Scarlet Re: SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Wed, 23 Oct, 14:21
Isabelle Phan Delete checkpointed data for a single dataset? Wed, 23 Oct, 18:43
zhangliyun Re:Re: A question about broadcast nest loop join Wed, 23 Oct, 21:57
Jungtaek Lim Re: SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Wed, 23 Oct, 22:10
zhangliyun Re:Re: A question about broadcast nest loop join Wed, 23 Oct, 22:29
Wenchen Fan Re: Re: A question about broadcast nest loop join Thu, 24 Oct, 05:13
Reminia Scarlet Re: SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Thu, 24 Oct, 06:14
Jungtaek Lim Re: SparkStreming logical plan leaf nodes is not equal pysical plan leaf nodes and streaming metrics cannot be reported. Thu, 24 Oct, 07:11
Sriram Ganesh Re: Monitor executor and task memory getting used Thu, 24 Oct, 09:28
francexo83 [Spark Sql] Direct write on hive and s3 while executing a CTAS on spark sql Thu, 24 Oct, 14:21
manishgupta88 Re: Spark executor pods not getting killed after task completion Fri, 25 Oct, 07:06
amit kumar singh issue with regexp_replace Sat, 26 Oct, 11:16
Message list1 · 2 · Next »Thread · Author · Date
Box list
Nov 201993
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137