spark-user mailing list archives: May 2018

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Huiliang Zhang NullPointerException when scanning HBase table Tue, 01 May, 02:05
Re: Spark launcher listener not getting invoked k8s Spark 2.3
Marcelo Vanzin   Re: Spark launcher listener not getting invoked k8s Spark 2.3 Tue, 01 May, 03:17
lsn24 Filter one dataset based on values from another Tue, 01 May, 04:02
Lalwani, Jayesh   Re: Filter one dataset based on values from another Tue, 01 May, 12:08
lsn24     Re: Filter one dataset based on values from another Tue, 01 May, 16:00
880f0464 UnresolvedException: Invalid call to dataType on unresolved object Tue, 01 May, 11:14
880f0464 spark.python.worker.reuse not working as expected Tue, 01 May, 11:17
880f0464 PySpark.sql.filter not performing as it should Tue, 01 May, 11:19
Pralabh Kumar org.apache.spark.shuffle.FetchFailedException: Too large frame: Tue, 01 May, 11:21
Ryan Blue   Re: org.apache.spark.shuffle.FetchFailedException: Too large frame: Tue, 01 May, 16:07
Pralabh Kumar     Re: org.apache.spark.shuffle.FetchFailedException: Too large frame: Thu, 03 May, 03:57
Ryan Blue       Re: org.apache.spark.shuffle.FetchFailedException: Too large frame: Thu, 03 May, 17:54
Valery Khamenya all calculations finished, but "VCores Used" value remains at its max Tue, 01 May, 11:30
Felix Cheung   Re: all calculations finished, but "VCores Used" value remains at its max Tue, 01 May, 15:53
Re: Dataframe vs dataset
Lalwani, Jayesh   Re: Dataframe vs dataset Tue, 01 May, 12:27
Michael Artz     Re: Dataframe vs dataset Tue, 01 May, 15:14
Rich Bowen ApacheCon North America 2018 schedule is now live. Tue, 01 May, 12:36
Valery Khamenya smarter way to "forget" DataFrame definition and stick to its values Tue, 01 May, 13:16
Lalwani, Jayesh   Re: smarter way to "forget" DataFrame definition and stick to its values Wed, 02 May, 12:28
marcos rebelo Fast Unit Tests Tue, 01 May, 15:25
Geoff Von Allmen   Re: Fast Unit Tests Tue, 01 May, 15:44
Yeikel Santana   RE: Fast Unit Tests Tue, 01 May, 15:56
Re: [EXT] [Spark 2.x Core] .collect() size limit
klrmowse   Re: [EXT] [Spark 2.x Core] .collect() size limit Tue, 01 May, 15:49
nicholasl keep getting empty table while using saveAsTable() to save DataFrame as table Tue, 01 May, 18:51
Patrick McCarthy Poor performance reading Hive table made of sequence files Tue, 01 May, 20:36
Khaled Zaouk [Spark Streaming]: Does DStream workload run over Spark SQL engine? Wed, 02 May, 08:51
Saisai Shao   Re: [Spark Streaming]: Does DStream workload run over Spark SQL engine? Wed, 02 May, 09:06
Paul Borgmans [Spark scheduling] Spark schedules single task although rdd has 48 partitions? Wed, 02 May, 09:31
Agostino Calamita spark.executor.extraJavaOptions inside application code Wed, 02 May, 10:59
Vadim Semenov   Re: spark.executor.extraJavaOptions inside application code Wed, 02 May, 13:38
kant kodali what is the query language used for graphX? Wed, 02 May, 11:00
Daniele Foroni Dataset Caching and Unpersisting Wed, 02 May, 11:19
Re: ML Linear and Logistic Regression - Poor Performance
Irving Duran   Re: ML Linear and Logistic Regression - Poor Performance Wed, 02 May, 14:15
Mihai Iacob how to trace sparkDriver context creation for pyspark Wed, 02 May, 14:39
[No Subject]
Filippo Balicchia   [No Subject] Wed, 02 May, 15:03
Davide Brambilla   [No Subject] Wed, 16 May, 09:36
Jörn Franke     Re: Wed, 16 May, 09:41
Davide Brambilla       Re: Wed, 16 May, 10:20
Vadim Semenov     Re: Wed, 16 May, 14:18
Nicolas Paris       Re: Wed, 16 May, 19:06
Re: Problem in persisting file in S3 using Spark: xxx file does not exist Exception
Paul Tremblay   Re: Problem in persisting file in S3 using Spark: xxx file does not exist Exception Wed, 02 May, 15:56
Marco Mistroni     Re: Problem in persisting file in S3 using Spark: xxx file does not exist Exception Wed, 02 May, 19:35
Christopher Piggott Running apps over a VPN Wed, 02 May, 15:57
Re: Uncaught exception in thread heartbeat-receiver-event-loop-thread
ccherng   Re: Uncaught exception in thread heartbeat-receiver-event-loop-thread Wed, 02 May, 20:34
ccherng     Re: Uncaught exception in thread heartbeat-receiver-event-loop-thread Wed, 02 May, 20:48
ccherng ConcurrentModificationException Wed, 02 May, 20:47
Sergey Zhemzhitsky AccumulatorV2 vs AccumulableParam (V1) Wed, 02 May, 22:20
Wenchen Fan   Re: AccumulatorV2 vs AccumulableParam (V1) Thu, 03 May, 14:20
Sergey Zhemzhitsky     Re: AccumulatorV2 vs AccumulableParam (V1) Fri, 04 May, 12:33
Mina Aslani MappingException - org.apache.spark.mllib.classification.LogisticRegressionModel.load Thu, 03 May, 03:05
kant kodali question on collect_list or say aggregations in general in structured streaming 2.3.0 Thu, 03 May, 08:24
kant kodali   Re: question on collect_list or say aggregations in general in structured streaming 2.3.0 Thu, 03 May, 08:52
Arun Mahadevan     Re: question on collect_list or say aggregations in general in structured streaming 2.3.0 Thu, 03 May, 16:55
kant kodali       Re: question on collect_list or say aggregations in general in structured streaming 2.3.0 Fri, 04 May, 08:39
Fawze Abujaber native-lzo library not available Thu, 03 May, 12:06
yuliya Feldman   Re: native-lzo library not available Thu, 03 May, 18:17
Fawze Abujaber     Re: native-lzo library not available Fri, 04 May, 05:39
ayan guha       Re: native-lzo library not available Fri, 04 May, 05:48
erp12 Pickling Keras models for use in UDFs Thu, 03 May, 15:26
Khaled Zaouk   Re: Pickling Keras models for use in UDFs Fri, 04 May, 09:28
erp12     Re: Pickling Keras models for use in UDFs Mon, 07 May, 18:32
Re: Read or save specific blocks of a file
Thodoris Zois   Re: Read or save specific blocks of a file Thu, 03 May, 15:46
ayan guha     Re: Read or save specific blocks of a file Thu, 03 May, 18:41
Jiří Syrový [Structured streaming, V2] commit on ContinuousReader Thu, 03 May, 17:43
neeravsalaria SparkContext taking time after adding jars and asking yarn for resources Fri, 04 May, 09:01
kant kodali I cannot use spark 2.3.0 and kafka 0.9? Fri, 04 May, 09:02
Shixiong(Ryan) Zhu   Re: I cannot use spark 2.3.0 and kafka 0.9? Wed, 09 May, 00:20
Shuporno Choudhury [pyspark] Read multiple files parallely into a single dataframe Fri, 04 May, 09:38
Irving Duran   Re: [pyspark] Read multiple files parallely into a single dataframe Fri, 04 May, 17:09
Christopher Piggott Free Column Reference with $ Fri, 04 May, 14:10
Vadim Semenov   Re: Free Column Reference with $ Fri, 04 May, 16:14
RV: Unintelligible warning arose out of the blue.
Tomas Zubiri   RV: Unintelligible warning arose out of the blue. Fri, 04 May, 20:15
Marco Mistroni     Re: RV: Unintelligible warning arose out of the blue. Fri, 04 May, 20:54
Dhaval Modi Advice on multiple streaming job Sat, 05 May, 15:09
vincent gromakowski   Re: Advice on multiple streaming job Sun, 06 May, 07:32
Susan X. Huynh     Re: Advice on multiple streaming job Sun, 06 May, 14:57
Dhaval Modi       Re: Advice on multiple streaming job Sun, 06 May, 17:59
Gerard Maas         Re: Advice on multiple streaming job Mon, 07 May, 08:23
Dhaval Modi           Re: Advice on multiple streaming job Mon, 07 May, 09:08
Peter Liu             Re: Advice on multiple streaming job Tue, 08 May, 15:44
Dhaval Modi     Re: Advice on multiple streaming job Sun, 06 May, 17:57
Message list1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Sep 2019137
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137