spark-user mailing list archives: May 2018

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Huiliang Zhang NullPointerException when scanning HBase table Tue, 01 May, 02:05
Marcelo Vanzin Re: Spark launcher listener not getting invoked k8s Spark 2.3 Tue, 01 May, 03:17
lsn24 Filter one dataset based on values from another Tue, 01 May, 04:02
880f0464 UnresolvedException: Invalid call to dataType on unresolved object Tue, 01 May, 11:14
880f0464 spark.python.worker.reuse not working as expected Tue, 01 May, 11:17
880f0464 PySpark.sql.filter not performing as it should Tue, 01 May, 11:19
Pralabh Kumar org.apache.spark.shuffle.FetchFailedException: Too large frame: Tue, 01 May, 11:21
Valery Khamenya all calculations finished, but "VCores Used" value remains at its max Tue, 01 May, 11:30
Lalwani, Jayesh Re: Filter one dataset based on values from another Tue, 01 May, 12:08
Lalwani, Jayesh Re: Dataframe vs dataset Tue, 01 May, 12:27
Rich Bowen ApacheCon North America 2018 schedule is now live. Tue, 01 May, 12:36
Valery Khamenya smarter way to "forget" DataFrame definition and stick to its values Tue, 01 May, 13:16
Michael Artz Re: Dataframe vs dataset Tue, 01 May, 15:14
marcos rebelo Fast Unit Tests Tue, 01 May, 15:25
Geoff Von Allmen Re: Fast Unit Tests Tue, 01 May, 15:44
klrmowse Re: [EXT] [Spark 2.x Core] .collect() size limit Tue, 01 May, 15:49
Felix Cheung Re: all calculations finished, but "VCores Used" value remains at its max Tue, 01 May, 15:53
Yeikel Santana RE: Fast Unit Tests Tue, 01 May, 15:56
lsn24 Re: Filter one dataset based on values from another Tue, 01 May, 16:00
Ryan Blue Re: org.apache.spark.shuffle.FetchFailedException: Too large frame: Tue, 01 May, 16:07
nicholasl keep getting empty table while using saveAsTable() to save DataFrame as table Tue, 01 May, 18:51
Patrick McCarthy Poor performance reading Hive table made of sequence files Tue, 01 May, 20:36
Khaled Zaouk [Spark Streaming]: Does DStream workload run over Spark SQL engine? Wed, 02 May, 08:51
Saisai Shao Re: [Spark Streaming]: Does DStream workload run over Spark SQL engine? Wed, 02 May, 09:06
Paul Borgmans [Spark scheduling] Spark schedules single task although rdd has 48 partitions? Wed, 02 May, 09:31
Agostino Calamita spark.executor.extraJavaOptions inside application code Wed, 02 May, 10:59
kant kodali what is the query language used for graphX? Wed, 02 May, 11:00
Daniele Foroni Dataset Caching and Unpersisting Wed, 02 May, 11:19
Lalwani, Jayesh Re: smarter way to "forget" DataFrame definition and stick to its values Wed, 02 May, 12:28
Vadim Semenov Re: spark.executor.extraJavaOptions inside application code Wed, 02 May, 13:38
Irving Duran Re: ML Linear and Logistic Regression - Poor Performance Wed, 02 May, 14:15
Mihai Iacob how to trace sparkDriver context creation for pyspark Wed, 02 May, 14:39
Filippo Balicchia [No Subject] Wed, 02 May, 15:03
Paul Tremblay Re: Problem in persisting file in S3 using Spark: xxx file does not exist Exception Wed, 02 May, 15:56
Christopher Piggott Running apps over a VPN Wed, 02 May, 15:57
Marco Mistroni Re: Problem in persisting file in S3 using Spark: xxx file does not exist Exception Wed, 02 May, 19:35
ccherng Re: Uncaught exception in thread heartbeat-receiver-event-loop-thread Wed, 02 May, 20:34
ccherng ConcurrentModificationException Wed, 02 May, 20:47
ccherng Re: Uncaught exception in thread heartbeat-receiver-event-loop-thread Wed, 02 May, 20:48
Sergey Zhemzhitsky AccumulatorV2 vs AccumulableParam (V1) Wed, 02 May, 22:20
Mina Aslani MappingException - org.apache.spark.mllib.classification.LogisticRegressionModel.load Thu, 03 May, 03:05
Pralabh Kumar Re: org.apache.spark.shuffle.FetchFailedException: Too large frame: Thu, 03 May, 03:57
kant kodali question on collect_list or say aggregations in general in structured streaming 2.3.0 Thu, 03 May, 08:24
kant kodali Re: question on collect_list or say aggregations in general in structured streaming 2.3.0 Thu, 03 May, 08:52
Fawze Abujaber native-lzo library not available Thu, 03 May, 12:06
Wenchen Fan Re: AccumulatorV2 vs AccumulableParam (V1) Thu, 03 May, 14:20
erp12 Pickling Keras models for use in UDFs Thu, 03 May, 15:26
Thodoris Zois Re: Read or save specific blocks of a file Thu, 03 May, 15:46
Arun Mahadevan Re: question on collect_list or say aggregations in general in structured streaming 2.3.0 Thu, 03 May, 16:55
Jiří Syrový [Structured streaming, V2] commit on ContinuousReader Thu, 03 May, 17:43
Ryan Blue Re: org.apache.spark.shuffle.FetchFailedException: Too large frame: Thu, 03 May, 17:54
yuliya Feldman Re: native-lzo library not available Thu, 03 May, 18:17
ayan guha Re: Read or save specific blocks of a file Thu, 03 May, 18:41
Fawze Abujaber Re: native-lzo library not available Fri, 04 May, 05:39
ayan guha Re: native-lzo library not available Fri, 04 May, 05:48
kant kodali Re: question on collect_list or say aggregations in general in structured streaming 2.3.0 Fri, 04 May, 08:39
neeravsalaria SparkContext taking time after adding jars and asking yarn for resources Fri, 04 May, 09:01
kant kodali I cannot use spark 2.3.0 and kafka 0.9? Fri, 04 May, 09:02
Khaled Zaouk Re: Pickling Keras models for use in UDFs Fri, 04 May, 09:28
Shuporno Choudhury [pyspark] Read multiple files parallely into a single dataframe Fri, 04 May, 09:38
Sergey Zhemzhitsky Re: AccumulatorV2 vs AccumulableParam (V1) Fri, 04 May, 12:33
Christopher Piggott Free Column Reference with $ Fri, 04 May, 14:10
Vadim Semenov Re: Free Column Reference with $ Fri, 04 May, 16:14
Irving Duran Re: [pyspark] Read multiple files parallely into a single dataframe Fri, 04 May, 17:09
Tomas Zubiri RV: Unintelligible warning arose out of the blue. Fri, 04 May, 20:15
Marco Mistroni Re: RV: Unintelligible warning arose out of the blue. Fri, 04 May, 20:54
Dhaval Modi Advice on multiple streaming job Sat, 05 May, 15:09
amit kumar singh help needed in perforance improvement of spark structured streaming Sat, 05 May, 16:20
SparkUser6 Spark with HBase on Spark Runtime 2.2.1 Sat, 05 May, 23:12
SparkUser6 Unable to Connect to Apache Phoenix From Spark Sun, 06 May, 01:40
vincent gromakowski Re: Advice on multiple streaming job Sun, 06 May, 07:32
付涛 stage blocked sometimes Sun, 06 May, 14:22
Susan X. Huynh Re: Advice on multiple streaming job Sun, 06 May, 14:57
Dhaval Modi Re: Advice on multiple streaming job Sun, 06 May, 17:57
Dhaval Modi Re: Advice on multiple streaming job Sun, 06 May, 17:59
karthikjay [beginner][StructuredStreaming] Null pointer exception - possible serialization errors. Mon, 07 May, 00:17
Gerard Maas Re: Advice on multiple streaming job Mon, 07 May, 08:23
王 纯超 Watch Zookeeper in Spark Closure Mon, 07 May, 08:38
Dhaval Modi Re: Advice on multiple streaming job Mon, 07 May, 09:08
Marcelo Vanzin Re: Spark UI Source Code Mon, 07 May, 16:20
Stephen Boesch Guava dependency issue Mon, 07 May, 17:30
erp12 Re: Pickling Keras models for use in UDFs Mon, 07 May, 18:32
Victor Tso-Guillen Spark 2.3.0 DataFrame.write.parquet() behavior change from 2.2.0 Mon, 07 May, 19:18
Victor Tso-Guillen Re: Spark 2.3.0 DataFrame.write.parquet() behavior change from 2.2.0 Mon, 07 May, 19:35
ravidspark Best place to persist offsets into Zookeeper Mon, 07 May, 23:53
Yuanjian Li Re: Spark 2.3.0 DataFrame.write.parquet() behavior change from 2.2.0 Tue, 08 May, 02:59
SparkUser6 Error submitting Spark Job in yarn-cluster mode on EMR Tue, 08 May, 09:14
Debabrata Ghosh Help Required - Unable to run spark-submit on YARN client mode Tue, 08 May, 11:35
Deepak Sharma Re: Help Required - Unable to run spark-submit on YARN client mode Tue, 08 May, 11:46
Stephen Boesch Re: Guava dependency issue Tue, 08 May, 15:44
Peter Liu Re: Advice on multiple streaming job Tue, 08 May, 15:44
Marcelo Vanzin Re: Guava dependency issue Tue, 08 May, 16:31
Koert Kuipers Re: Guava dependency issue Tue, 08 May, 16:41
Marco Mistroni Re: Error submitting Spark Job in yarn-cluster mode on EMR Tue, 08 May, 20:14
Shixiong(Ryan) Zhu Re: I cannot use spark 2.3.0 and kafka 0.9? Wed, 09 May, 00:20
Yuta Morisawa Spark 2.3.0 Structured Streaming Kafka Timestamp Wed, 09 May, 07:14
Marius Spark 2.3.0 --files vs. addFile() Wed, 09 May, 07:51
Alchemist Malformed URL Exception when connecting to Phoenix to Spark Wed, 09 May, 12:38
Serkan TAS Invalid Spark URL: spark://HeartbeatReceiver@hostname Wed, 09 May, 14:06
David Ignjić Fwd: Array[Double] two time slower then DenseVector Wed, 09 May, 14:23
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
May 2019279
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137