spark-user mailing list archives: April 2018

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Yeikel Santana What is the purpose of CoarseGrainedScheduler and how can I disable it? Sun, 01 Apr, 06:45
Re: Re: the issue about the + in column,can we support the string please?
1427357...@qq.com   Re: Re: the issue about the + in column,can we support the string please? Sun, 01 Apr, 12:28
kant kodali Does Spark run on Java 10? Sun, 01 Apr, 13:57
Muthu Jayakumar   Re: Does Spark run on Java 10? Sun, 01 Apr, 14:50
kant kodali     Re: Does Spark run on Java 10? Sun, 01 Apr, 18:15
Muthu Jayakumar       Re: Does Spark run on Java 10? Mon, 02 Apr, 05:05
Re: [Query] Columnar transformation without Structured Streaming
Gourav Sengupta   Re: [Query] Columnar transformation without Structured Streaming Sun, 01 Apr, 18:20
Shahab Yunus Sparse Matrix to Matrix multiplication in Spark Sun, 01 Apr, 19:24
kant kodali is there a way of register python UDF using java API? Sun, 01 Apr, 22:46
kant kodali   Re: is there a way of register python UDF using java API? Mon, 02 Apr, 19:11
Bryan Cutler     Re: is there a way of register python UDF using java API? Mon, 02 Apr, 23:00
Louis Hust OOM when extract big data from MySQL Using JDBC Mon, 02 Apr, 04:17
Shuporno Choudhury   Re: OOM when extract big data from MySQL Using JDBC Mon, 02 Apr, 08:05
Aakash Basu [Structured Streaming Query] Calculate Running Avg from Kafka feed using SQL query Mon, 02 Apr, 07:31
Aakash Basu   Re: [Structured Streaming Query] Calculate Running Avg from Kafka feed using SQL query Mon, 02 Apr, 14:07
Aakash Basu   Re: [Structured Streaming Query] Calculate Running Avg from Kafka feed using SQL query Mon, 02 Apr, 14:29
Aakash Basu   Fwd: [Structured Streaming Query] Calculate Running Avg from Kafka feed using SQL query Fri, 06 Apr, 10:22
Felix Cheung     Re: [Structured Streaming Query] Calculate Running Avg from Kafka feed using SQL query Fri, 06 Apr, 16:25
Aakash Basu       Re: [Structured Streaming Query] Calculate Running Avg from Kafka feed using SQL query Mon, 09 Apr, 08:15
Deepak Sharma Merge query using spark sql Mon, 02 Apr, 10:23
unsubscribe
Romero, Saul   unsubscribe Mon, 02 Apr, 17:45
purna pradeep   unsubscribe Mon, 02 Apr, 17:46
学生张洪斌   unsubscribe Tue, 03 Apr, 02:17
15811225244   unsubscribe Wed, 04 Apr, 01:26
Nikhil Kalbande     unsubscribe Thu, 05 Apr, 08:07
varma dantuluri   unsubscribe Thu, 12 Apr, 11:59
韩盼   unsubscribe Tue, 17 Apr, 03:07
varma dantuluri   unsubscribe Fri, 20 Apr, 12:38
Shiyuan Uncaught exception in thread heartbeat-receiver-event-loop-thread Mon, 02 Apr, 23:31
Junfeng Chen How to delete empty columns in df when writing to parquet? Tue, 03 Apr, 03:28
Junfeng Chen   Re: How to delete empty columns in df when writing to parquet? Wed, 04 Apr, 03:04
Gourav Sengupta   Re: How to delete empty columns in df when writing to parquet? Wed, 04 Apr, 09:45
Junfeng Chen     Re: How to delete empty columns in df when writing to parquet? Wed, 04 Apr, 10:02
Junfeng Chen       Re: How to delete empty columns in df when writing to parquet? Sun, 08 Apr, 02:28
Gourav Sengupta         Re: How to delete empty columns in df when writing to parquet? Sun, 08 Apr, 03:42
snjv [Spark sql]: Re-execution of same operation takes less time than 1st Tue, 03 Apr, 05:42
naresh Goud   Re: [Spark sql]: Re-execution of same operation takes less time than 1st Tue, 03 Apr, 16:09
snjv [Spark-sql]: DF parquet read write multiple tasks Tue, 03 Apr, 05:44
Vitaliy Pisarev How does extending an existing parquet with columns affect impala/spark performance? Tue, 03 Apr, 14:14
naresh Goud   Re: How does extending an existing parquet with columns affect impala/spark performance? Tue, 03 Apr, 14:40
Re: How to pass sparkSession from driver to executor
Gourav Sengupta   Re: How to pass sparkSession from driver to executor Tue, 03 Apr, 17:04
Gourav Sengupta     Re: How to pass sparkSession from driver to executor Tue, 03 Apr, 17:12
Re: ORC native in Spark 2.3, with zlib, gives java.nio.BufferUnderflowException during read
Eirik Thorsnes   Re: ORC native in Spark 2.3, with zlib, gives java.nio.BufferUnderflowException during read Tue, 03 Apr, 17:47
Re: Issue with using Generalized Linear Regression for Logistic Regression modeling
FireFly   Re: Issue with using Generalized Linear Regression for Logistic Regression modeling Tue, 03 Apr, 19:56
Gourav Sengupta bucketing in SPARK Tue, 03 Apr, 21:32
Guillermo Ortiz Testing spark-testing-base. Error multiple SparkContext Tue, 03 Apr, 22:03
anbu Apache spark -2.1.0 question in Spark SQL Wed, 04 Apr, 03:51
anbu NumberFormatException while reading and split the file Wed, 04 Apr, 08:13
utkarsh_deep   Re: NumberFormatException while reading and split the file Wed, 04 Apr, 10:32
Donni Khan run huge number of queries in Spark Wed, 04 Apr, 08:56
Georg Heiler   Re: run huge number of queries in Spark Wed, 04 Apr, 09:14
Mahender Sarangam Building Datwarehouse Application in Spark Wed, 04 Apr, 09:29
Kittu M Scala program to spark-submit on k8 cluster Wed, 04 Apr, 11:45
Yinan Li   Re: Scala program to spark-submit on k8 cluster Wed, 04 Apr, 16:25
purna pradeep     Re: Scala program to spark-submit on k8 cluster Wed, 04 Apr, 16:47
Kittu M     Re: Scala program to spark-submit on k8 cluster Fri, 06 Apr, 12:04
Thodoris Zois       Re: Scala program to spark-submit on k8 cluster Fri, 06 Apr, 14:53
anbu ClassCastException: java.sql.Date cannot be cast to java.lang.String in Scala Wed, 04 Apr, 14:58
Ritesh Shah Issue with nested JSON parsing in to data frame Wed, 04 Apr, 17:00
Thodoris Zois 1 Executor per partition Wed, 04 Apr, 19:13
Gourav Sengupta   Re: 1 Executor per partition Wed, 04 Apr, 21:22
utkarsh_deep     Re: 1 Executor per partition Thu, 05 Apr, 05:43
Andy Davidson trouble with 'pip pyspark' pyspark.sql.functions. ³unresolved import² for col() and lit() Wed, 04 Apr, 22:28
Gourav Sengupta   Re: trouble with 'pip pyspark' pyspark.sql.functions. ³unresolved import² for col() and lit() Wed, 04 Apr, 22:37
Andy Davidson how to set up pyspark eclipse, pyDev, virtualenv? syntaxError: yield from walk( Thu, 05 Apr, 00:36
Andy Davidson   Re: how to set up pyspark eclipse, pyDev, virtualenv? syntaxError: yield from walk( Thu, 05 Apr, 23:48
Hyukjin Kwon     Re: how to set up pyspark eclipse, pyDev, virtualenv? syntaxError: yield from walk( Fri, 06 Apr, 01:09
Andy Davidson       Re: how to set up pyspark eclipse, pyDev, virtualenv? syntaxError: yield from walk( Fri, 06 Apr, 03:32
Xiangyu Li Spark uses more threads than specified in local[n] Thu, 05 Apr, 01:41
Pralabh Kumar Best way to Hive to Spark migration Thu, 05 Apr, 03:43
Jörn Franke   Re: Best way to Hive to Spark migration Thu, 05 Apr, 05:16
Aakash Basu [Structured Streaming] How to save entire column aggregation to a file Thu, 05 Apr, 08:58
Aakash Basu   Fwd: [Structured Streaming] How to save entire column aggregation to a file Fri, 06 Apr, 10:22
Aakash Basu Spark Structured Streaming Inner Queries fails Thu, 05 Apr, 09:20
Aakash Basu   Fwd: Spark Structured Streaming Inner Queries fails Fri, 06 Apr, 10:22
Aakash Basu [Structured Streaming] More than 1 streaming in a code Thu, 05 Apr, 09:48
Aakash Basu   Fwd: [Structured Streaming] More than 1 streaming in a code Fri, 06 Apr, 10:23
Panagiotis Garefalakis     Re: [Structured Streaming] More than 1 streaming in a code Fri, 06 Apr, 10:48
Aakash Basu       Re: [Structured Streaming] More than 1 streaming in a code Fri, 06 Apr, 11:40
spark receiver         Re: [Structured Streaming] More than 1 streaming in a code Sat, 14 Apr, 03:49
Lalwani, Jayesh           Re: [Structured Streaming] More than 1 streaming in a code Mon, 16 Apr, 02:41
Aakash Basu             Re: [Structured Streaming] More than 1 streaming in a code Mon, 16 Apr, 08:52
Lalwani, Jayesh               Re: [Structured Streaming] More than 1 streaming in a code Mon, 16 Apr, 14:22
Aakash Basu                 Re: [Structured Streaming] More than 1 streaming in a code Mon, 16 Apr, 14:55
Lalwani, Jayesh                   Re: [Structured Streaming] More than 1 streaming in a code Mon, 16 Apr, 15:23
Gerard Maas               Re: [Structured Streaming] More than 1 streaming in a code Mon, 16 Apr, 15:35
Aakash Basu                 Re: [Structured Streaming] More than 1 streaming in a code Mon, 16 Apr, 19:28
Mark Bonetti Which metrics would be best to alert on? Thu, 05 Apr, 14:07
Cesar Union of multiple data frames Thu, 05 Apr, 18:17
Brandon Geise   Re: Union of multiple data frames Thu, 05 Apr, 18:23
Andy Davidson     Re: Union of multiple data frames Thu, 05 Apr, 18:29
Cesar       Re: Union of multiple data frames Thu, 05 Apr, 21:22
Alessandro Solimando         Re: Union of multiple data frames Fri, 06 Apr, 07:31
klrmowse [Spark 2.x Core] Adding to ArrayList inside rdd.foreach() Sat, 07 Apr, 17:07
Jörn Franke   Re: [Spark 2.x Core] Adding to ArrayList inside rdd.foreach() Sat, 07 Apr, 17:12
klrmowse     Re: [Spark 2.x Core] Adding to ArrayList inside rdd.foreach() Sat, 07 Apr, 17:29
Gourav Sengupta       Re: [Spark 2.x Core] Adding to ArrayList inside rdd.foreach() Sun, 08 Apr, 03:54
Bryan Jeffrey     Re: [Spark 2.x Core] Adding to ArrayList inside rdd.foreach() Sat, 07 Apr, 17:31
Saad Mufti High Disk Usage In Spark 2.2.1 With No Shuffle Or Spill To Disk Sat, 07 Apr, 18:26
Jörn Franke   Re: High Disk Usage In Spark 2.2.1 With No Shuffle Or Spill To Disk Sat, 07 Apr, 18:37
Saad Mufti     Re: High Disk Usage In Spark 2.2.1 With No Shuffle Or Spill To Disk Sat, 07 Apr, 18:40
Saad Mufti       Re: High Disk Usage In Spark 2.2.1 With No Shuffle Or Spill To Disk Sat, 07 Apr, 21:09
Gourav Sengupta         Re: High Disk Usage In Spark 2.2.1 With No Shuffle Or Spill To Disk Sun, 08 Apr, 03:51
lk_spark spark2.3 on kubernets Sun, 08 Apr, 03:15
lk_spark   Re: spark2.3 on kubernets Sun, 08 Apr, 05:16
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
May 2019263
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137