spark-user mailing list archives: March 2019

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
yuvraj singh error in sprark sql Fri, 01 Mar, 07:36
Shyam P   Re: error in sprark sql Tue, 05 Mar, 07:07
Nuno Silva [Spark SQL]: sql.DataFrame.replace to accept regexp Fri, 01 Mar, 10:21
Richard Garris   Re: [Spark SQL]: sql.DataFrame.replace to accept regexp Fri, 01 Mar, 14:39
Gourav Sengupta     Re: [Spark SQL]: sql.DataFrame.replace to accept regexp Fri, 01 Mar, 20:38
Andrey Dudin spark.python.worker.memory VS spark.executor.pyspark.memory Fri, 01 Mar, 13:24
Xiao Li   Re: spark.python.worker.memory VS spark.executor.pyspark.memory Fri, 01 Mar, 21:19
oskarryn Spark Streaming loading kafka source value column type Fri, 01 Mar, 13:38
Re: to_avro and from_avro not working with struct type in spark 2.4
Gabor Somogyi   Re: to_avro and from_avro not working with struct type in spark 2.4 Fri, 01 Mar, 14:54
Kristopher Kane Spark 2.4 Structured Streaming Kafka assign API polling same offsets Fri, 01 Mar, 15:10
Kristopher Kane   Re: Spark 2.4 Structured Streaming Kafka assign API polling same offsets Fri, 01 Mar, 16:35
kant kodali Is there a way to validate the syntax of raw spark sql query? Fri, 01 Mar, 16:44
Akshay Bhardwaj   Re: Is there a way to validate the syntax of raw spark sql query? Tue, 05 Mar, 12:14
kant kodali     Re: Is there a way to validate the syntax of raw spark sql query? Tue, 05 Mar, 17:08
Re: Spark on k8s - map persistentStorage for data spilling
Tomasz Krol   Re: Spark on k8s - map persistentStorage for data spilling Fri, 01 Mar, 19:56
Matt Cheah     Re: Spark on k8s - map persistentStorage for data spilling Fri, 01 Mar, 19:30
Tomasz Krol       Re: Spark on k8s - map persistentStorage for data spilling Fri, 01 Mar, 20:44
Gourav Sengupta SPARK Streaming Graphs Fri, 01 Mar, 20:47
swastik mittal updateBytesRead() Sat, 02 Mar, 04:30
swastik mittal Milliseconds in timestamp Sat, 02 Mar, 18:53
Andrey Dudin disable spark disk cache Sun, 03 Mar, 21:46
Hien Luu   Re: disable spark disk cache Mon, 04 Mar, 00:25
Bruno Faria Shuffle service with more than one executor Mon, 04 Mar, 02:51
Spark SQL doesn't produce output while hive does
mayangyang02   Spark SQL doesn't produce output while hive does Mon, 04 Mar, 06:18
Chunpeng Wang   Re: Spark SQL doesn't produce output while hive does Mon, 04 Mar, 14:34
Patrik Medvedev   Re: Spark SQL doesn't produce output while hive does Mon, 04 Mar, 14:49
JF Chen spark df.write.partitionBy run very slow Mon, 04 Mar, 10:02
Shyam P   Re: spark df.write.partitionBy run very slow Tue, 05 Mar, 07:05
JF Chen     Re: spark df.write.partitionBy run very slow Wed, 06 Mar, 03:03
Shyam P       Re: spark df.write.partitionBy run very slow Wed, 06 Mar, 06:39
JF Chen         Re: spark df.write.partitionBy run very slow Thu, 07 Mar, 08:21
JF Chen           Re: spark df.write.partitionBy run very slow Fri, 08 Mar, 08:46
Shyam P             Re: spark df.write.partitionBy run very slow Fri, 08 Mar, 12:54
JF Chen               Re: spark df.write.partitionBy run very slow Tue, 12 Mar, 03:38
Shyam P                 Re: spark df.write.partitionBy run very slow Thu, 14 Mar, 06:26
JF Chen                   Re: spark df.write.partitionBy run very slow Fri, 15 Mar, 02:26
Jürgen Thomann Timeout between driver and application master (Thrift Server) Mon, 04 Mar, 12:49
Nicolas Paris Connect to hive 3 from spark Mon, 04 Mar, 13:58
Yeikel Difference between One map vs multiple maps Tue, 05 Mar, 03:13
Huon.Wil...@data61.csiro.au [SQL] 64-bit hash function, and seeding Tue, 05 Mar, 04:30
Nicolas Paris   Re: [SQL] 64-bit hash function, and seeding Tue, 05 Mar, 20:47
Huon.Wil...@data61.csiro.au     Re: [SQL] 64-bit hash function, and seeding Tue, 05 Mar, 23:33
subscribe
Qian He   subscribe Tue, 05 Mar, 05:48
Anbazhagan Muthuramalingam   subscribe Thu, 14 Mar, 02:52
Anbazhagan Muthuramalingam   subscribe Thu, 14 Mar, 02:56
Akhilanand Join selection Tue, 05 Mar, 07:20
[No Subject]
Shyam P   [No Subject] Tue, 05 Mar, 07:54
Shyam P     Re: How to group dataframe year-wise and iterate through groups and send each year to dataframe to executor? Wed, 06 Mar, 06:31
Anbazhagan Muthuramalingam   [No Subject] Thu, 14 Mar, 02:59
Daniel Sierra   [No Subject] Fri, 29 Mar, 06:30
Nuthan Reddy How to add more imports at the start of REPL Tue, 05 Mar, 11:14
Jesús Vásquez   Re: How to add more imports at the start of REPL Tue, 05 Mar, 11:46
Nuthan Reddy     Re: How to add more imports at the start of REPL Tue, 05 Mar, 11:54
Mkal C++ script on Spark Cluster throws exit status 132 Tue, 05 Mar, 11:25
lokeshkumar Why does Apache Spark Master shutdown when Zookeeper expires the session Tue, 05 Mar, 13:02
Jungtaek Lim   Re: Why does Apache Spark Master shutdown when Zookeeper expires the session Wed, 06 Mar, 09:37
Thomas Ryck [PySpark] TypeError: expected string or bytes-like object Tue, 05 Mar, 15:08
Chandu Kavar [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 15:46
Chandu Kavar   Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 15:51
Gabor Somogyi     Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 15:58
Chandu Kavar       Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 16:05
JF Chen "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 03:08
Shyam P   Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 06:40
Akshay Bhardwaj   Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 07:56
Akshay Bhardwaj     Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 08:01
JF Chen       Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 08:45
Rich Bowen 4 Apache Events in 2019: DC Roadshow soon; next up Chicago, Las Vegas, and Berlin! Wed, 06 Mar, 14:00
Pankaj Wahane Structured Streaming to Kafka Topic Wed, 06 Mar, 16:58
Akshay Bhardwaj   Re: Structured Streaming to Kafka Topic Thu, 07 Mar, 07:21
William Creger PysPark date_add function suggestion Wed, 06 Mar, 18:51
Lian Jiang spark structured streaming crash due to decompressing gzip file failure Thu, 07 Mar, 05:58
Akshay Bhardwaj   Re: spark structured streaming crash due to decompressing gzip file failure Thu, 07 Mar, 13:05
Lian Jiang     Re: spark structured streaming crash due to decompressing gzip file failure Thu, 07 Mar, 14:53
Sommer Tobias Hadoop free spark on kubernetes => NoClassDefFound Thu, 07 Mar, 09:09
Sommer Tobias [SparkSQL, user-defined Hadoop, K8s] Hadoop free spark on kubernetes => NoClassDefFound Thu, 07 Mar, 09:23
Re: mapreduce.input.fileinputformat.split.maxsize not working for spark 2.4.0
Akshay Mendole   Re: mapreduce.input.fileinputformat.split.maxsize not working for spark 2.4.0 Thu, 07 Mar, 14:47
Battini Lakshman Difference between 'cores' config params: spark submit on k8s Thu, 07 Mar, 21:53
linr...@itri.org.tw A spark streaming problem about shuffle operation Fri, 08 Mar, 08:55
zjzzjz Optimize tables used more than once: make dataframe persistent or save as parquet Sun, 10 Mar, 01:10
zjzzjz How to know if a machine in a Spark cluster 'participate's a job Sun, 10 Mar, 01:14
Lian Jiang use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 18:54
Arun Mahadevan   Re: use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 19:51
Georg Heiler     Re: use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 20:58
Jungtaek Lim       Re: use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 21:39
Lian Jiang         Re: use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 21:46
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Sep 2019116
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137