spark-user mailing list archives: March 2019

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
563280...@qq.com spark sql occer error Fri, 22 Mar, 07:39
Jürgen Thomann Timeout between driver and application master (Thrift Server) Mon, 04 Mar, 12:49
李斌松 pysphark sql filters regular expression double backslashes, resulting in incorrect results Mon, 18 Mar, 07:51
Jesús Vásquez Re: How to add more imports at the start of REPL Tue, 05 Mar, 11:46
563280193 spark sql occer error Fri, 22 Mar, 07:45
1266 JavaRDD and WrappedArrays type iterate Sat, 23 Mar, 15:45
Dávid Szakállas Dataset schema incompatibility bug when reading column partitioned data Fri, 29 Mar, 13:15
mayangyang02 Spark SQL doesn't produce output while hive does Mon, 04 Mar, 06:18
Jörn Franke Re: Masking username in Spark with regexp_replace and reverse functions Sun, 17 Mar, 09:50
Jörn Franke Re: Spark does not load all classes in fat jar Mon, 18 Mar, 13:08
Jörn Franke Re: Spark does not load all classes in fat jar Mon, 18 Mar, 13:09
Jörn Franke Re: Spark SQL API taking longer time than DF API. Sun, 31 Mar, 12:29
Achilleus 003 Re: [spark sql performance] Only 1 executor to write output? Mon, 25 Mar, 16:50
Achilleus 003 Udfs in spark Thu, 28 Mar, 04:45
Akhil Das Re: Where does the Driver run? Sun, 24 Mar, 04:26
Akhil Das Re: Where does the Driver run? Mon, 25 Mar, 02:44
Akhil Das Re: [spark sql performance] Only 1 executor to write output? Mon, 25 Mar, 03:19
Akhil Das Re: [spark sql performance] Only 1 executor to write output? Mon, 25 Mar, 12:22
Akhilanand Join selection Tue, 05 Mar, 07:20
Akshay Bhardwaj Re: Is there a way to validate the syntax of raw spark sql query? Tue, 05 Mar, 12:14
Akshay Bhardwaj Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 07:56
Akshay Bhardwaj Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 08:01
Akshay Bhardwaj Re: Structured Streaming to Kafka Topic Thu, 07 Mar, 07:21
Akshay Bhardwaj Re: spark structured streaming crash due to decompressing gzip file failure Thu, 07 Mar, 13:05
Akshay Mendole Re: mapreduce.input.fileinputformat.split.maxsize not working for spark 2.4.0 Thu, 07 Mar, 14:47
Alessandro Solimando Re: Structured Streaming & Query Planning Thu, 14 Mar, 17:59
Anbazhagan Muthuramalingam subscribe Thu, 14 Mar, 02:52
Anbazhagan Muthuramalingam subscribe Thu, 14 Mar, 02:56
Anbazhagan Muthuramalingam [No Subject] Thu, 14 Mar, 02:59
Anbazhagan Muthuramalingam SUBSCRIBE Thu, 14 Mar, 03:28
Andrew Melo Re: Where does the Driver run? Sun, 24 Mar, 19:46
Andrew Melo Re: Where does the Driver run? Mon, 25 Mar, 18:39
Andrey Dudin spark.python.worker.memory VS spark.executor.pyspark.memory Fri, 01 Mar, 13:24
Andrey Dudin disable spark disk cache Sun, 03 Mar, 21:46
Andriy Redko [HELP WANTED] Apache Zipkin (incubating) needs Spark gurus Thu, 21 Mar, 00:16
Ankur Gupta Apache Spark Newsletter Issue 2 Sat, 23 Mar, 22:12
Apostolos N. Papadopoulos Re: Java Heap Space error - Spark ML Fri, 22 Mar, 20:30
Apostolos N. Papadopoulos Re: writing a small csv to HDFS is super slow Fri, 22 Mar, 21:54
Arko Provo Mukherjee Re: Where does the Driver run? Mon, 25 Mar, 02:31
Arun Mahadevan Re: use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 19:51
Arun Mahadevan Re: Structured Streaming & Query Planning Mon, 18 Mar, 18:05
Arun Mahadevan Re: Understanding State Store storage behavior for the Stream Deduplication function Mon, 25 Mar, 22:13
Battini Lakshman Difference between 'cores' config params: spark submit on k8s Thu, 07 Mar, 21:53
Bobby Evans Re: what is the difference between udf execution and map(someLambda)? Mon, 18 Mar, 13:01
Bruno Faria Shuffle service with more than one executor Mon, 04 Mar, 02:51
Byron Lee unsubscribe Mon, 11 Mar, 17:40
Byron Lee unsubscribe Fri, 29 Mar, 04:01
Chandu Kavar [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 15:46
Chandu Kavar Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 15:51
Chandu Kavar Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 16:05
Chenghao [spark context / spark sql] unexpected disk IO activity after spark job finished but spark context has not Sat, 23 Mar, 06:51
Chenghao [spark context / spark sql] unexpected disk IO activity after spark job finished but spark context has not Sat, 23 Mar, 07:01
Chenghao spark core / spark sql -- unexpected disk IO activity after all the spark tasks finished but spark context has not stopped. Sat, 23 Mar, 07:21
Chunpeng Wang Re: Spark SQL doesn't produce output while hive does Mon, 04 Mar, 14:34
Daniel Sierra [No Subject] Fri, 29 Mar, 06:30
Daniel Zhang java.lang.NoSuchFieldError: HIVE_STATS_JDBC_TIMEOUT on EMR Mon, 18 Mar, 15:46
Federico D'Ambrosio Spark does not load all classes in fat jar Mon, 18 Mar, 11:34
Federico D'Ambrosio Re: Spark does not load all classes in fat jar Mon, 18 Mar, 14:11
Felix Cheung Re: Spark - Hadoop custom filesystem service loading Sun, 24 Mar, 03:28
Felix Cheung Re: spark.submit.deployMode: cluster Thu, 28 Mar, 16:42
Gabor Somogyi Re: to_avro and from_avro not working with struct type in spark 2.4 Fri, 01 Mar, 14:54
Gabor Somogyi Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 15:58
Gabor Somogyi Re: Writing the contents of spark dataframe to Kafka with Spark 2.2 Tue, 19 Mar, 07:48
Gabor Somogyi Re: Writing the contents of spark dataframe to Kafka with Spark 2.2 Tue, 19 Mar, 15:50
Gabor Somogyi Re: Writing the contents of spark dataframe to Kafka with Spark 2.2 Wed, 20 Mar, 09:07
Gabor Somogyi Re: Parquet File Output Sink - Spark Structured Streaming Wed, 27 Mar, 16:20
Gabor Somogyi Re: Streaming data out of spark to a Kafka topic Wed, 27 Mar, 21:22
Georg Heiler Re: use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 20:58
Gerard Maas Understanding State Store storage behavior for the Stream Deduplication function Mon, 25 Mar, 19:17
Gerard Maas Re: Understanding State Store storage behavior for the Stream Deduplication function Tue, 26 Mar, 00:00
Gezim Sejdiu Re: writing a small csv to HDFS is super slow Tue, 26 Mar, 20:50
Gezim Sejdiu Re: writing a small csv to HDFS is super slow Wed, 27 Mar, 07:44
Gourav Sengupta Re: [Spark SQL]: sql.DataFrame.replace to accept regexp Fri, 01 Mar, 20:38
Gourav Sengupta SPARK Streaming Graphs Fri, 01 Mar, 20:47
Gourav Sengupta Re: Spark 2.2 Structured Streaming + Kinesis Tue, 19 Mar, 23:30
Gourav Sengupta Re: [spark sql performance] Only 1 executor to write output? Sun, 24 Mar, 19:07
Gourav Sengupta Re: [spark sql performance] Only 1 executor to write output? Mon, 25 Mar, 10:06
Hariharan Re: Spark Profiler Fri, 29 Mar, 08:10
Hien Luu Re: disable spark disk cache Mon, 04 Mar, 00:25
Huon.Wil...@data61.csiro.au [SQL] 64-bit hash function, and seeding Tue, 05 Mar, 04:30
Huon.Wil...@data61.csiro.au Re: [SQL] 64-bit hash function, and seeding Tue, 05 Mar, 23:33
Ido Friedman Multiple context in one Driver Thu, 14 Mar, 06:37
Ido Friedman Re: Multiple context in one Driver Sun, 17 Mar, 11:35
Imran Rashid Re: [SHUFFLE]FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle Tue, 12 Mar, 15:22
JB Data31 Re: Masking username in Spark with regexp_replace and reverse functions Sun, 17 Mar, 09:32
JF Chen spark df.write.partitionBy run very slow Mon, 04 Mar, 10:02
JF Chen Re: spark df.write.partitionBy run very slow Wed, 06 Mar, 03:03
JF Chen "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 03:08
JF Chen Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 08:45
JF Chen Re: spark df.write.partitionBy run very slow Thu, 07 Mar, 08:21
JF Chen Re: spark df.write.partitionBy run very slow Fri, 08 Mar, 08:46
JF Chen Re: spark df.write.partitionBy run very slow Tue, 12 Mar, 03:38
JF Chen Re: spark df.write.partitionBy run very slow Fri, 15 Mar, 02:26
Jack Kolokasis Spark Profiler Tue, 26 Mar, 12:59
Jack Kolokasis Re: Spark Profiler Wed, 27 Mar, 20:48
Jain, Abhishek 3. (Nokia - IN/Bangalore) Spark Metrics : Job Remains In "Running" State Mon, 18 Mar, 13:15
Jan Brabec (janbrabe) Mutating broadcast variable from executors, any risks even if done in a thread-safe manner? Tue, 12 Mar, 09:39
Jason Dai Upcoming talks on BigDL and Analytics Zoo this week Mon, 25 Mar, 04:03
Jason Nerothin streaming - absolute maximum Tue, 26 Mar, 00:04
Jason Nerothin Re: How to extract data in parallel from RDBMS tables Thu, 28 Mar, 21:50
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
May 2019283
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137