spark-dev mailing list archives: August 2018

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
0xF0F...@protonmail.com.INVALID Re: [Performance] Spark DataFrame is slow with wide data. Polynomial complexity on the number of columns is observed. Why? Tue, 07 Aug, 09:29
0xF0F...@protonmail.com.INVALID Re: Naming policy for packages Wed, 15 Aug, 17:38
880f0464 Re: Naming policy for packages Wed, 15 Aug, 19:08
周浥尘 Why repartitionAndSortWithinPartitions slower than MapReducer Mon, 20 Aug, 12:52
周浥尘 Re: Why repartitionAndSortWithinPartitions slower than MapReducer Mon, 20 Aug, 15:21
崔苗 multiple group by action Sat, 25 Aug, 02:54
Happy每一天 Unsubscribe Tue, 21 Aug, 03:38
Tomasz Gawęda Re: Joining DataFrames derived from the same source yields confusing/incorrect results Wed, 29 Aug, 20:20
Jörn Franke Re: Spark Streaming : Multiple sources found for csv : Error Fri, 31 Aug, 04:45
Al Pivonka unsubscribe Wed, 08 Aug, 18:57
Alessandro Liparoti Spark sql syntax checker Fri, 03 Aug, 10:39
Andrew Melo SparkContext singleton get w/o create? Tue, 07 Aug, 22:11
Andrew Melo Re: SparkContext singleton get w/o create? Tue, 07 Aug, 22:34
Andrew Melo Re: SparkContext singleton get w/o create? Tue, 07 Aug, 22:52
Andrew Melo Re: SparkContext singleton get w/o create? Mon, 27 Aug, 19:09
Andrew Melo Re: SparkContext singleton get w/o create? Mon, 27 Aug, 19:17
Andrew Melo Re: SparkContext singleton get w/o create? Mon, 27 Aug, 19:48
Ankur Gupta Persisting driver logs in yarn client mode (SPARK-25118) Tue, 21 Aug, 21:19
Ankur Gupta Re: Persisting driver logs in yarn client mode (SPARK-25118) Wed, 22 Aug, 17:01
Ankur Gupta Re: Persisting driver logs in yarn client mode (SPARK-25118) Mon, 27 Aug, 20:03
Anton Kulaga Re: code freeze and branch cut for Apache Spark 2.4 Thu, 30 Aug, 21:49
Arun Mahadevan Re: [Proposal] New feature: reconfigurable number of partitions on stateful operators in Structured Streaming Fri, 03 Aug, 08:39
Arun Mahadevan Re: [Proposal] New feature: reconfigurable number of partitions on stateful operators in Structured Streaming Fri, 03 Aug, 17:55
Basil Hariri Spark Kafka adapter questions Fri, 17 Aug, 22:48
Basil Hariri RE: Spark Kafka adapter questions Mon, 20 Aug, 22:53
Bryan Cutler Re: code freeze and branch cut for Apache Spark 2.4 Mon, 06 Aug, 19:36
Bryan Cutler Re: code freeze and branch cut for Apache Spark 2.4 Fri, 10 Aug, 17:41
Bryan Cutler Re: [discuss][minor] impending python 3.x jenkins upgrade... 3.5.x? 3.6.x? Mon, 20 Aug, 18:33
Chetan Khatri Reading 20 GB of log files from Directory - Out of Memory Error Sat, 25 Aug, 10:08
Chetan Khatri Re: Reading 20 GB of log files from Directory - Out of Memory Error Sat, 25 Aug, 10:11
Cody Koeninger Re: Migrating from kafka08 client to kafka010 Fri, 03 Aug, 04:52
Cody Koeninger Re: [discuss] replacing SPIP template with Heilmeier's Catechism? Fri, 31 Aug, 20:09
Cody Koeninger Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it) Fri, 31 Aug, 20:14
Darcy Shen Upgrade SBT to the latest Fri, 31 Aug, 13:16
Divay Jindal Handle BlockMissingException in pyspark Mon, 06 Aug, 09:20
Divay Jindal Re: Handle BlockMissingException in pyspark Tue, 07 Aug, 15:46
Driesprong, Fokko Re: Spark data quality bug when reading parquet files from hive metastore Fri, 24 Aug, 09:39
Erik Erlandson Re: code freeze and branch cut for Apache Spark 2.4 Wed, 01 Aug, 23:34
Erik Erlandson Re: code freeze and branch cut for Apache Spark 2.4 Wed, 01 Aug, 23:39
Erik Erlandson [DISCUSS] SparkR support on k8s back-end for Spark 2.4 Wed, 15 Aug, 19:33
Erik Erlandson Re: [DISCUSS] SparkR support on k8s back-end for Spark 2.4 Thu, 16 Aug, 16:49
Erik Erlandson Re: [MLlib][Test] Smoke and Metamorphic Testing of MLlib Thu, 23 Aug, 17:47
Felix Cheung Re: [R] discuss: removing lint-r checks for old branches Sat, 11 Aug, 17:08
Felix Cheung Re: [DISCUSS] SparkR support on k8s back-end for Spark 2.4 Fri, 17 Aug, 05:20
Felix Cheung Re: SPIP: Executor Plugin (SPARK-24918) Fri, 31 Aug, 06:00
Felix Cheung Re: [DISCUSS] move away from python doctests Fri, 31 Aug, 06:05
Great Info Handling Very Large volume(500TB) data using spark Sat, 25 Aug, 02:54
Hemant Bhanawat mllib + SQL Thu, 30 Aug, 06:45
Hemant Bhanawat Re: mllib + SQL Fri, 31 Aug, 10:05
Hemant Bhanawat Re: mllib + SQL Fri, 31 Aug, 10:10
Henry Robinson Re: Persisting driver logs in yarn client mode (SPARK-25118) Mon, 27 Aug, 20:07
Holden Karau Re: code freeze and branch cut for Apache Spark 2.4 Tue, 07 Aug, 20:21
Holden Karau Re: SparkContext singleton get w/o create? Mon, 27 Aug, 19:14
Holden Karau Re: SparkContext singleton get w/o create? Mon, 27 Aug, 19:20
Hyukjin Kwon Re: Review notification bot Wed, 01 Aug, 01:21
Hyukjin Kwon Re: [build system] bumped pull request builder job timeout to 400mins Tue, 07 Aug, 23:46
Hyukjin Kwon Re: [discuss][minor] impending python 3.x jenkins upgrade... 3.5.x? 3.6.x? Mon, 20 Aug, 04:49
Hyukjin Kwon Re: [R] discuss: removing lint-r checks for old branches Mon, 20 Aug, 04:51
Hyukjin Kwon Re: best way to run one python test? Mon, 20 Aug, 04:54
Hyukjin Kwon [DISCUSS] USING syntax for Datasource V2 Mon, 20 Aug, 07:19
Hyukjin Kwon Re: best way to run one python test? Mon, 20 Aug, 17:08
Hyukjin Kwon Porting or explicitly linking project style in Apache Spark based on https://github.com/databricks/scala-style-guide Fri, 24 Aug, 01:14
Hyukjin Kwon Re: Porting or explicitly linking project style in Apache Spark based on https://github.com/databricks/scala-style-guide Fri, 24 Aug, 01:38
Hyukjin Kwon Re: Porting or explicitly linking project style in Apache Spark based on https://github.com/databricks/scala-style-guide Fri, 24 Aug, 01:50
Hyukjin Kwon Re: Spark Streaming : Multiple sources found for csv : Error Fri, 31 Aug, 04:01
Hyukjin Kwon Re: [DISCUSS] move away from python doctests Fri, 31 Aug, 07:02
Ilan Filonenko Re: [DISCUSS] SparkR support on k8s back-end for Spark 2.4 Wed, 15 Aug, 19:45
Ilan Filonenko Re: [DISCUSS] SparkR support on k8s back-end for Spark 2.4 Wed, 15 Aug, 19:56
Ilan Filonenko Re: [DISCUSS] SparkR support on k8s back-end for Spark 2.4 Thu, 16 Aug, 17:27
Ilan Filonenko Re: no logging in pyspark code? Mon, 27 Aug, 17:41
Imran Rashid Re: code freeze and branch cut for Apache Spark 2.4 Wed, 01 Aug, 04:21
Imran Rashid Re: code freeze and branch cut for Apache Spark 2.4 Wed, 01 Aug, 20:43
Imran Rashid SPIP: Executor Plugin (SPARK-24918) Fri, 03 Aug, 16:59
Imran Rashid Re: code freeze and branch cut for Apache Spark 2.4 Wed, 08 Aug, 14:06
Imran Rashid Re: [DISCUSS] Handling correctness/data loss jiras Mon, 13 Aug, 16:13
Imran Rashid Re: [DISCUSS] Handling correctness/data loss jiras Tue, 14 Aug, 20:31
Imran Rashid best way to run one python test? Mon, 20 Aug, 03:07
Imran Rashid Re: best way to run one python test? Mon, 20 Aug, 15:24
Imran Rashid python tests: any reason for a huge tests.py? Fri, 24 Aug, 16:53
Imran Rashid no logging in pyspark code? Mon, 27 Aug, 17:29
Imran Rashid Re: no logging in pyspark code? Mon, 27 Aug, 18:05
Imran Rashid [VOTE] SPIP: Executor Plugin (SPARK-24918) Tue, 28 Aug, 13:50
Imran Rashid [DISCUSS] move away from python doctests Wed, 29 Aug, 18:35
Imran Rashid Re: [DISCUSS] move away from python doctests Wed, 29 Aug, 20:26
Imran Rashid Re: [DISCUSS] move away from python doctests Wed, 29 Aug, 20:41
Ivan Gozali Spark DataFrame UNPIVOT feature Tue, 21 Aug, 22:05
Jacek Laskowski Re: Am I crazy, or does the binary distro not have Kafka integration? Sat, 04 Aug, 21:17
Jacek Laskowski Re: Why is SQLImplicits an abstract class rather than a trait? Sun, 05 Aug, 22:37
Jacek Laskowski Same code in DataFrameWriter.runCommand and Dataset.withAction? Tue, 14 Aug, 15:05
Jacek Laskowski Why is View logical operator not a UnaryNode explicitly? Mon, 27 Aug, 10:10
Jack Kolokasis Off Heap Memory Fri, 24 Aug, 08:53
John Zhuge Re: [DISCUSS][SQL] Control the number of output files Mon, 06 Aug, 03:58
John Zhuge Re: [DISCUSS][SQL] Control the number of output files Mon, 06 Aug, 04:00
John Zhuge Re: Handle BlockMissingException in pyspark Mon, 06 Aug, 19:49
John Zhuge Re: code freeze and branch cut for Apache Spark 2.4 Tue, 07 Aug, 20:41
Joseph Torres Re: [Proposal] New feature: reconfigurable number of partitions on stateful operators in Structured Streaming Fri, 03 Aug, 13:23
Joseph Torres Re: [Proposal] New feature: reconfigurable number of partitions on stateful operators in Structured Streaming Fri, 03 Aug, 15:21
Joseph Torres Re: [Proposal] New feature: reconfigurable number of partitions on stateful operators in Structured Streaming Fri, 03 Aug, 18:10
Jules Damji Re: [discuss] replacing SPIP template with Heilmeier's Catechism? Fri, 31 Aug, 23:16
Jungtaek Lim [Proposal] New feature: reconfigurable number of partitions on stateful operators in Structured Streaming Fri, 03 Aug, 06:45
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
Aug 2019147
Jul 2019138
Jun 2019147
May 2019168
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333