spark-dev mailing list archives: September 2020

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
RE: [VOTE] Release Spark 2.4.7 (RC1)
Nicholas Marion   RE: [VOTE] Release Spark 2.4.7 (RC1) Tue, 01 Sep, 13:12
Prashant Sharma     Re: [VOTE] Release Spark 2.4.7 (RC1) Wed, 02 Sep, 06:18
Micah Kornfield       Re: [VOTE] Release Spark 2.4.7 (RC1) Wed, 02 Sep, 06:28
Sean Owen         Re: [VOTE] Release Spark 2.4.7 (RC1) Wed, 02 Sep, 13:18
Micah Kornfield           Re: [VOTE] Release Spark 2.4.7 (RC1) Fri, 04 Sep, 05:31
Re: [VOTE] Release Spark 3.0.1 (RC3)
Xiao Li   Re: [VOTE] Release Spark 3.0.1 (RC3) Tue, 01 Sep, 14:54
Dongjoon Hyun     Re: [VOTE] Release Spark 3.0.1 (RC3) Wed, 02 Sep, 03:45
Hyukjin Kwon       Re: [VOTE] Release Spark 3.0.1 (RC3) Wed, 02 Sep, 09:14
Dongjoon Hyun         Re: [VOTE] Release Spark 3.0.1 (RC3) Wed, 02 Sep, 15:15
郑瑞峰 [VOTE][RESULT] Release Spark 3.0.1 (RC3) Thu, 03 Sep, 01:39
Re: SPIP: Catalog API for view metadata
Wenchen Fan   Re: SPIP: Catalog API for view metadata Thu, 03 Sep, 08:59
John Zhuge     Re: SPIP: Catalog API for view metadata Thu, 03 Sep, 16:22
John Zhuge       Re: SPIP: Catalog API for view metadata Fri, 04 Sep, 08:20
Re: What's the root cause of not supporting multiple aggregations in structured streaming?
Jungtaek Lim   Re: What's the root cause of not supporting multiple aggregations in structured streaming? Fri, 04 Sep, 06:06
Etienne Chauchot     Re: What's the root cause of not supporting multiple aggregations in structured streaming? Fri, 04 Sep, 08:55
Jungtaek Lim       Re: What's the root cause of not supporting multiple aggregations in structured streaming? Sat, 26 Sep, 02:30
Yuanjian Li         Re: What's the root cause of not supporting multiple aggregations in structured streaming? Tue, 29 Sep, 01:24
XIMO GUANTER GONZALBEZ Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter Fri, 04 Sep, 12:51
Reynold Xin   Re: Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter Fri, 04 Sep, 17:33
Cheng Su     Re: Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter Fri, 04 Sep, 18:37
kalyan       Re: Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter Sat, 05 Sep, 07:37
Cheng Su         Re: Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter Sun, 06 Sep, 00:58
XIMO GUANTER GONZALBEZ       RE: Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter Mon, 07 Sep, 05:55
Cheng Su         Re: Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter Wed, 09 Sep, 06:57
XIMO GUANTER GONZALBEZ           RE: Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter Mon, 21 Sep, 15:16
Cheng Su           Re: Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter Mon, 21 Sep, 15:53
Prashant Sharma [VOTE] Release Spark 2.4.7 (RC3) Tue, 08 Sep, 13:54
Sean Owen   Re: [VOTE] Release Spark 2.4.7 (RC3) Tue, 08 Sep, 20:00
Mridul Muralidharan   Re: [VOTE] Release Spark 2.4.7 (RC3) Tue, 08 Sep, 22:11
Wenchen Fan     Re: [VOTE] Release Spark 2.4.7 (RC3) Thu, 10 Sep, 01:03
Sean Owen       Re: [VOTE] Release Spark 2.4.7 (RC3) Thu, 10 Sep, 01:18
Mridul Muralidharan       Re: [VOTE] Release Spark 2.4.7 (RC3) Thu, 10 Sep, 01:25
Wenchen Fan         Re: [VOTE] Release Spark 2.4.7 (RC3) Thu, 10 Sep, 02:08
Sean Owen           Re: [VOTE] Release Spark 2.4.7 (RC3) Thu, 10 Sep, 03:43
Prashant Sharma             Re: [VOTE] Release Spark 2.4.7 (RC3) Thu, 10 Sep, 06:12
Prashant Sharma               Re: [VOTE] Release Spark 2.4.7 (RC3) Thu, 10 Sep, 06:26
Wenchen Fan                 Re: [VOTE] Release Spark 2.4.7 (RC3) Thu, 10 Sep, 08:09
Dongjoon Hyun                   Re: [VOTE] Release Spark 2.4.7 (RC3) Thu, 10 Sep, 18:41
Dongjoon Hyun                     Re: [VOTE] Release Spark 2.4.7 (RC3) Fri, 11 Sep, 21:27
Prashant Sharma                       Re: [VOTE] Release Spark 2.4.7 (RC3) Sat, 12 Sep, 01:55
Dongjoon Hyun                         Re: [VOTE] Release Spark 2.4.7 (RC3) Sat, 12 Sep, 03:03
Gang Li For the same data source in two SQLs, how to read it once? Wed, 09 Sep, 07:42
Yang shun   Re: For the same data source in two SQLs, how to read it once? Wed, 09 Sep, 08:06
Gang Li     Re: For the same data source in two SQLs, how to read it once? Wed, 09 Sep, 09:01
Gang Li       Re: For the same data source in two SQLs, how to read it once? Wed, 09 Sep, 09:06
Liu Genie       回复: For the same data source in two SQLs, how to read it once? Thu, 10 Sep, 01:36
Gang Li         Re: 回复: For the same data source in two SQLs, how to read it once? Thu, 10 Sep, 02:08
cfang1109 Question about differences between batch and streaming training of LogisticRegression Algorithm in Spark3.0 Wed, 09 Sep, 11:21
Sean Owen   Re: Question about differences between batch and streaming training of LogisticRegression Algorithm in Spark3.0 Wed, 09 Sep, 12:45
mundaym leveldbjni dependency Wed, 09 Sep, 14:34
Sean Owen   Re: leveldbjni dependency Thu, 10 Sep, 12:35
David Li [DISCUSS] Reducing memory usage of toPandas with Arrow "self_destruct" option Thu, 10 Sep, 13:41
Griselda Cuevas Notification of analysis on publicly available project data Thu, 10 Sep, 16:48
Chao Sun Migrating BinaryFileFormat to DSv2? Thu, 10 Sep, 16:48
Re: Contributing to JIRA Maintenance
EveLiao   Re: Contributing to JIRA Maintenance Thu, 10 Sep, 21:54
Sean Owen     Re: Contributing to JIRA Maintenance Thu, 10 Sep, 22:34
EveLiao       Re: Contributing to JIRA Maintenance Thu, 10 Sep, 23:12
陈晓宇 [DISCUSS] Spark cannot identify the problem executor Fri, 11 Sep, 05:07
Sean Owen   Re: [DISCUSS] Spark cannot identify the problem executor Fri, 11 Sep, 12:42
郑瑞峰 [ANNOUNCE] Announcing Apache Spark 3.0.1 Fri, 11 Sep, 08:52
Dongjoon Hyun   Re: [ANNOUNCE] Announcing Apache Spark 3.0.1 Fri, 11 Sep, 12:49
Takeshi Yamamuro     Re: [ANNOUNCE] Announcing Apache Spark 3.0.1 Fri, 11 Sep, 13:50
Gengliang Wang       Re: [ANNOUNCE] Announcing Apache Spark 3.0.1 Fri, 11 Sep, 15:09
Wenchen Fan         Re: [ANNOUNCE] Announcing Apache Spark 3.0.1 Fri, 11 Sep, 15:50
Prashant Sharma [VOTE][RESULT] Release Spark 2.4.7 (RC3) Sat, 12 Sep, 02:01
Dongjoon Hyun   Re: [VOTE][RESULT] Release Spark 2.4.7 (RC3) Sat, 12 Sep, 03:59
Prashant Sharma     Re: [VOTE][RESULT] Release Spark 2.4.7 (RC3) Sat, 12 Sep, 09:38
Prashant Sharma [ANNOUNCE] Announcing Apache Spark 2.4.7 Sat, 12 Sep, 09:36
Alfie Davidson [SPARK SQL] Make max multi table join limit configurable in OptimizeSkewedJoin Sat, 12 Sep, 19:28
Chang Chen Performance of VectorizedRleValuesReader Mon, 14 Sep, 02:25
Sean Owen   Re: Performance of VectorizedRleValuesReader Mon, 14 Sep, 02:39
Chang Chen     Re: Performance of VectorizedRleValuesReader Mon, 14 Sep, 03:48
Sean Owen       Re: Performance of VectorizedRleValuesReader Mon, 14 Sep, 12:29
Ryan Blue         Re: Performance of VectorizedRleValuesReader Mon, 14 Sep, 18:03
Chang Chen           Re: Performance of VectorizedRleValuesReader Tue, 15 Sep, 03:50
Mark Daniels   unsubscribe Thu, 17 Sep, 12:35
Mridul Muralidharan [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Mon, 14 Sep, 02:59
Xingbo Jiang   Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Mon, 14 Sep, 18:13
Venkatakrishnan Sowrirajan     Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Mon, 14 Sep, 18:22
Tom Graves   Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Mon, 14 Sep, 18:39
Chandni Singh     Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Mon, 14 Sep, 19:30
DB Tsai       Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Mon, 14 Sep, 21:29
Xiao Li         Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Tue, 15 Sep, 00:21
angers.zhu           Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Tue, 15 Sep, 01:38
Joseph Torres             Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Tue, 15 Sep, 03:53
kalyan               Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Tue, 15 Sep, 04:19
Dongjoon Hyun                 Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Tue, 15 Sep, 06:42
Wenchen Fan                   Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Tue, 15 Sep, 07:44
Yi Wu                     Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Tue, 15 Sep, 09:10
叶先进                       Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Tue, 15 Sep, 11:09
郑瑞峰                         回复: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Wed, 16 Sep, 02:29
Takeshi Yamamuro                           Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Wed, 16 Sep, 03:23
Mridul Muralidharan   Re: [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Fri, 18 Sep, 22:00
lsn248 How to clear spark Shuffle files Mon, 14 Sep, 15:45
Edward Mitchell   Re: How to clear spark Shuffle files Mon, 14 Sep, 20:32
Holden Karau     Re: How to clear spark Shuffle files Mon, 14 Sep, 21:25
lsn248       Re: How to clear spark Shuffle files Mon, 14 Sep, 22:31
Jungtaek Lim [DISCUSS] Time to evaluate "continuous mode" in SS? Tue, 15 Sep, 04:34
Gabor Somogyi   Re: [DISCUSS] Time to evaluate "continuous mode" in SS? Tue, 15 Sep, 08:48
Sean Owen   Re: [DISCUSS] Time to evaluate "continuous mode" in SS? Tue, 15 Sep, 12:08
Jungtaek Lim     Re: [DISCUSS] Time to evaluate "continuous mode" in SS? Tue, 15 Sep, 13:19
Sean Owen       Re: [DISCUSS] Time to evaluate "continuous mode" in SS? Tue, 15 Sep, 13:36
Joseph Torres         Re: [DISCUSS] Time to evaluate "continuous mode" in SS? Tue, 15 Sep, 14:02
mshen           Re: [DISCUSS] Time to evaluate "continuous mode" in SS? Tue, 15 Sep, 21:32
Jungtaek Lim           Re: [DISCUSS] Time to evaluate "continuous mode" in SS? Wed, 16 Sep, 00:03
Cheng Su             Re: [DISCUSS] Time to evaluate "continuous mode" in SS? Thu, 17 Sep, 00:47
Nasrulla Khan Haris Spark-Locality: Hinting Spark location of the executor does not take effect. Wed, 16 Sep, 20:41
Nasrulla Khan Haris   Spark-Locality: Hinting Spark location of the executor does not take effect. Wed, 16 Sep, 23:10
nakhanha     Re: Spark-Locality: Hinting Spark location of the executor does not take effect. Thu, 17 Sep, 01:42
Nasrulla Khan Haris     RE: Spark-Locality: Hinting Spark location of the executor does not take effect. Fri, 18 Sep, 17:48
nakhanha   Re: Spark-Locality: Hinting Spark location of the executor does not take effect. Thu, 17 Sep, 01:40
nakhanha   Re: Spark-Locality: Hinting Spark location of the executor does not take effect. Thu, 17 Sep, 01:41
Tarun Query /Bug Spark Streaming / Context Cleaner/ GC question Wed, 16 Sep, 22:23
Priyanka Gomatam Spark-Locality: Hinting Spark location of the executor does not take effect Wed, 16 Sep, 23:34
Jacek Laskowski Incorrect Scala version for Spark 2.4.x releases in the docs? Thu, 17 Sep, 14:11
Sean Owen   Re: Incorrect Scala version for Spark 2.4.x releases in the docs? Thu, 17 Sep, 14:16
Jacek Laskowski     Re: Incorrect Scala version for Spark 2.4.x releases in the docs? Thu, 17 Sep, 15:35
Shubham Chaurasia Pre query execution hook for custom datasources Fri, 18 Sep, 08:17
tanelk Inconsistencies with how catalyst optimizer handles non-deterministic expressions Fri, 18 Sep, 19:41
Mridul Muralidharan [RESULT] [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency Fri, 18 Sep, 22:01
Jungtaek Lim Output mode in Structured Streaming and DSv1 sink/DSv2 table Sun, 20 Sep, 04:59
Jungtaek Lim   Re: Output mode in Structured Streaming and DSv1 sink/DSv2 table Mon, 28 Sep, 01:10
Prashant Sharma Automatically mount the user-specific configurations on K8s cluster, using a config map. Mon, 21 Sep, 12:35
Steve Loughran A common naming policy for third-party packages/modules under org.apache.spark? Mon, 21 Sep, 13:28
Dongjoon Hyun   Re: A common naming policy for third-party packages/modules under org.apache.spark? Tue, 22 Sep, 02:58
Dongjoon Hyun   Re: A common naming policy for third-party packages/modules under org.apache.spark? Tue, 22 Sep, 03:02
Steve Loughran     Re: A common naming policy for third-party packages/modules under org.apache.spark? Wed, 23 Sep, 13:00
Sean Owen       Re: A common naming policy for third-party packages/modules under org.apache.spark? Wed, 23 Sep, 13:04
Dongjoon Hyun [FYI] Removing `spark-3.1.0-bin-hadoop2.7-hive1.2.tgz` from Apache Spark 3.1 distribution Wed, 23 Sep, 22:57
shane knapp ☠ [build system] downtime due to SSL cert errors Thu, 24 Sep, 01:07
shane knapp ☠   Re: [build system] downtime due to SSL cert errors Thu, 24 Sep, 16:48
EveLiao Test Failures on macOS 10.15.4 Thu, 24 Sep, 02:12
Jeff Evans Supporting Row and DataFrame level metadata? Thu, 24 Sep, 16:19
Re: Running K8s integration tests for changes in core?
shane knapp ☠   Re: Running K8s integration tests for changes in core? Thu, 24 Sep, 17:17
Holden Karau     Re: Running K8s integration tests for changes in core? Thu, 24 Sep, 17:21
Hyukjin Kwon       Re: Running K8s integration tests for changes in core? Thu, 24 Sep, 22:55
gpongracz get method guid prefix for file parts for write Fri, 25 Sep, 04:35
EveLiao   Re: get method guid prefix for file parts for write Fri, 25 Sep, 18:00
Nicholas Chammas     Re: get method guid prefix for file parts for write Fri, 25 Sep, 22:14
gpongracz       Re: get method guid prefix for file parts for write Fri, 25 Sep, 23:01
gpongracz       Re: get method guid prefix for file parts for write Fri, 25 Sep, 23:05
Re: [DISCUSS] "latestFirst" option and metadata growing issue in File stream source
Jungtaek Lim   Re: [DISCUSS] "latestFirst" option and metadata growing issue in File stream source Mon, 28 Sep, 01:11
Message list1 · 2 · Next »Thread · Author · Date
Box list
Nov 202077
Oct 2020115
Sep 2020147
Aug 2020173
Jul 2020246
Jun 2020215
May 2020198
Apr 2020140
Mar 2020201
Feb 2020182
Jan 2020196
Dec 2019184
Nov 2019215
Oct 2019229
Sep 2019241
Aug 2019236
Jul 2019138
Jun 2019147
May 2019168
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333