spark-dev mailing list archives: April 2021

Site index · List index
Message listThread · Author · Date
Re: [Spark Core]: Adding support for size based partition coalescing
German Schiavon   Re: [Spark Core]: Adding support for size based partition coalescing Thu, 01 Apr, 14:23
Re: Welcoming six new Apache Spark committers
Maxim Gekk   Re: Welcoming six new Apache Spark committers Thu, 01 Apr, 15:59
Chang Chen [Discuss][SPIP] DataSource V2 SQL push down Fri, 02 Apr, 07:57
Chang Chen   Re: [Discuss][SPIP] DataSource V2 SQL push down Fri, 02 Apr, 08:04
huaxin gao     Re: [Discuss][SPIP] DataSource V2 SQL push down Sun, 04 Apr, 18:24
Chang Chen       Re: [Discuss][SPIP] DataSource V2 SQL push down Mon, 05 Apr, 14:02
Chang Chen         Re: [Discuss][SPIP] DataSource V2 SQL push down Wed, 07 Apr, 08:32
huaxin gao           Re: [Discuss][SPIP] DataSource V2 SQL push down Wed, 07 Apr, 23:09
Chang Chen             Re: [Discuss][SPIP] DataSource V2 SQL push down Fri, 09 Apr, 06:48
huaxin gao               Re: [Discuss][SPIP] DataSource V2 SQL push down Fri, 09 Apr, 16:19
Re: Apache Spark 2.4.8 (and EOL of 2.4)
Liang-Chi Hsieh   Re: Apache Spark 2.4.8 (and EOL of 2.4) Sun, 04 Apr, 09:17
Hyukjin Kwon     Re: Apache Spark 2.4.8 (and EOL of 2.4) Sun, 04 Apr, 09:23
Dongjoon Hyun       Re: Apache Spark 2.4.8 (and EOL of 2.4) Sun, 04 Apr, 14:28
Liang-Chi Hsieh         Re: Apache Spark 2.4.8 (and EOL of 2.4) Sun, 04 Apr, 16:39
mingjia   Re: Apache Spark 2.4.8 (and EOL of 2.4) Mon, 05 Apr, 22:05
Liang-Chi Hsieh     Re: Apache Spark 2.4.8 (and EOL of 2.4) Mon, 05 Apr, 22:11
Re: Shutdown cleanup of disk-based resources that Spark creates
Steve Loughran   Re: Shutdown cleanup of disk-based resources that Spark creates Tue, 06 Apr, 12:45
Re: Support User Defined Types in pandas_udf for Spark's own Python API
Hyukjin Kwon   Re: Support User Defined Types in pandas_udf for Spark's own Python API Wed, 07 Apr, 04:17
Hyukjin Kwon Increase the number of parallel jobs in GitHub Actions at ASF organization level Wed, 07 Apr, 05:23
Jarek Potiuk   Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level Wed, 07 Apr, 08:40
Greg Stein   Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level Wed, 07 Apr, 08:51
Hyukjin Kwon     Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level Wed, 07 Apr, 12:40
Martin Grigorov       Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level Wed, 07 Apr, 13:02
Hyukjin Kwon         Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level Wed, 07 Apr, 13:30
Wenchen Fan           Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level Thu, 08 Apr, 04:50
Hyukjin Kwon             Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level Thu, 08 Apr, 05:55
Jarek Potiuk             Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level Thu, 08 Apr, 22:06
shane knapp ☠           Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level Thu, 08 Apr, 15:37
Liang-Chi Hsieh [VOTE] Release Spark 2.4.8 (RC1) Wed, 07 Apr, 08:11
Sean Owen   Re: [VOTE] Release Spark 2.4.8 (RC1) Thu, 08 Apr, 01:23
Wenchen Fan     Re: [VOTE] Release Spark 2.4.8 (RC1) Thu, 08 Apr, 02:19
Takeshi Yamamuro       Re: [VOTE] Release Spark 2.4.8 (RC1) Thu, 08 Apr, 02:28
Liang-Chi Hsieh       Re: [VOTE] Release Spark 2.4.8 (RC1) Thu, 08 Apr, 02:30
Mridul Muralidharan         Re: [VOTE] Release Spark 2.4.8 (RC1) Thu, 08 Apr, 03:16
Liang-Chi Hsieh           Re: [VOTE] Release Spark 2.4.8 (RC1) Thu, 08 Apr, 03:41
shane knapp ☠ please read: current state and the future of the apache spark build system Wed, 07 Apr, 18:38
shane knapp ☠   Re: please read: current state and the future of the apache spark build system Thu, 15 Apr, 00:02
Hyukjin Kwon     Re: please read: current state and the future of the apache spark build system Thu, 15 Apr, 00:12
Holden Karau       Re: please read: current state and the future of the apache spark build system Thu, 15 Apr, 00:28
Yikun Jiang         Re: please read: current state and the future of the apache spark build system Thu, 15 Apr, 08:49
Karen [DISCUSS] Build error message guideline Wed, 07 Apr, 20:27
Hyukjin Kwon   Re: [DISCUSS] Build error message guideline Thu, 08 Apr, 03:18
Karen     Re: [DISCUSS] Build error message guideline Tue, 13 Apr, 21:31
Hyukjin Kwon       Re: [DISCUSS] Build error message guideline Wed, 14 Apr, 01:27
Yuming Wang         Re: [DISCUSS] Build error message guideline Wed, 14 Apr, 02:41
Karen           Re: [DISCUSS] Build error message guideline Wed, 14 Apr, 17:50
Yuming Wang             Re: [DISCUSS] Build error message guideline Thu, 15 Apr, 00:34
Karen               Re: [DISCUSS] Build error message guideline Fri, 16 Apr, 02:06
Tomas Bartalos Big Broadcast Hash Join with Dynamic Partition Pruning gives wrong results Wed, 07 Apr, 23:51
Wenchen Fan   Re: Big Broadcast Hash Join with Dynamic Partition Pruning gives wrong results Thu, 08 Apr, 02:24
Dhruv Kumar Automated setup of a multi-node cluster for Apache Spark and generation of profiling results Sat, 10 Apr, 08:49
sid New Idea Proposal for GSoC 2021 Sat, 10 Apr, 16:18
Liang-Chi Hsieh [VOTE] Release Spark 2.4.8 (RC2) Mon, 12 Apr, 05:46
Sean Owen   Re: [VOTE] Release Spark 2.4.8 (RC2) Mon, 12 Apr, 17:57
Hyukjin Kwon     Re: [VOTE] Release Spark 2.4.8 (RC2) Mon, 12 Apr, 23:52
sarutak       Re: [VOTE] Release Spark 2.4.8 (RC2) Tue, 13 Apr, 00:40
Herman van Hovell         Re: [VOTE] Release Spark 2.4.8 (RC2) Tue, 13 Apr, 08:02
Jungtaek Lim           Re: [VOTE] Release Spark 2.4.8 (RC2) Wed, 14 Apr, 05:33
Gengliang Wang             Re: [VOTE] Release Spark 2.4.8 (RC2) Wed, 14 Apr, 05:36
Kent Yao               Re: [VOTE] Release Spark 2.4.8 (RC2) Wed, 14 Apr, 05:37
Dongjoon Hyun                 Re: [VOTE] Release Spark 2.4.8 (RC2) Wed, 14 Apr, 15:39
Maxim Gekk                   Re: [VOTE] Release Spark 2.4.8 (RC2) Wed, 14 Apr, 16:21
Wenchen Fan                     Re: [VOTE] Release Spark 2.4.8 (RC2) Wed, 14 Apr, 17:42
DB Tsai                       Re: [VOTE] Release Spark 2.4.8 (RC2) Wed, 14 Apr, 20:44
Liang-Chi Hsieh                         Re: [VOTE] Release Spark 2.4.8 (RC2) Thu, 15 Apr, 17:07
Nicholas Marion                           RE: [VOTE] Release Spark 2.4.8 (RC2) Wed, 28 Apr, 12:31
Re: Apache Spark 3.2 Expectation
Wenchen Fan   Re: Apache Spark 3.2 Expectation Mon, 12 Apr, 05:59
Kwangsun Noh UserGroupInformation.doAS is working well in Spark Executors? Mon, 12 Apr, 15:19
yaooqinn   Re: UserGroupInformation.doAS is working well in Spark Executors? Mon, 12 Apr, 15:57
Steve Loughran   Re: UserGroupInformation.doAS is working well in Spark Executors? Thu, 15 Apr, 10:00
Hyukjin Kwon [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 04:42
Hyukjin Kwon   Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 04:46
Gengliang Wang     Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 05:00
Yi Wu       Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 06:50
Yuanjian Li         Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 07:39
Kent Yao           Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 07:41
Kent Yao             Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 12:11
Hyukjin Kwon               Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 12:19
Kent Yao                 Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 12:24
Dongjoon Hyun                   Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 15:34
Kent Yao                     Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 17:41
Dongjoon Hyun                       Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 14 Apr, 22:21
Hyukjin Kwon                         Re: [PSA] Please read: PR builder now runs test and build in your forked repository Thu, 15 Apr, 02:00
Hyukjin Kwon                           Re: [PSA] Please read: PR builder now runs test and build in your forked repository Thu, 15 Apr, 02:01
Hyukjin Kwon                             Re: [PSA] Please read: PR builder now runs test and build in your forked repository Thu, 15 Apr, 04:09
Kent Yao                             Re: [PSA] Please read: PR builder now runs test and build in your forked repository Thu, 15 Apr, 04:14
Hyukjin Kwon                               Re: [PSA] Please read: PR builder now runs test and build in your forked repository Thu, 15 Apr, 04:17
Kent Yao                                 Re: [PSA] Please read: PR builder now runs test and build in your forked repository Thu, 15 Apr, 04:26
Hyukjin Kwon                                   Re: [PSA] Please read: PR builder now runs test and build in your forked repository Thu, 15 Apr, 14:12
Hyukjin Kwon                                     Re: [PSA] Please read: PR builder now runs test and build in your forked repository Thu, 15 Apr, 16:31
Hyukjin Kwon                                       Re: [PSA] Please read: PR builder now runs test and build in your forked repository Fri, 16 Apr, 01:38
Hyukjin Kwon                                         Re: [PSA] Please read: PR builder now runs test and build in your forked repository Sun, 18 Apr, 02:35
Hyukjin Kwon                                           Re: [PSA] Please read: PR builder now runs test and build in your forked repository Wed, 21 Apr, 01:17
shane knapp ☠ [SPARK-34738] issues w/k8s+minikube and PV tests Wed, 14 Apr, 17:20
Frank Luo   Re: [SPARK-34738] issues w/k8s+minikube and PV tests Wed, 14 Apr, 17:32
shane knapp ☠     Re: [SPARK-34738] issues w/k8s+minikube and PV tests Wed, 14 Apr, 17:39
Rob Vesse       Re: [SPARK-34738] issues w/k8s+minikube and PV tests Thu, 15 Apr, 09:26
Holden Karau         Re: [SPARK-34738] issues w/k8s+minikube and PV tests Thu, 15 Apr, 21:58
shane knapp ☠           Re: [SPARK-34738] issues w/k8s+minikube and PV tests Thu, 15 Apr, 22:05
shane knapp ☠             Re: [SPARK-34738] issues w/k8s+minikube and PV tests Fri, 16 Apr, 23:55
Karen [DISCUSS] Add error IDs Wed, 14 Apr, 19:04
Steve Loughran   Re: [DISCUSS] Add error IDs Thu, 15 Apr, 10:17
Karen     Re: [DISCUSS] Add error IDs Thu, 15 Apr, 21:14
Yuming Wang       Re: [DISCUSS] Add error IDs Fri, 16 Apr, 10:01
Wenchen Fan         Re: [DISCUSS] Add error IDs Wed, 21 Apr, 14:32
mshen Production results of push-based shuffle after rolling out to 100% of Spark workloads at LinkedIn Thu, 15 Apr, 20:50
Fatal Lin [Spark SQL] quick enhancement for SPARK-28098 Sat, 17 Apr, 07:30
Dhruv Kumar Benchmarks for Many-to-Many Joins Wed, 21 Apr, 17:19
waltercai   Re: Benchmarks for Many-to-Many Joins Thu, 22 Apr, 02:35
Bruce Robbins mvn auto-downloading on fresh clone Wed, 21 Apr, 17:50
Sean Owen   Re: mvn auto-downloading on fresh clone Wed, 21 Apr, 18:01
Walter Cai modifying spark's optimizer for research Thu, 22 Apr, 01:08
Cheng Su   Re: modifying spark's optimizer for research Thu, 22 Apr, 06:46
Walter Cai     Re: modifying spark's optimizer for research Thu, 22 Apr, 16:15
Yikun Jiang [DISCUSS] Multiple columns adding/replacing support in PySpark DataFrame API Thu, 22 Apr, 07:33
Saurabh Chawla   Re: [DISCUSS] Multiple columns adding/replacing support in PySpark DataFrame API Fri, 30 Apr, 05:13
Matthew Powers     Re: [DISCUSS] Multiple columns adding/replacing support in PySpark DataFrame API Fri, 30 Apr, 11:29
Manu Zhang Why is failing to get Hive token non fatal ? Thu, 22 Apr, 12:58
Rich Bowen CFP for ApacheCon 2021 closes in ONE WEEK Fri, 23 Apr, 15:00
Ye YuQiang Unsubscriber Sun, 25 Apr, 01:59
Mohamed Moustapha Diouf   Unsubscriber Sun, 25 Apr, 10:58
Darcy Shen Correctness Issue for UDT Support in PySpark Sun, 25 Apr, 04:13
Bo Zhang Bintray replacement for spark-packages.org Mon, 26 Apr, 07:30
Matthew Powers   Re: Bintray replacement for spark-packages.org Tue, 27 Apr, 01:02
Wenchen Fan     Re: Bintray replacement for spark-packages.org Wed, 28 Apr, 17:14
Dongjoon Hyun       Re: Bintray replacement for spark-packages.org Thu, 29 Apr, 16:36
Mich Talebzadeh How to gracefully shutdown Spark Structured Streaming Mon, 26 Apr, 08:44
Mich Talebzadeh   Re: How to gracefully shutdown Spark Structured Streaming Mon, 26 Apr, 09:21
Re: Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter
Cheng Su   Re: Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter Tue, 27 Apr, 07:33
Re: [DISCUSS] Add RocksDB StateStore
Yuanjian Li   Re: [DISCUSS] Add RocksDB StateStore Tue, 27 Apr, 09:41
Jungtaek Lim     Re: [DISCUSS] Add RocksDB StateStore Wed, 28 Apr, 01:50
Liang-Chi Hsieh       Re: [DISCUSS] Add RocksDB StateStore Wed, 28 Apr, 23:24
Liang-Chi Hsieh [VOTE] Release Spark 2.4.8 (RC3) Wed, 28 Apr, 16:26
DB Tsai   Re: [VOTE] Release Spark 2.4.8 (RC3) Wed, 28 Apr, 17:04
Wenchen Fan     Re: [VOTE] Release Spark 2.4.8 (RC3) Wed, 28 Apr, 17:12
Maxim Gekk       Re: [VOTE] Release Spark 2.4.8 (RC3) Wed, 28 Apr, 17:31
Dongjoon Hyun         Re: [VOTE] Release Spark 2.4.8 (RC3) Wed, 28 Apr, 17:42
Holden Karau           Re: [VOTE] Release Spark 2.4.8 (RC3) Wed, 28 Apr, 21:41
Sean Owen   Re: [VOTE] Release Spark 2.4.8 (RC3) Wed, 28 Apr, 22:07
Hyukjin Kwon     Re: [VOTE] Release Spark 2.4.8 (RC3) Thu, 29 Apr, 00:14
郑瑞峰       回复: [VOTE] Release Spark 2.4.8 (RC3) Thu, 29 Apr, 02:43
Kent Yao         Re: [VOTE] Release Spark 2.4.8 (RC3) Thu, 29 Apr, 03:15
sarutak           Re: [VOTE] Release Spark 2.4.8 (RC3) Thu, 29 Apr, 04:53
Liang-Chi Hsieh             Re: [VOTE] Release Spark 2.4.8 (RC3) Fri, 30 Apr, 19:05
Holden Karau Should we add built in support for bouncy castle EC w/Kube Thu, 29 Apr, 18:08
Sean Owen   Re: Should we add built in support for bouncy castle EC w/Kube Thu, 29 Apr, 18:11
Message listThread · Author · Date
Box list
May 202144
Apr 2021146
Mar 2021208
Feb 2021210
Jan 2021118
Dec 202068
Nov 202098
Oct 2020115
Sep 2020147
Aug 2020173
Jul 2020246
Jun 2020215
May 2020198
Apr 2020140
Mar 2020201
Feb 2020182
Jan 2020196
Dec 2019184
Nov 2019215
Oct 2019229
Sep 2019241
Aug 2019236
Jul 2019138
Jun 2019147
May 2019168
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333