spark-dev mailing list archives: May 2020

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Xiangyu Li No LICENSE file in spark custom build distribution Fri, 01 May, 15:18
Sean Owen   Re: No LICENSE file in spark custom build distribution Fri, 01 May, 15:30
Xiangyu Li     Re: No LICENSE file in spark custom build distribution Fri, 01 May, 16:43
Sean Owen       Re: No LICENSE file in spark custom build distribution Fri, 01 May, 17:30
Xiangyu Li         Re: No LICENSE file in spark custom build distribution Fri, 01 May, 18:45
Sean Owen           Re: No LICENSE file in spark custom build distribution Fri, 01 May, 18:48
Xiangyu Li             Re: No LICENSE file in spark custom build distribution Fri, 01 May, 20:13
Sean Owen               Re: No LICENSE file in spark custom build distribution Fri, 01 May, 20:23
Xiangyu Li                 Re: No LICENSE file in spark custom build distribution Fri, 01 May, 20:32
Sean Owen                   Re: No LICENSE file in spark custom build distribution Fri, 01 May, 20:37
Xiangyu Li                     Re: No LICENSE file in spark custom build distribution Fri, 01 May, 20:43
Holden Karau                   Re: No LICENSE file in spark custom build distribution Fri, 01 May, 20:39
Xiangyu Li                     Re: No LICENSE file in spark custom build distribution Fri, 01 May, 20:46
Holden Karau                       Re: No LICENSE file in spark custom build distribution Fri, 01 May, 20:51
Xiangyu Li                         Re: No LICENSE file in spark custom build distribution Fri, 01 May, 20:56
Re:Re: is there any tool to visualize the spark physical plan or spark plan
zhangliyun   Re:Re: is there any tool to visualize the spark physical plan or spark plan Fri, 01 May, 22:45
Enrico Minack     Re: is there any tool to visualize the spark physical plan or spark plan Sat, 02 May, 19:07
Aditya Addepalli Spark FP-growth Sat, 02 May, 08:12
Sean Owen   Re: Spark FP-growth Sat, 02 May, 15:43
Aditya Addepalli     Re: Spark FP-growth Sat, 02 May, 16:04
Aditya Addepalli       Re: Spark FP-growth Thu, 07 May, 17:25
Sean Owen       Re: Spark FP-growth Thu, 07 May, 17:51
Aditya Addepalli         Re: Spark FP-growth Thu, 07 May, 18:12
Sean Owen           Re: Spark FP-growth Thu, 07 May, 18:26
Aditya Addepalli             Re: Spark FP-growth Thu, 07 May, 18:28
Jungtaek Lim Inconsistent schema on Encoders.bean (reported issues from user@) Mon, 04 May, 07:57
Jungtaek Lim   Re: Inconsistent schema on Encoders.bean (reported issues from user@) Fri, 08 May, 07:48
Wenchen Fan     Re: Inconsistent schema on Encoders.bean (reported issues from user@) Fri, 08 May, 08:50
Jungtaek Lim       Re: Inconsistent schema on Encoders.bean (reported issues from user@) Fri, 08 May, 15:42
Wenchen Fan         Re: Inconsistent schema on Encoders.bean (reported issues from user@) Mon, 11 May, 04:24
Jungtaek Lim           Re: Inconsistent schema on Encoders.bean (reported issues from user@) Mon, 11 May, 04:36
Jungtaek Lim             Re: Inconsistent schema on Encoders.bean (reported issues from user@) Sun, 24 May, 08:00
Sean Owen               Re: Inconsistent schema on Encoders.bean (reported issues from user@) Sun, 24 May, 14:01
Jungtaek Lim                 Re: Inconsistent schema on Encoders.bean (reported issues from user@) Tue, 26 May, 05:54
Jungtaek Lim Handling user-facing metadata issues on file stream source & sink Mon, 04 May, 08:45
Jungtaek Lim   Re: Handling user-facing metadata issues on file stream source & sink Fri, 08 May, 07:49
Jungtaek Lim     Re: Handling user-facing metadata issues on file stream source & sink Fri, 22 May, 03:50
Re: RDD order guarantees
Steve Loughran   Re: RDD order guarantees Wed, 06 May, 15:19
Antonin Delpeuch (lists)     Re: RDD order guarantees Wed, 06 May, 15:53
zhangliyun Screen Shot 2020-05-07 at 6.35.43 AM Thu, 07 May, 02:13
zhangliyun a spark job hangs 20 hours and it shows 2 tasks not finished in stage page but all tasks shows finished or failed in task page Thu, 07 May, 02:14
ML Books   Re: a spark job hangs 20 hours and it shows 2 tasks not finished in stage page but all tasks shows finished or failed in task page Thu, 07 May, 02:59
zhangliyun     Re:Re: a spark job hangs 20 hours and it shows 2 tasks not finished in stage page but all tasks shows finished or failed in task page Thu, 07 May, 03:49
angers.zhu       Re: a spark job hangs 20 hours and it shows 2 tasks not finished in stage page but all tasks shows finished or failed in task page Thu, 07 May, 03:53
ML Books         Re: a spark job hangs 20 hours and it shows 2 tasks not finished in stage page but all tasks shows finished or failed in task page Thu, 07 May, 04:03
Sandeep Katta         Re: a spark job hangs 20 hours and it shows 2 tasks not finished in stage page but all tasks shows finished or failed in task page Thu, 07 May, 04:04
zhangliyun           Re:Re: a spark job hangs 20 hours and it shows 2 tasks not finished in stage page but all tasks shows finished or failed in task page Thu, 07 May, 07:37
Wenchen Fan             Re: Re: a spark job hangs 20 hours and it shows 2 tasks not finished in stage page but all tasks shows finished or failed in task page Fri, 08 May, 08:53
zhangliyun               Re:Re: Re: a spark job hangs 20 hours and it shows 2 tasks not finished in stage page but all tasks shows finished or failed in task page Sun, 10 May, 21:35
Wenchen Fan                 Re: Re: Re: a spark job hangs 20 hours and it shows 2 tasks not finished in stage page but all tasks shows finished or failed in task page Mon, 11 May, 04:29
Hyukjin Kwon [OSS DIGEST] The major changes of Apache Spark from Apr 8 to Apr 21 Thu, 07 May, 12:04
Re: [DISCUSS] Java specific APIs design concern and choice
Hyukjin Kwon   Re: [DISCUSS] Java specific APIs design concern and choice Thu, 07 May, 12:18
Hyukjin Kwon     Re: [DISCUSS] Java specific APIs design concern and choice Mon, 11 May, 11:44
Tom Graves       Re: [DISCUSS] Java specific APIs design concern and choice Mon, 11 May, 13:45
Hyukjin Kwon         Re: [DISCUSS] Java specific APIs design concern and choice Mon, 11 May, 14:08
Hyukjin Kwon           Re: [DISCUSS] Java specific APIs design concern and choice Mon, 11 May, 14:52
Holden Karau [VOTE] Release Spark 2.4.6 (RC1) Thu, 07 May, 18:29
Holden Karau   Re: [VOTE] Release Spark 2.4.6 (RC1) Thu, 07 May, 21:30
Dongjoon Hyun     Re: [VOTE] Release Spark 2.4.6 (RC1) Fri, 08 May, 01:42
Holden Karau       Re: [VOTE] Release Spark 2.4.6 (RC1) Fri, 08 May, 01:50
Sean Owen   Re: [VOTE] Release Spark 2.4.6 (RC1) Fri, 08 May, 15:42
Yuanjian Li     Re: [VOTE] Release Spark 2.4.6 (RC1) Fri, 08 May, 16:33
Holden Karau       Re: [VOTE] Release Spark 2.4.6 (RC1) Fri, 08 May, 17:26
Dongjoon Hyun         Re: [VOTE] Release Spark 2.4.6 (RC1) Fri, 08 May, 18:40
Holden Karau           Re: [VOTE] Release Spark 2.4.6 (RC1) Sat, 09 May, 17:50
Takeshi Yamamuro             Re: [VOTE] Release Spark 2.4.6 (RC1) Mon, 11 May, 01:03
Yuanjian Li               Re: [VOTE] Release Spark 2.4.6 (RC1) Tue, 12 May, 14:28
Holden Karau                 Re: [VOTE] Release Spark 2.4.6 (RC1) Tue, 12 May, 14:38
Prashant Sharma                   Re: [VOTE] Release Spark 2.4.6 (RC1) Tue, 12 May, 14:49
Re: [VOTE] Apache Spark 3.0.0 RC1
Sean Owen   Re: [VOTE] Apache Spark 3.0.0 RC1 Fri, 08 May, 00:28
Xiao Li     Re: [VOTE] Apache Spark 3.0.0 RC1 Fri, 08 May, 00:40
Jungtaek Lim       Re: [VOTE] Apache Spark 3.0.0 RC1 Fri, 08 May, 02:48
ZHANG Wei Executor exceptions stacktrace omitted by HotSpot in long running application Fri, 08 May, 06:15
Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s
Wenchen Fan   Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Fri, 08 May, 14:22
Jungtaek Lim     Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Mon, 11 May, 04:31
Xiao Li       Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Mon, 11 May, 07:28
JackyLee         Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Mon, 11 May, 08:06
Ryan Blue           Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Mon, 11 May, 20:06
Russell Spitzer             Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Mon, 11 May, 21:45
Jungtaek Lim               Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Mon, 11 May, 21:50
Jungtaek Lim                 Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Mon, 11 May, 22:12
Ryan Blue                   Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Mon, 11 May, 22:16
Wenchen Fan                     Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Tue, 12 May, 05:34
Jungtaek Lim                       Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Tue, 12 May, 08:32
Jungtaek Lim                         Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Tue, 12 May, 08:45
Ryan Blue                           Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Tue, 12 May, 17:45
Russell Spitzer                             Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Tue, 12 May, 18:09
Jungtaek Lim                               Re: [DISCUSS] Resolve ambiguous parser rule between two "create table"s Tue, 12 May, 23:22
zhangliyun Screen Shot 2020-05-11 at 5.28.03 AM Sun, 10 May, 21:41
Russell Spitzer   Re: Screen Shot 2020-05-11 at 5.28.03 AM Mon, 11 May, 00:55
zhangliyun     Re:Re: Screen Shot 2020-05-11 at 5.28.03 AM Mon, 11 May, 01:44
ZHANG Wei       Re: Re:Re: Screen Shot 2020-05-11 at 5.28.03 AM Mon, 11 May, 07:41
Russell Spitzer         Re: Re:Re: Screen Shot 2020-05-11 at 5.28.03 AM Mon, 11 May, 17:23
zhangliyun         Re:Re: Re:Re: Screen Shot 2020-05-11 at 5.28.03 AM Mon, 11 May, 20:47
ML Books Accessing temp tables Mon, 11 May, 07:35
unsubscribe
Chenguang He   unsubscribe Mon, 11 May, 22:14
Kiran B   unsubscribe Tue, 12 May, 08:50
刘杰     unsubscribe Wed, 13 May, 02:21
淘米旺旺   unsubscribe Sun, 24 May, 13:37
Matei Zaharia ASF board report draft for May Tue, 12 May, 00:24
Russell Spitzer [Datasource V2] Exception Handling for Catalogs - Naming Suggestions Tue, 12 May, 16:16
Wenchen Fan   Re: [Datasource V2] Exception Handling for Catalogs - Naming Suggestions Wed, 13 May, 15:22
Neerav Kumar Clarification on Spark code comments Wed, 13 May, 02:07
Russell Spitzer [DatasourceV2] Allowing Partial Writes to DSV2 Tables Wed, 13 May, 21:57
Ryan Blue   Re: [DatasourceV2] Allowing Partial Writes to DSV2 Tables Wed, 13 May, 22:13
Russell Spitzer     Re: [DatasourceV2] Allowing Partial Writes to DSV2 Tables Wed, 13 May, 22:17
Wenchen Fan       Re: [DatasourceV2] Allowing Partial Writes to DSV2 Tables Thu, 14 May, 05:10
Russell Spitzer         Re: [DatasourceV2] Allowing Partial Writes to DSV2 Tables Thu, 14 May, 11:57
Ryan Blue           Re: [DatasourceV2] Allowing Partial Writes to DSV2 Tables Thu, 14 May, 20:19
shane knapp ☠ [build system] jenkins rebooting now Thu, 14 May, 16:11
shane knapp ☠   Re: [build system] jenkins rebooting now Thu, 14 May, 16:50
Xiao Li     Re: [build system] jenkins rebooting now Thu, 14 May, 16:51
Dongjoon Hyun       Re: [build system] jenkins rebooting now Thu, 14 May, 17:29
Hyukjin Kwon         Re: [build system] jenkins rebooting now Thu, 14 May, 17:57
Sudharshann D ./dev/run-tests failing at master Thu, 14 May, 18:20
Sean Owen   Re: ./dev/run-tests failing at master Thu, 14 May, 18:39
Jeff Evans   Re: ./dev/run-tests failing at master Thu, 14 May, 18:46
suddhu     Re: ./dev/run-tests failing at master Thu, 14 May, 18:57
shane knapp ☠       Re: ./dev/run-tests failing at master Thu, 14 May, 19:59
suddhu         Re: ./dev/run-tests failing at master Thu, 14 May, 21:00
suddhu           Re: ./dev/run-tests failing at master Fri, 15 May, 01:01
suddhu     Re: ./dev/run-tests failing at master Thu, 14 May, 19:14
zhangliyun is there any mentrics to show the usage of executor on memory or CPU Fri, 15 May, 22:33
Holden Karau [VOTE] Release Spark 2.4.6 (RC3) Sat, 16 May, 05:07
Prashant Sharma   Re: [VOTE] Release Spark 2.4.6 (RC3) Sun, 17 May, 12:16
Sean Owen   Re: [VOTE] Release Spark 2.4.6 (RC3) Sun, 17 May, 14:39
DB Tsai     Re: [VOTE] Release Spark 2.4.6 (RC3) Sun, 17 May, 16:48
Wenchen Fan       Re: [VOTE] Release Spark 2.4.6 (RC3) Mon, 18 May, 13:04
Tom Graves         Re: [VOTE] Release Spark 2.4.6 (RC3) Mon, 18 May, 14:21
Xiao Li           Re: [VOTE] Release Spark 2.4.6 (RC3) Mon, 18 May, 14:40
Holden Karau             Re: [VOTE] Release Spark 2.4.6 (RC3) Mon, 18 May, 16:25
Sean Owen               Re: [VOTE] Release Spark 2.4.6 (RC3) Mon, 18 May, 21:12
Holden Karau                 Re: [VOTE] Release Spark 2.4.6 (RC3) Mon, 18 May, 21:47
DB Tsai                   Re: [VOTE] Release Spark 2.4.6 (RC3) Mon, 18 May, 21:58
Holden Karau                     Re: [VOTE] Release Spark 2.4.6 (RC3) Mon, 18 May, 21:59
Ismaël Mejía                       Re: [VOTE] Release Spark 2.4.6 (RC3) Sat, 30 May, 13:52
Sean Owen                         Re: [VOTE] Release Spark 2.4.6 (RC3) Sun, 31 May, 23:09
Holden Karau                           Re: [VOTE] Release Spark 2.4.6 (RC3) Sun, 31 May, 23:39
rahul c Applying schema dynamically in dataframe Sat, 16 May, 06:15
ZHANG Wei   Re: Applying schema dynamically in dataframe Mon, 18 May, 06:03
kanchan pradhan PyCharm 2020 :: pyspark installation issue Sat, 16 May, 06:22
ch...@cmartinit.co.uk   Re: PyCharm 2020 :: pyspark installation issue Sat, 16 May, 09:04
suddhu scalastyle failing even after ./dev/scalafmt Sat, 16 May, 17:53
Sean Owen   Re: scalastyle failing even after ./dev/scalafmt Sat, 16 May, 18:03
suddhu     Re: scalastyle failing even after ./dev/scalafmt Sat, 16 May, 20:54
Sean Owen       Re: scalastyle failing even after ./dev/scalafmt Sun, 17 May, 01:21
Manu Zhang         Re: scalastyle failing even after ./dev/scalafmt Sun, 17 May, 02:50
Jeffrey Orihuela K8s with apache spark Mon, 18 May, 17:03
Reynold Xin [VOTE] Apache Spark 3.0 RC2 Mon, 18 May, 20:43
Jungtaek Lim   Re: [VOTE] Apache Spark 3.0 RC2 Tue, 19 May, 00:05
Sean Owen   Re: [VOTE] Apache Spark 3.0 RC2 Tue, 19 May, 14:48
rickestcode   Re: [VOTE] Apache Spark 3.0 RC2 Wed, 20 May, 06:39
Wenchen Fan     Re: [VOTE] Apache Spark 3.0 RC2 Wed, 20 May, 07:13
Ryan Blue       Re: [VOTE] Apache Spark 3.0 RC2 Wed, 20 May, 17:00
Ryan Blue         Re: [VOTE] Apache Spark 3.0 RC2 Wed, 20 May, 17:11
Jungtaek Lim           Re: [VOTE] Apache Spark 3.0 RC2 Fri, 22 May, 03:05
Koert Kuipers             Re: [VOTE] Apache Spark 3.0 RC2 Fri, 22 May, 14:40
Xiao Li               Re: [VOTE] Apache Spark 3.0 RC2 Fri, 22 May, 15:08
王斐   Re: [VOTE] Apache Spark 3.0 RC2 Fri, 22 May, 21:54
Hyukjin Kwon     Re: [VOTE] Apache Spark 3.0 RC2 Sat, 23 May, 00:19
Ryan Blue       Re: [VOTE] Apache Spark 3.0 RC2 Sat, 23 May, 18:34
Jungtaek Lim [DISCUSS] "complete" streaming output mode Tue, 19 May, 03:44
Shixiong(Ryan) Zhu   Re: [DISCUSS] "complete" streaming output mode Thu, 21 May, 00:45
Jungtaek Lim     Re: [DISCUSS] "complete" streaming output mode Thu, 21 May, 05:29
Burak Yavuz       Re: [DISCUSS] "complete" streaming output mode Thu, 21 May, 06:32
Jungtaek Lim         Re: [DISCUSS] "complete" streaming output mode Thu, 21 May, 07:30
Jungtaek Lim [DISCUSS] remove the incomplete code path on aggregation for continuous mode Tue, 19 May, 04:14
Jungtaek Lim   Re: [DISCUSS] remove the incomplete code path on aggregation for continuous mode Wed, 20 May, 23:54
help Tue, 19 May, 08:27
Russell Spitzer [DatasourceV2] Default Mode for DataFrameWriter not Dependent on DataSource Version Wed, 20 May, 21:50
Burak Yavuz   Re: [DatasourceV2] Default Mode for DataFrameWriter not Dependent on DataSource Version Wed, 20 May, 21:59
Ryan Blue   Re: [DatasourceV2] Default Mode for DataFrameWriter not Dependent on DataSource Version Wed, 20 May, 22:00
Russell Spitzer     Re: [DatasourceV2] Default Mode for DataFrameWriter not Dependent on DataSource Version Wed, 20 May, 22:07
Russell Spitzer       Re: [DatasourceV2] Default Mode for DataFrameWriter not Dependent on DataSource Version Thu, 21 May, 16:28
Stephen Coy Weird ClassCastException when using generics from Java Fri, 22 May, 04:26
Sean Owen   Re: Weird ClassCastException when using generics from Java Fri, 22 May, 13:22
Stephen Coy     Re: Weird ClassCastException when using generics from Java Sun, 24 May, 22:40
Edgar Klerks SPARK-23443 - Spark with Glue as external catalog Fri, 22 May, 08:12
Edgar Klerks   Re: SPARK-23443 - Spark with Glue as external catalog Sun, 24 May, 18:58
Vipul Rajan Spark behavior with changing data source Fri, 22 May, 17:55
沉黙dē羔羊 join Apache Spark Community Sat, 23 May, 15:24
Antonin Delpeuch (lists) Map with state for RDDs Sun, 24 May, 08:58
Antonin Delpeuch (lists)   Re: Map with state for RDDs Sun, 24 May, 09:27
Antonin Delpeuch (lists)     Re: Map with state for RDDs Sun, 24 May, 09:34
淘米旺旺 unsubscription Sun, 24 May, 13:42
Message list1 · 2 · Next »Thread · Author · Date
Box list
Apr 202153
Mar 2021208
Feb 2021210
Jan 2021118
Dec 202068
Nov 202098
Oct 2020115
Sep 2020147
Aug 2020173
Jul 2020246
Jun 2020215
May 2020198
Apr 2020140
Mar 2020201
Feb 2020182
Jan 2020196
Dec 2019184
Nov 2019215
Oct 2019229
Sep 2019241
Aug 2019236
Jul 2019138
Jun 2019147
May 2019168
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333