spark-dev mailing list archives: September 2019

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Re: Design review of SPARK-28594
Felix Cheung   Re: Design review of SPARK-28594 Sun, 01 Sep, 17:16
Jungtaek Lim     Re: Design review of SPARK-28594 Sun, 01 Sep, 23:26
Koert Kuipers concurrent writes with dynamic partition overwrite mode Sun, 01 Sep, 18:53
Koert Kuipers   Re: concurrent writes with dynamic partition overwrite mode Mon, 02 Sep, 04:00
Steve Loughran   Re: concurrent writes with dynamic partition overwrite mode Thu, 05 Sep, 11:30
Dongjoon Hyun [ANNOUNCE] Announcing Apache Spark 2.4.4 Sun, 01 Sep, 21:54
Wenchen Fan   Re: [ANNOUNCE] Announcing Apache Spark 2.4.4 Mon, 02 Sep, 04:27
Hyukjin Kwon     Re: [ANNOUNCE] Announcing Apache Spark 2.4.4 Mon, 02 Sep, 05:16
Peter Liu   Re: read image or binary files / spark 2.3 Thu, 05 Sep, 18:13
Ilya Matiach     RE: read image or binary files / spark 2.3 Thu, 05 Sep, 19:09
Peter Liu       Re: read binary files (for stream reader) / spark 2.3 Mon, 09 Sep, 14:07
Re: [DISCUSSION]JDK11 for Apache 2.x?
Holden Karau   Re: [DISCUSSION]JDK11 for Apache 2.x? Mon, 02 Sep, 02:04
Sean Owen     Re: [DISCUSSION]JDK11 for Apache 2.x? Mon, 02 Sep, 02:14
Re: [SS]Kafka EOS transaction timeout solution
Genmao Yu   Re: [SS]Kafka EOS transaction timeout solution Tue, 03 Sep, 03:39
wenxuan Guan     Re: [SS]Kafka EOS transaction timeout solution Wed, 04 Sep, 06:49
Re: [SS] KafkaSource doesn't use KafkaSourceInitialOffsetWriter for initial offsets?
Jacek Laskowski   Re: [SS] KafkaSource doesn't use KafkaSourceInitialOffsetWriter for initial offsets? Tue, 03 Sep, 11:56
Jacek Laskowski Why two netty libs? Tue, 03 Sep, 11:59
Sean Owen   Re: Why two netty libs? Tue, 03 Sep, 13:15
Shixiong(Ryan) Zhu     Re: Why two netty libs? Tue, 03 Sep, 16:18
Steve Loughran       Re: Why two netty libs? Wed, 04 Sep, 13:05
Sean Owen         Re: Why two netty libs? Wed, 04 Sep, 13:15
Jacek Laskowski           Re: Why two netty libs? Thu, 05 Sep, 15:29
maven 3.6.1 removed from apache maven repo
Tom Graves   maven 3.6.1 removed from apache maven repo Tue, 03 Sep, 17:58
Xiao Li     Re: maven 3.6.1 removed from apache maven repo Tue, 03 Sep, 18:39
Sean Owen       Re: maven 3.6.1 removed from apache maven repo Tue, 03 Sep, 18:58
Felix Cheung       Re: maven 3.6.1 removed from apache maven repo Tue, 03 Sep, 19:17
Gengliang Wang [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default Wed, 04 Sep, 05:59
Wenchen Fan   Re: [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default Thu, 05 Sep, 07:27
Reynold Xin     Re: [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default Thu, 05 Sep, 16:17
Alastair Green       Re: [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default Fri, 06 Sep, 10:11
Ryan Blue         Re: [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default Sat, 07 Sep, 00:27
Felix Cheung           Re: [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default Mon, 09 Sep, 00:00
Wenchen Fan             Re: [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default Thu, 12 Sep, 06:09
Gengliang Wang               Re: [VOTE][SPARK-28885] Follow ANSI store assignment rules in table insertion by default Thu, 12 Sep, 08:00
El Houssain ALLAMI Schema inference for nested case class issue Wed, 04 Sep, 11:40
Sean Owen   Re: Schema inference for nested case class issue Wed, 04 Sep, 12:38
Thomas graves [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling Wed, 04 Sep, 14:24
Bobby Evans   Re: [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling Wed, 11 Sep, 13:35
Felix Cheung   Re: [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling Wed, 11 Sep, 16:37
Ryan Blue     Re: [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling Wed, 11 Sep, 17:04
Bryan Cutler       Re: [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling Wed, 11 Sep, 18:10
Thomas Graves         Re: [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling Fri, 13 Sep, 16:59
Dongjoon Hyun           Re: [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling Fri, 13 Sep, 19:26
Shubham Chaurasia DataSourceV2: pushFilters() is not invoked for each read call - spark 2.3.2 Fri, 06 Sep, 06:24
Hyukjin Kwon   Re: DataSourceV2: pushFilters() is not invoked for each read call - spark 2.3.2 Fri, 06 Sep, 07:20
Arwin Tio DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading S3 files Fri, 06 Sep, 12:09
Sean Owen   Re: DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading S3 files Fri, 06 Sep, 13:50
Steve Loughran     Re: DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading S3 files Fri, 06 Sep, 20:15
Arwin Tio       Re: DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading S3 files Fri, 06 Sep, 21:56
Steve Loughran         Re: DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading S3 files Sat, 07 Sep, 13:22
Arwin Tio         Re: DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading S3 files Mon, 23 Sep, 08:14
Re: [VOTE][RESULT] Spark 2.3.4 (RC1)
Nicholas Marion   Re: [VOTE][RESULT] Spark 2.3.4 (RC1) Fri, 06 Sep, 16:01
Kazuaki Ishizaki   Re: [VOTE][RESULT] Spark 2.3.4 (RC1) Sat, 07 Sep, 15:07
Wenchen Fan     Re: [VOTE][RESULT] Spark 2.3.4 (RC1) Mon, 09 Sep, 03:24
Wenchen Fan       Re: [VOTE][RESULT] Spark 2.3.4 (RC1) Mon, 09 Sep, 07:50
Kazuaki Ishizaki         RE: [VOTE][RESULT] Spark 2.3.4 (RC1) Mon, 09 Sep, 08:57
Wenchen Fan           Re: [VOTE][RESULT] Spark 2.3.4 (RC1) Mon, 09 Sep, 09:59
Ryan Blue DSv2 sync - 4 September 2019 Fri, 06 Sep, 22:28
Nicholas Chammas   Re: DSv2 sync - 4 September 2019 Sun, 08 Sep, 16:45
Wenchen Fan     Re: DSv2 sync - 4 September 2019 Mon, 09 Sep, 10:05
Nicholas Chammas       Re: DSv2 sync - 4 September 2019 Mon, 09 Sep, 12:21
angers.zhu [Spark SQL] Any intersted in do SQL between two hive metastore. Sat, 07 Sep, 12:51
Hyukjin Kwon Resolving all JIRAs affecting EOL releases Sun, 08 Sep, 03:15
Takeshi Yamamuro   Re: Resolving all JIRAs affecting EOL releases Sun, 08 Sep, 04:31
Hyukjin Kwon     Re: Resolving all JIRAs affecting EOL releases Sun, 08 Sep, 04:54
Takeshi Yamamuro       Re: Resolving all JIRAs affecting EOL releases Sun, 08 Sep, 05:09
Sean Owen   Re: Resolving all JIRAs affecting EOL releases Sun, 08 Sep, 23:27
Dongjoon Hyun     Re: Resolving all JIRAs affecting EOL releases Mon, 09 Sep, 00:45
Hyukjin Kwon       Re: Resolving all JIRAs affecting EOL releases Mon, 09 Sep, 00:46
Ankit Kumar send this email to unsubscribe Sun, 08 Sep, 17:11
unsubscribe
Mario Amatucci   unsubscribe Mon, 09 Sep, 09:45
Mario Amatucci   unsubscribe Thu, 19 Sep, 07:21
Matei Zaharia Welcoming some new committers and PMC members Tue, 10 Sep, 00:31
Xiao Li   Re: Welcoming some new committers and PMC members Tue, 10 Sep, 00:40
Takuya UESHIN     Re: Welcoming some new committers and PMC members Tue, 10 Sep, 00:41
Younggyu Chun       Re: Welcoming some new committers and PMC members Tue, 10 Sep, 00:49
Shane Knapp   Re: Welcoming some new committers and PMC members Tue, 10 Sep, 00:45
Takeshi Yamamuro     Re: Welcoming some new committers and PMC members Tue, 10 Sep, 00:49
John Zhuge     Re: Welcoming some new committers and PMC members Tue, 10 Sep, 00:51
Jungtaek Lim       Re: Welcoming some new committers and PMC members Tue, 10 Sep, 01:11
Saisai Shao         Re: Welcoming some new committers and PMC members Tue, 10 Sep, 01:15
Jeff Zhang           Re: Welcoming some new committers and PMC members Tue, 10 Sep, 01:19
Ye Xianjin             Re: Welcoming some new committers and PMC members Tue, 10 Sep, 01:26
王 斐               Re: Welcoming some new committers and PMC members Tue, 10 Sep, 01:27
Joseph Torres                 Re: Welcoming some new committers and PMC members Tue, 10 Sep, 01:30
Haibo                   回复: Welcoming some new committers and PMC members Tue, 10 Sep, 01:56
sujith chacko                     Re: Welcoming some new committers and PMC members Tue, 10 Sep, 02:14
Yuanjian Li                       Re: Welcoming some new committers and PMC members Tue, 10 Sep, 02:18
Wenchen Fan                         Re: Welcoming some new committers and PMC members Tue, 10 Sep, 02:49
Xingbo Jiang                           Re: Welcoming some new committers and PMC members Tue, 10 Sep, 04:13
Sean Lin                             Re: Welcoming some new committers and PMC members Tue, 10 Sep, 04:20
Mingjie Tang         Re: Welcoming some new committers and PMC members Tue, 10 Sep, 01:26
angers.zhu   Re: Welcoming some new committers and PMC members Tue, 10 Sep, 01:24
Duan,Bing   unsubscribe Tue, 10 Sep, 01:50
Kazuaki Ishizaki   Re: Welcoming some new committers and PMC members Tue, 10 Sep, 04:24
Dilip Biswal     RE: Welcoming some new committers and PMC members Tue, 10 Sep, 07:31
Gabor Somogyi   Re: Welcoming some new committers and PMC members Tue, 10 Sep, 08:21
Driesprong, Fokko     Re: Welcoming some new committers and PMC members Tue, 10 Sep, 10:20
Stavros Kontopoulos       Re: Welcoming some new committers and PMC members Tue, 10 Sep, 11:48
Furkan KAMACI         Re: Welcoming some new committers and PMC members Thu, 12 Sep, 09:55
Jacek Laskowski   Re: Welcoming some new committers and PMC members Thu, 12 Sep, 10:31
Bryan Cutler     Re: Welcoming some new committers and PMC members Tue, 17 Sep, 22:51
Li Jin       Re: Welcoming some new committers and PMC members Tue, 17 Sep, 22:53
Kazuaki Ishizaki [ANNOUNCE] Announcing Apache Spark 2.3.4 Tue, 10 Sep, 04:37
Jason Guo [DISCUSS][SPIP][SPARK-29031] Materialized columns Tue, 10 Sep, 09:47
Wenchen Fan   Re: [DISCUSS][SPIP][SPARK-29031] Materialized columns Mon, 16 Sep, 04:50
Lantao Jin (Jira) [jira] Lantao Jin shared "SPARK-29038: SPIP: Support Spark Materialized View" with you Tue, 10 Sep, 13:08
Alaa Zbair Request for contributor permissions Tue, 10 Sep, 19:36
Takeshi Yamamuro   Re: Request for contributor permissions Tue, 10 Sep, 20:04
Re: script running in jupyter 6-7x faster than spark submit
Dhrubajyoti Hati   Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 03:05
Stephen Boesch     Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 03:16
Dhrubajyoti Hati       Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 03:25
Stephen Boesch         Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 03:32
Abdeali Kothari       Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 03:28
Dhrubajyoti Hati         Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 04:15
Dhrubajyoti Hati           Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 07:17
Dhrubajyoti Hati             Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 14:03
Abdeali Kothari               Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 14:52
Dhrubajyoti Hati                 Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 16:58
Dhrubajyoti Hati                   Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 17:02
Abdeali Kothari                     Re: script running in jupyter 6-7x faster than spark submit Wed, 11 Sep, 17:40
Re: Python API for mapGroupsWithState
Stavros Kontopoulos   Re: Python API for mapGroupsWithState Wed, 11 Sep, 13:13
Sean Owen Thoughts on Spark 3 release, or a preview release Wed, 11 Sep, 18:37
Michael Heuer   Re: Thoughts on Spark 3 release, or a preview release Wed, 11 Sep, 18:54
Dongjoon Hyun     Re: Thoughts on Spark 3 release, or a preview release Thu, 12 Sep, 00:07
Hyukjin Kwon       Re: Thoughts on Spark 3 release, or a preview release Thu, 12 Sep, 00:40
Jean Georges Perrin         Re: Thoughts on Spark 3 release, or a preview release Thu, 12 Sep, 00:52
Jungtaek Lim           Re: Thoughts on Spark 3 release, or a preview release Thu, 12 Sep, 23:09
John Zhuge             Re: Thoughts on Spark 3 release, or a preview release Thu, 12 Sep, 23:15
Matt Cheah               Re: Thoughts on Spark 3 release, or a preview release Thu, 12 Sep, 23:19
Holden Karau               Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 00:26
Reynold Xin                 Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 00:32
Driesprong, Fokko                   Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 08:07
Stavros Kontopoulos                     Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 09:55
Thomas Graves                       Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 16:58
Ilan Filonenko                         Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 18:11
Michael Heuer                     Re: Thoughts on Spark 3 release, or a preview release Mon, 16 Sep, 14:57
Sean Owen                   Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 18:21
Xingbo Jiang                     Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 18:30
Dongjoon Hyun                       Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 19:26
Ryan Blue                         Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 20:07
Andrew Melo                           Re: Thoughts on Spark 3 release, or a preview release Fri, 13 Sep, 21:26
Sean Owen                             Re: Thoughts on Spark 3 release, or a preview release Sat, 14 Sep, 14:15
Wenchen Fan                               Re: Thoughts on Spark 3 release, or a preview release Mon, 16 Sep, 03:09
Erik Erlandson   Re: Thoughts on Spark 3 release, or a preview release Mon, 16 Sep, 19:22
Xiao Li     Re: Thoughts on Spark 3 release, or a preview release Tue, 17 Sep, 06:59
Matt Cheah       Re: Thoughts on Spark 3 release, or a preview release Tue, 17 Sep, 18:34
Mats Rydberg         Re: Thoughts on Spark 3 release, or a preview release Thu, 19 Sep, 08:38
Re: Ask for ARM CI for spark
Tianhua huang   Re: Ask for ARM CI for spark Thu, 12 Sep, 03:06
Sean Owen     Re: Ask for ARM CI for spark Thu, 12 Sep, 13:36
Tianhua huang       Re: Ask for ARM CI for spark Mon, 16 Sep, 04:03
Shane Knapp         Re: Ask for ARM CI for spark Mon, 16 Sep, 20:39
Tianhua huang           Re: Ask for ARM CI for spark Tue, 17 Sep, 06:48
Dongjoon Hyun             Re: Ask for ARM CI for spark Wed, 18 Sep, 16:44
Tianhua huang               Re: Ask for ARM CI for spark Thu, 19 Sep, 02:59
bo zhaobo                 Re: Ask for ARM CI for spark Mon, 23 Sep, 03:55
Thomas graves [RESULT][VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling Sat, 14 Sep, 03:02
Thomas graves   Re: [RESULT][VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling Sat, 14 Sep, 16:37
Vipul Rajan Documentation on org.apache.spark.sql.functions backend. Mon, 16 Sep, 06:27
Marco Gaido   Re: Documentation on org.apache.spark.sql.functions backend. Mon, 16 Sep, 08:07
Vipul Rajan     Re: Documentation on org.apache.spark.sql.functions backend. Mon, 16 Sep, 08:44
Marco Gaido       Re: Documentation on org.apache.spark.sql.functions backend. Mon, 16 Sep, 09:03
Shane Knapp [build system] jenkins wedged, restarting now Mon, 16 Sep, 18:02
Shane Knapp   Re: [build system] jenkins wedged, restarting now Mon, 16 Sep, 18:07
Jungtaek Lim Weird build failures in PR builder Tue, 17 Sep, 02:13
Shane Knapp   Re: Weird build failures in PR builder Tue, 17 Sep, 04:08
Jungtaek Lim     Re: Weird build failures in PR builder Tue, 17 Sep, 04:13
Shane Knapp       Re: Weird build failures in PR builder Tue, 17 Sep, 04:15
Shane Knapp [build system] short (~1hr max) downtime Tue, 17 Sep, 17:14
Shane Knapp   Re: [build system] short (~1hr max) downtime Tue, 17 Sep, 18:51
Shane Knapp [build system] weird mvn errors post-cache cleaning Tue, 17 Sep, 19:41
Sean Owen   Re: [build system] weird mvn errors post-cache cleaning Tue, 17 Sep, 19:52
Shane Knapp     Re: [build system] weird mvn errors post-cache cleaning Tue, 17 Sep, 19:53
Shane Knapp       Re: [build system] weird mvn errors post-cache cleaning Tue, 17 Sep, 19:57
Shane Knapp         Re: [build system] weird mvn errors post-cache cleaning Tue, 17 Sep, 19:57
Dongjoon Hyun           Re: [build system] weird mvn errors post-cache cleaning Tue, 17 Sep, 21:35
Jungtaek Lim FYI - filed bunch of issues for flaky tests in recent CI builds Wed, 18 Sep, 05:54
Gabor Somogyi   Re: FYI - filed bunch of issues for flaky tests in recent CI builds Wed, 18 Sep, 07:17
Shubham Chaurasia Incorrect results in left_outer join in DSv2 implementation with filter pushdown - spark 2.3.2 Thu, 19 Sep, 13:24
Tomas Bartalos Parquet read performance for different schemas Thu, 19 Sep, 16:10
Tomas Bartalos   Re: Parquet read performance for different schemas Fri, 20 Sep, 09:36
Xingbo Jiang Spark 3.0 preview release on-going features discussion Fri, 20 Sep, 07:45
Wenchen Fan   Re: Spark 3.0 preview release on-going features discussion Fri, 20 Sep, 08:06
Sean Owen   Re: Spark 3.0 preview release on-going features discussion Fri, 20 Sep, 13:22
Dongjoon Hyun     Re: Spark 3.0 preview release on-going features discussion Fri, 20 Sep, 16:55
Ryan Blue       Re: Spark 3.0 preview release on-going features discussion Fri, 20 Sep, 17:55
Xingbo Jiang         Re: Spark 3.0 preview release on-going features discussion Mon, 23 Sep, 20:48
Georg Heiler custom FileStreamSource which reads from one partition onwards Fri, 20 Sep, 14:25
Ryan Blue DSv2 sync notes - 28 September 2019 Fri, 20 Sep, 17:36
Message list1 · 2 · Next »Thread · Author · Date
Box list
Nov 202089
Oct 2020115
Sep 2020147
Aug 2020173
Jul 2020246
Jun 2020215
May 2020198
Apr 2020140
Mar 2020201
Feb 2020182
Jan 2020196
Dec 2019184
Nov 2019215
Oct 2019229
Sep 2019241
Aug 2019236
Jul 2019138
Jun 2019147
May 2019168
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333