spark-dev mailing list archives: November 2017

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Xin Lu Jenkins upgrade/Test Parallelization & Containerization Wed, 01 Nov, 06:05
Holden Karau   Re: Jenkins upgrade/Test Parallelization & Containerization Tue, 07 Nov, 19:20
Holden Karau     Re: Jenkins upgrade/Test Parallelization & Containerization Tue, 07 Nov, 19:21
Sean Owen   Re: Jenkins upgrade/Test Parallelization & Containerization Tue, 07 Nov, 20:52
Holden Karau     Re: Jenkins upgrade/Test Parallelization & Containerization Tue, 07 Nov, 22:14
Reynold Xin       Re: Jenkins upgrade/Test Parallelization & Containerization Wed, 08 Nov, 00:04
Holden Karau         Re: Jenkins upgrade/Test Parallelization & Containerization Wed, 08 Nov, 00:31
Felix Cheung       Re: Jenkins upgrade/Test Parallelization & Containerization Wed, 08 Nov, 04:25
Sean Owen         Re: Jenkins upgrade/Test Parallelization & Containerization Wed, 08 Nov, 09:57
Xin Lu           Re: Jenkins upgrade/Test Parallelization & Containerization Thu, 09 Nov, 23:08
shane knapp             Re: Jenkins upgrade/Test Parallelization & Containerization Mon, 13 Nov, 01:36
Anton Okolnychyi [SS] Custom Sinks Wed, 01 Nov, 09:41
Reynold Xin   Re: [SS] Custom Sinks Wed, 01 Nov, 12:06
Reynold Xin [Vote] SPIP: Continuous Processing Mode for Structured Streaming Wed, 01 Nov, 15:37
Debasish Das   Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Wed, 01 Nov, 16:29
Reynold Xin     Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Wed, 01 Nov, 16:32
Cody Koeninger       Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Wed, 01 Nov, 16:50
Reynold Xin         Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Wed, 01 Nov, 17:31
Tom Graves     Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Mon, 06 Nov, 15:29
Reynold Xin       Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Tue, 07 Nov, 01:09
Noman Khan   Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Wed, 01 Nov, 23:33
Sean Owen   Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Thu, 02 Nov, 08:01
Wenchen Fan     Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Fri, 03 Nov, 23:59
Matei Zaharia       Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Sat, 04 Nov, 00:04
Weichen Xu         Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Sat, 04 Nov, 01:14
vaquar khan           Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Sat, 04 Nov, 05:02
Burak Yavuz             Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Sat, 04 Nov, 18:00
Xiao Li               Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Sat, 04 Nov, 18:02
Michael Armbrust                 Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Tue, 07 Nov, 01:11
Joseph Bradley                   Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Tue, 07 Nov, 21:34
Shixiong(Ryan) Zhu                     Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Tue, 07 Nov, 22:40
Saisai Shao                       Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Wed, 08 Nov, 06:42
Reynold Xin   Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming Wed, 08 Nov, 01:49
Yinan Li Announcing Spark on Kubernetes release 0.5.0 Wed, 01 Nov, 16:49
Henry Robinson SPARK-22211: Removing an incorrect FOJ optimization Wed, 01 Nov, 21:47
Re: HashingTFModel/IDFModel in Structured Streaming
Bago Amirbekian   Re: HashingTFModel/IDFModel in Structured Streaming Wed, 01 Nov, 23:42
Davis Varghese     Re: HashingTFModel/IDFModel in Structured Streaming Thu, 02 Nov, 03:53
Bago Amirbekian       Re: HashingTFModel/IDFModel in Structured Streaming Thu, 09 Nov, 19:25
Davis Varghese         Re: HashingTFModel/IDFModel in Structured Streaming Fri, 10 Nov, 06:17
Davis Varghese         Re: HashingTFModel/IDFModel in Structured Streaming Mon, 13 Nov, 01:37
Bago Amirbekian           Re: HashingTFModel/IDFModel in Structured Streaming Wed, 15 Nov, 01:11
Jorge Sánchez             Re: HashingTFModel/IDFModel in Structured Streaming Wed, 15 Nov, 21:54
Davis Varghese               Re: HashingTFModel/IDFModel in Structured Streaming Thu, 16 Nov, 12:52
Davis Varghese             Re: HashingTFModel/IDFModel in Structured Streaming Thu, 16 Nov, 06:16
Davis Varghese             Re: HashingTFModel/IDFModel in Structured Streaming Thu, 16 Nov, 07:48
RE: Kicking off the process around Spark 2.2.1
Kevin Grealish   RE: Kicking off the process around Spark 2.2.1 Thu, 02 Nov, 16:51
Felix Cheung     Re: Kicking off the process around Spark 2.2.1 Thu, 02 Nov, 17:24
Holden Karau       Re: Kicking off the process around Spark 2.2.1 Thu, 02 Nov, 17:38
Felix Cheung         Re: Kicking off the process around Spark 2.2.1 Thu, 02 Nov, 18:06
Holden Karau           Re: Kicking off the process around Spark 2.2.1 Thu, 02 Nov, 18:10
Sean Owen           Re: Kicking off the process around Spark 2.2.1 Thu, 02 Nov, 18:12
Reynold Xin             Re: Kicking off the process around Spark 2.2.1 Thu, 02 Nov, 19:12
Holden Karau               Re: Kicking off the process around Spark 2.2.1 Thu, 02 Nov, 19:47
Felix Cheung               Re: Kicking off the process around Spark 2.2.1 Wed, 08 Nov, 23:51
Pralabh Kumar Spark build is failing in amplab Jenkins Thu, 02 Nov, 17:39
Sean Owen   Re: Spark build is failing in amplab Jenkins Sat, 04 Nov, 08:15
Hyukjin Kwon     Re: Spark build is failing in amplab Jenkins Sat, 04 Nov, 08:23
Xin Lu       Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 04:09
Xin Lu         Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 04:15
Frank Austin Nothaft           Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 04:19
Xin Lu             Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 04:25
Frank A Nothaft               Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 05:50
Frank Austin Nothaft                 Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 06:50
Xin Lu                   Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 16:15
Xin Lu                     Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 16:45
Xin Lu                       Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 17:01
shane knapp                         Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 17:20
Josh Rosen                           Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 17:40
Xin Lu                             Re: Spark build is failing in amplab Jenkins Sun, 05 Nov, 18:06
Chetan Khatri Joining 3 tables with 17 billions records Thu, 02 Nov, 19:57
Jörn Franke   Re: Joining 3 tables with 17 billions records Thu, 02 Nov, 20:01
Chetan Khatri     Re: Joining 3 tables with 17 billions records Thu, 02 Nov, 20:08
Jörn Franke       Re: Joining 3 tables with 17 billions records Thu, 02 Nov, 20:46
knowsnothing Accessing DataFrame inside UserDefinedFunction. Sun, 05 Nov, 02:41
knowsnothing   RE: Accessing DataFrame inside UserDefinedFunction. Sun, 05 Nov, 14:03
Re: Catalyst dependency on Spark Core
piyush.mukati   Re: Catalyst dependency on Spark Core Mon, 06 Nov, 07:21
Marco Gaido [ML] Migrating transformers from mllib to ml Mon, 06 Nov, 14:58
颜发才(Yan Facai)   Re: [ML] Migrating transformers from mllib to ml Tue, 07 Nov, 08:38
Joseph Bradley     Re: [ML] Migrating transformers from mllib to ml Tue, 07 Nov, 21:37
Felix Cheung Cutting the RC for Spark 2.2.1 release Wed, 08 Nov, 23:57
Holden Karau   Re: Cutting the RC for Spark 2.2.1 release Thu, 09 Nov, 01:51
Dongjoon Hyun     Re: Cutting the RC for Spark 2.2.1 release Thu, 09 Nov, 03:41
Felix Cheung     Re: Cutting the RC for Spark 2.2.1 release Thu, 09 Nov, 05:12
Felix Cheung   Re: Cutting the RC for Spark 2.2.1 release Mon, 13 Nov, 08:00
Felix Cheung     Re: Cutting the RC for Spark 2.2.1 release Mon, 13 Nov, 18:36
Holden Karau       Re: Cutting the RC for Spark 2.2.1 release Mon, 13 Nov, 18:38
Felix Cheung         Re: Cutting the RC for Spark 2.2.1 release Mon, 13 Nov, 18:39
Sean Owen           Re: Cutting the RC for Spark 2.2.1 release Mon, 13 Nov, 18:47
Felix Cheung           Re: Cutting the RC for Spark 2.2.1 release Mon, 13 Nov, 18:52
Sean Owen             Re: Cutting the RC for Spark 2.2.1 release Mon, 13 Nov, 18:54
Felix Cheung             Re: Cutting the RC for Spark 2.2.1 release Mon, 13 Nov, 19:23
Felix Cheung             Re: Cutting the RC for Spark 2.2.1 release Tue, 14 Nov, 13:02
Jan-Hendrik Zab Task failures and other problems Thu, 09 Nov, 19:04
Jörn Franke   Re: Task failures and other problems Thu, 09 Nov, 19:47
Jan-Hendrik Zab     Re: Task failures and other problems Thu, 09 Nov, 21:28
Vadim Semenov       Re: Task failures and other problems Thu, 09 Nov, 22:38
Jörn Franke         Re: Task failures and other problems Thu, 09 Nov, 23:31
Michael Armbrust Timeline for Spark 2.3 Thu, 09 Nov, 23:54
Justin Miller   Re: Timeline for Spark 2.3 Thu, 09 Nov, 23:56
Anirudh Ramanathan     Re: Timeline for Spark 2.3 Fri, 10 Nov, 00:04
Matei Zaharia       Re: Timeline for Spark 2.3 Fri, 10 Nov, 01:03
Erik Erlandson         Re: Timeline for Spark 2.3 Fri, 10 Nov, 01:13
Nick Pentreath           Re: Timeline for Spark 2.3 Fri, 10 Nov, 04:58
Marco Gaido             Re: Timeline for Spark 2.3 Fri, 10 Nov, 08:39
Sean Owen   Re: Timeline for Spark 2.3 Fri, 10 Nov, 10:07
Sameer Agarwal     Re: Timeline for Spark 2.3 Fri, 10 Nov, 19:55
dji...@dataxu.com       Re: Timeline for Spark 2.3 Tue, 14 Nov, 00:13
sunerhan1...@sina.com skip.header.line.count is ignored in HiveContext Fri, 10 Nov, 01:59
Dongjoon Hyun   Re: skip.header.line.count is ignored in HiveContext Fri, 10 Nov, 02:13
Chi Zewen How can I connect hawq using SparkSession? Fri, 10 Nov, 02:37
unsubscribe
Al Pivonka   unsubscribe Fri, 10 Nov, 14:41
Steve Johnston   unsubscribe Fri, 10 Nov, 15:35
marco rocchi   unsubscribe Fri, 10 Nov, 17:28
何琪   unsubscribe Mon, 13 Nov, 03:31
Gengliang Wang Spark-avro 4.0.0 is released Sat, 11 Nov, 01:23
Jorge Sánchez Some Spark MLLIB tests failing due to some classes not being registered with Kryo Sat, 11 Nov, 12:21
Marco Gaido   Re: Some Spark MLLIB tests failing due to some classes not being registered with Kryo Sat, 11 Nov, 12:46
Jorge Sánchez     Re: Some Spark MLLIB tests failing due to some classes not being registered with Kryo Sat, 11 Nov, 15:24
Cristian Lorenzetto how to replace hdfs with a custom distributed fs ? Sat, 11 Nov, 17:37
Reynold Xin   Re: how to replace hdfs with a custom distributed fs ? Sat, 11 Nov, 17:38
Cristian Lorenzetto is there a way for removing hadoop from spark Sat, 11 Nov, 17:42
yohann jardin   Re: is there a way for removing hadoop from spark Sat, 11 Nov, 18:30
Jörn Franke   Re: is there a way for removing hadoop from spark Sun, 12 Nov, 09:17
trs...@gmail.com     Re: is there a way for removing hadoop from spark Mon, 13 Nov, 03:36
Jörn Franke       Re: is there a way for removing hadoop from spark Mon, 13 Nov, 07:21
Sean Owen       Re: is there a way for removing hadoop from spark Mon, 13 Nov, 07:51
Barath Ramamoorthy Spark json data - avro schema validation Sun, 12 Nov, 03:49
Chetan Khatri Divide Spark Dataframe to parts by timestamp Sun, 12 Nov, 18:52
spark receiver Reload some static data during struct streaming Mon, 13 Nov, 21:21
Burak Yavuz   Re: Reload some static data during struct streaming Mon, 13 Nov, 21:49
spark receiver     Re: Reload some static data during struct streaming Mon, 13 Nov, 22:01
Takuya UESHIN [discuss][PySpark] Can we drop support old Pandas (<0.19.2) or what version should we support? Tue, 14 Nov, 10:13
Hyukjin Kwon   Re: [discuss][PySpark] Can we drop support old Pandas (<0.19.2) or what version should we support? Tue, 14 Nov, 11:04
Li Jin     Re: [discuss][PySpark] Can we drop support old Pandas (<0.19.2) or what version should we support? Tue, 14 Nov, 15:59
Takuya UESHIN       Re: [discuss][PySpark] Can we drop support old Pandas (<0.19.2) or what version should we support? Thu, 16 Nov, 06:11
Hyukjin Kwon         Re: [discuss][PySpark] Can we drop support old Pandas (<0.19.2) or what version should we support? Thu, 16 Nov, 08:34
Holden Karau           Re: [discuss][PySpark] Can we drop support old Pandas (<0.19.2) or what version should we support? Thu, 16 Nov, 11:52
Hyukjin Kwon             Re: [discuss][PySpark] Can we drop support old Pandas (<0.19.2) or what version should we support? Mon, 20 Nov, 05:35
Abdeali Kothari               Re: [discuss][PySpark] Can we drop support old Pandas (<0.19.2) or what version should we support? Mon, 20 Nov, 05:59
Reynold Xin                 Re: [discuss][PySpark] Can we drop support old Pandas (<0.19.2) or what version should we support? Mon, 20 Nov, 06:03
Takuya UESHIN                   Re: [discuss][PySpark] Can we drop support old Pandas (<0.19.2) or what version should we support? Tue, 21 Nov, 04:28
Mark Petruska SPARK-22267 issue: Spark SQL incorrectly reads ORC file when column order is different Tue, 14 Nov, 11:46
Dongjoon Hyun   Re: SPARK-22267 issue: Spark SQL incorrectly reads ORC file when column order is different Tue, 14 Nov, 17:58
Mark Petruska     Re: SPARK-22267 issue: Spark SQL incorrectly reads ORC file when column order is different Wed, 15 Nov, 10:54
Hyukjin Kwon [discuss][SQL] Partitioned column type inference proposal Tue, 14 Nov, 14:54
Wenchen Fan   Re: [discuss][SQL] Partitioned column type inference proposal Tue, 14 Nov, 16:33
Reynold Xin     Re: [discuss][SQL] Partitioned column type inference proposal Tue, 14 Nov, 22:29
Hyukjin Kwon       Re: [discuss][SQL] Partitioned column type inference proposal Wed, 15 Nov, 02:15
Hyukjin Kwon         Re: [discuss][SQL] Partitioned column type inference proposal Wed, 15 Nov, 07:50
Wenchen Fan           Re: [discuss][SQL] Partitioned column type inference proposal Wed, 15 Nov, 10:15
Hyukjin Kwon             Re: [discuss][SQL] Partitioned column type inference proposal Wed, 15 Nov, 12:22
Hyukjin Kwon               Re: [discuss][SQL] Partitioned column type inference proposal Wed, 15 Nov, 12:42
Ryan Blue                 Re: [discuss][SQL] Partitioned column type inference proposal Wed, 15 Nov, 16:41
Wenchen Fan                   Re: [discuss][SQL] Partitioned column type inference proposal Wed, 15 Nov, 16:51
Ryan Blue                     Re: [discuss][SQL] Partitioned column type inference proposal Wed, 15 Nov, 17:01
Hyukjin Kwon                       Re: [discuss][SQL] Partitioned column type inference proposal Tue, 21 Nov, 06:43
Reynold Xin                         Re: [discuss][SQL] Partitioned column type inference proposal Tue, 28 Nov, 04:38
Wenchen Fan                           Re: [discuss][SQL] Partitioned column type inference proposal Tue, 28 Nov, 05:25
Yash Sharma [spark-kinesis] [SPARK-20168] Requesting some attention for a review Wed, 15 Nov, 01:19
Re: Questions about the future of UDTs and Encoders
mlopez   Re: Questions about the future of UDTs and Encoders Wed, 15 Nov, 01:38
Grandjean Patrick     Re: Questions about the future of UDTs and Encoders Sun, 19 Nov, 01:51
Michael Lopez       Re: Questions about the future of UDTs and Encoders Sun, 19 Nov, 13:58
Felix Cheung [VOTE] Spark 2.2.1 (RC1) Wed, 15 Nov, 06:25
Xiao Li   Re: [VOTE] Spark 2.2.1 (RC1) Wed, 15 Nov, 17:12
Xiao Li     Re: [VOTE] Spark 2.2.1 (RC1) Wed, 15 Nov, 22:15
Felix Cheung       Re: [VOTE] Spark 2.2.1 (RC1) Thu, 16 Nov, 02:45
Sean Owen   Re: [VOTE] Spark 2.2.1 (RC1) Thu, 16 Nov, 03:01
Felix Cheung     Re: [VOTE] Spark 2.2.1 (RC1) Fri, 17 Nov, 16:51
Marcelo Vanzin       Re: [VOTE] Spark 2.2.1 (RC1) Fri, 17 Nov, 16:53
Felix Cheung   Re: [CANCEL] Spark 2.2.1 (RC1) Sun, 19 Nov, 23:35
Jacek Laskowski [SQL] Why no numOutputRows metric for LocalTableScanExec in webUI? Wed, 15 Nov, 21:14
Jacek Laskowski   Re: [SQL] Why no numOutputRows metric for LocalTableScanExec in webUI? Thu, 16 Nov, 09:53
Shixiong(Ryan) Zhu     Re: [SQL] Why no numOutputRows metric for LocalTableScanExec in webUI? Fri, 17 Nov, 01:30
Jacek Laskowski       Re: [SQL] Why no numOutputRows metric for LocalTableScanExec in webUI? Fri, 17 Nov, 08:04
Andrew Andrade Faster and Lower memory implementation toPandas Thu, 16 Nov, 15:27
Reynold Xin   Re: Faster and Lower memory implementation toPandas Thu, 16 Nov, 17:01
gmcrosh   Re: Faster and Lower memory implementation toPandas Mon, 20 Nov, 16:32
Siddharth Murching [ML] Spark Package Release: Deep Learning Pipelines 0.2.0 Thu, 16 Nov, 21:29
Holden Karau Thoughts on extedning ML exporting in Spark? Sat, 18 Nov, 22:55
Sean Owen   Re: Thoughts on extedning ML exporting in Spark? Sun, 19 Nov, 14:01
Timur Shenkao     Re: Thoughts on extedning ML exporting in Spark? Sun, 19 Nov, 17:36
Holden Karau       Re: Thoughts on extedning ML exporting in Spark? Mon, 20 Nov, 00:14
Chang Chen How to print plan of Structured Streaming DataFrame Mon, 20 Nov, 12:00
Liang-Chi Hsieh   Re: How to print plan of Structured Streaming DataFrame Tue, 21 Nov, 05:49
Chang Chen     Re: How to print plan of Structured Streaming DataFrame Tue, 21 Nov, 08:22
Re: Spark Writing to parquet directory : java.io.IOException: Disk quota exceeded
Chetan Khatri   Re: Spark Writing to parquet directory : java.io.IOException: Disk quota exceeded Wed, 22 Nov, 13:23
Vadim Semenov     Re: Spark Writing to parquet directory : java.io.IOException: Disk quota exceeded Wed, 22 Nov, 15:55
Stephen Boesch Spark.ml roadmap 2.3.0 and beyond Wed, 22 Nov, 23:07
Stephen Boesch   Re: Spark.ml roadmap 2.3.0 and beyond Wed, 29 Nov, 14:39
Stephen Boesch     Re: Spark.ml roadmap 2.3.0 and beyond Wed, 29 Nov, 14:52
163 SparkSQL not support CharType Thu, 23 Nov, 03:09
Herman van Hövell tot Westerflier   Re: SparkSQL not support CharType Thu, 23 Nov, 09:18
Jörn Franke     Re: SparkSQL not support CharType Thu, 23 Nov, 09:28
Ajith shetty Spark SQL : How to make Spark support parallelism per sql Thu, 23 Nov, 17:06
Message list1 · 2 · Next »Thread · Author · Date
Box list
May 2019120
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333