spark-dev mailing list archives: May 2018

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Nicholas Chammas Identifying specific persisted DataFrames via getPersistentRDDs() Tue, 01 May, 03:17
Reynold Xin   Re: Identifying specific persisted DataFrames via getPersistentRDDs() Fri, 04 May, 02:26
Nicholas Chammas     Re: Identifying specific persisted DataFrames via getPersistentRDDs() Tue, 08 May, 13:00
Mark Hamstra       Re: Identifying specific persisted DataFrames via getPersistentRDDs() Tue, 08 May, 17:32
Nicholas Chammas         Re: Identifying specific persisted DataFrames via getPersistentRDDs() Wed, 09 May, 02:36
shane knapp [build system] jenkins master unreachable, build system currently down Tue, 01 May, 03:27
Xiao Li   Re: [build system] jenkins master unreachable, build system currently down Tue, 01 May, 04:40
shane knapp   Re: [build system] jenkins master unreachable, build system currently down Tue, 01 May, 15:40
Xiao Li     Re: [build system] jenkins master unreachable, build system currently down Tue, 01 May, 15:58
Joseph Bradley       Re: [build system] jenkins master unreachable, build system currently down Tue, 01 May, 16:23
880f0464 UnresolvedException: Invalid call to dataType on unresolved object Tue, 01 May, 11:14
880f0464 spark.python.worker.reuse not working as expected Tue, 01 May, 11:17
880f0464 PySpark.sql.filter not performing as it should Tue, 01 May, 11:19
Pralabh Kumar org.apache.spark.shuffle.FetchFailedException: Too large frame: Tue, 01 May, 11:21
Ryan Blue   Re: org.apache.spark.shuffle.FetchFailedException: Too large frame: Tue, 01 May, 16:07
Pralabh Kumar     Re: org.apache.spark.shuffle.FetchFailedException: Too large frame: Thu, 03 May, 03:57
Ryan Blue       Re: org.apache.spark.shuffle.FetchFailedException: Too large frame: Thu, 03 May, 17:54
Rich Bowen ApacheCon North America 2018 schedule is now live. Tue, 01 May, 12:36
Re: Datasource API V2 and checkpointing
Ryan Blue   Re: Datasource API V2 and checkpointing Tue, 01 May, 17:26
Joseph Torres     Re: Datasource API V2 and checkpointing Tue, 01 May, 17:58
Thakrar, Jayesh     Re: Datasource API V2 and checkpointing Tue, 01 May, 19:58
Re: Sorting on a streaming dataframe
Hemant Bhanawat   Re: Sorting on a streaming dataframe Wed, 02 May, 05:45
jwozniak Custom datasource as a wrapper for existing ones? Wed, 02 May, 16:49
Jörn Franke   Re: Custom datasource as a wrapper for existing ones? Wed, 02 May, 19:05
Jörn Franke   Re: Custom datasource as a wrapper for existing ones? Wed, 02 May, 19:07
Jakub Wozniak     Re: Custom datasource as a wrapper for existing ones? Wed, 02 May, 20:17
Wenchen Fan       Re: Custom datasource as a wrapper for existing ones? Thu, 03 May, 14:46
Jakub Wozniak         Re: Custom datasource as a wrapper for existing ones? Thu, 03 May, 15:06
Jörn Franke         Re: Custom datasource as a wrapper for existing ones? Thu, 03 May, 15:14
shane knapp [build system] meet your build engineer @ spark ai summit SF 2018 Wed, 02 May, 18:11
shane knapp   Re: [build system] meet your build engineer @ spark ai summit SF 2018 Wed, 02 May, 18:44
Sergey Zhemzhitsky AccumulatorV2 vs AccumulableParam (V1) Wed, 02 May, 22:20
Wenchen Fan   Re: AccumulatorV2 vs AccumulableParam (V1) Thu, 03 May, 14:20
Sergey Zhemzhitsky     Re: AccumulatorV2 vs AccumulableParam (V1) Fri, 04 May, 12:33
Joseph Bradley SparkR test failures in PR builder Wed, 02 May, 22:31
Kazuaki Ishizaki   Re: SparkR test failures in PR builder Wed, 02 May, 23:51
Felix Cheung     Re: SparkR test failures in PR builder Thu, 03 May, 15:42
Xiao Li       Re: SparkR test failures in PR builder Thu, 03 May, 17:15
Jiří Syrový [Structured streaming, V2] commit on ContinuousReader Thu, 03 May, 17:43
Joseph Torres   Re: [Structured streaming, V2] commit on ContinuousReader Thu, 03 May, 19:04
Joseph Torres Design for continuous processing shuffle Fri, 04 May, 18:27
Yuanjian Li   Re: Design for continuous processing shuffle Mon, 07 May, 14:15
Anshi Shrivastava Spark UI Source Code Mon, 07 May, 08:44
Marcelo Vanzin   Re: Spark UI Source Code Mon, 07 May, 16:20
Anshi Shrivastava     Re: Spark UI Source Code Wed, 09 May, 04:53
Reynold Xin Integrating ML/DL frameworks with Spark Tue, 08 May, 00:37
Xiangrui Meng   Re: Integrating ML/DL frameworks with Spark Tue, 08 May, 04:59
Jörn Franke     Re: Integrating ML/DL frameworks with Spark Tue, 08 May, 05:05
Reynold Xin       Re: Integrating ML/DL frameworks with Spark Tue, 08 May, 05:11
Jörn Franke         Re: Integrating ML/DL frameworks with Spark Tue, 08 May, 06:19
Shivaram Venkataraman     Re: Integrating ML/DL frameworks with Spark Tue, 08 May, 15:53
Naveen Swamy       Re: Integrating ML/DL frameworks with Spark Tue, 08 May, 18:08
Reynold Xin       Re: Integrating ML/DL frameworks with Spark Tue, 08 May, 18:10
Nan Zhu         Re: Integrating ML/DL frameworks with Spark Tue, 08 May, 18:14
Reynold Xin           Re: Integrating ML/DL frameworks with Spark Tue, 08 May, 18:16
Nan Zhu             Re: Integrating ML/DL frameworks with Spark Tue, 08 May, 18:17
Xiangrui Meng               Re: Integrating ML/DL frameworks with Spark Wed, 09 May, 23:31
Bryan Cutler                 Re: Integrating ML/DL frameworks with Spark Tue, 15 May, 06:37
Felix Cheung                   Re: Integrating ML/DL frameworks with Spark Mon, 21 May, 03:19
Xiangrui Meng                     Re: Integrating ML/DL frameworks with Spark Thu, 24 May, 05:08
Daniel Galvez   Re: Integrating ML/DL frameworks with Spark Thu, 17 May, 06:48
Nicholas Chammas Documenting the various DataFrame/SQL join types Tue, 08 May, 13:13
Reynold Xin   Re: Documenting the various DataFrame/SQL join types Tue, 08 May, 15:42
Nicholas Chammas     Re: Documenting the various DataFrame/SQL join types Wed, 09 May, 02:53
Reynold Xin eager execution and debuggability Tue, 08 May, 18:52
Koert Kuipers   Re: eager execution and debuggability Tue, 08 May, 19:05
Ryan Blue     Re: eager execution and debuggability Tue, 08 May, 19:37
Marco Gaido       Re: eager execution and debuggability Tue, 08 May, 21:35
Reynold Xin         Re: eager execution and debuggability Tue, 08 May, 22:44
Reynold Xin           Re: eager execution and debuggability Tue, 08 May, 22:47
Ryan Blue             Re: eager execution and debuggability Tue, 08 May, 22:52
Reynold Xin               Re: eager execution and debuggability Tue, 08 May, 22:58
Ryan Blue                 Re: eager execution and debuggability Tue, 08 May, 23:08
Nicholas Chammas                   Re: eager execution and debuggability Wed, 09 May, 02:22
Reynold Xin                     Re: eager execution and debuggability Wed, 09 May, 02:26
Tim Hunter                       Re: eager execution and debuggability Wed, 09 May, 12:39
Ryan Blue                         Re: eager execution and debuggability Thu, 10 May, 16:31
Tomasz Gawęda                           Re: eager execution and debuggability Mon, 14 May, 13:46
Ryan Blue                             Re: eager execution and debuggability Mon, 21 May, 22:15
Lalwani, Jayesh           Re: eager execution and debuggability Thu, 10 May, 13:32
Ryan Blue [DISCUSS] Spark SQL internal data: InternalRow or UnsafeRow? Tue, 08 May, 20:22
Reynold Xin   Re: [DISCUSS] Spark SQL internal data: InternalRow or UnsafeRow? Tue, 08 May, 23:09
Ryan Blue     Re: [DISCUSS] Spark SQL internal data: InternalRow or UnsafeRow? Tue, 08 May, 23:15
Reynold Xin       Re: [DISCUSS] Spark SQL internal data: InternalRow or UnsafeRow? Tue, 08 May, 23:27
Ryan Blue         Re: [DISCUSS] Spark SQL internal data: InternalRow or UnsafeRow? Tue, 08 May, 23:36
Holden Karau Revisiting Online serving of Spark models? Wed, 09 May, 14:18
Joseph Bradley   Re: Revisiting Online serving of Spark models? Thu, 10 May, 16:25
Holden Karau     Re: Revisiting Online serving of Spark models? Thu, 10 May, 16:39
Felix Cheung       Re: Revisiting Online serving of Spark models? Thu, 10 May, 17:10
Felix Cheung         Re: Revisiting Online serving of Spark models? Mon, 21 May, 03:11
Joseph Bradley           Re: Revisiting Online serving of Spark models? Mon, 21 May, 20:52
Holden Karau             Re: Revisiting Online serving of Spark models? Mon, 21 May, 21:51
Holden Karau               Re: Revisiting Online serving of Spark models? Mon, 21 May, 21:52
Felix Cheung               Re: Revisiting Online serving of Spark models? Mon, 21 May, 21:57
Leif Walsh             Re: Revisiting Online serving of Spark models? Tue, 22 May, 12:14
Maximiliano Felice               Re: Revisiting Online serving of Spark models? Tue, 22 May, 13:39
Saikat Kanjilal                 Re: Revisiting Online serving of Spark models? Tue, 22 May, 14:47
Felix Cheung                   Re: Revisiting Online serving of Spark models? Sat, 26 May, 20:05
Felix Cheung                     Re: Revisiting Online serving of Spark models? Tue, 29 May, 16:37
Holden Karau                       Re: Revisiting Online serving of Spark models? Tue, 29 May, 16:47
Felix Cheung                         Re: Revisiting Online serving of Spark models? Tue, 29 May, 17:27
Maximiliano Felice                           Re: Revisiting Online serving of Spark models? Tue, 29 May, 17:35
Saikat Kanjilal                             Re: Revisiting Online serving of Spark models? Tue, 29 May, 18:46
Felix Cheung                           Re: Revisiting Online serving of Spark models? Wed, 30 May, 16:32
Denny Lee                             Re: Revisiting Online serving of Spark models? Wed, 30 May, 17:30
agateaaa Problem with Spark Master shutting down when zookeeper leader is shutdown Wed, 09 May, 20:50
Marcelo Vanzin Time for 2.3.1? Thu, 10 May, 18:09
Ryan Blue   Re: Time for 2.3.1? Thu, 10 May, 18:19
Henry Robinson   Re: Time for 2.3.1? Thu, 10 May, 18:22
Cody Koeninger     Re: Time for 2.3.1? Fri, 11 May, 14:40
Ryan Blue       Re: Time for 2.3.1? Fri, 11 May, 18:45
Henry Robinson         Re: Time for 2.3.1? Fri, 11 May, 18:47
Henry Robinson           Re: Time for 2.3.1? Fri, 11 May, 19:34
Shivaram Venkataraman             Re: Time for 2.3.1? Sun, 13 May, 17:57
sha...@apache.org REMINDER: Apache EU Roadshow 2018 schedule announced! Fri, 11 May, 12:13
Re: Possible SPIP to improve matrix and vector column type support
Leif Walsh   Re: Possible SPIP to improve matrix and vector column type support Sat, 12 May, 22:44
Ilan Filonenko Build timeout -- continuous-integration/appveyor/pr — AppVeyor build failed Mon, 14 May, 00:45
Hyukjin Kwon   Re: Build timeout -- continuous-integration/appveyor/pr — AppVeyor build failed Mon, 14 May, 01:43
Holden Karau     Re: Build timeout -- continuous-integration/appveyor/pr — AppVeyor build failed Mon, 14 May, 02:05
Hyukjin Kwon       Re: Build timeout -- continuous-integration/appveyor/pr — AppVeyor build failed Mon, 14 May, 02:38
Reynold Xin parser error? Mon, 14 May, 05:38
Sean Owen   Re: parser error? Mon, 14 May, 12:47
Takeshi Yamamuro     Re: parser error? Mon, 14 May, 13:08
Marco Gaido       Re: parser error? Mon, 14 May, 13:34
Jacek Laskowski InMemoryTableScanExec.inputRDD and buffers (RDD[CachedBatch]) Mon, 14 May, 11:30
Re: Sort-merge join improvement
Petar Zecevic   Re: Sort-merge join improvement Tue, 15 May, 08:56
Petar Zecevic     Re: Sort-merge join improvement Tue, 22 May, 08:38
Tomasz Gawęda Preventing predicate pushdown Tue, 15 May, 12:33
Wenchen Fan   Re: Preventing predicate pushdown Tue, 15 May, 16:29
Tomasz Gawęda     Re: Preventing predicate pushdown Tue, 15 May, 17:38
Marcelo Vanzin [VOTE] Spark 2.3.1 (RC1) Tue, 15 May, 21:00
Justin Miller   Re: [VOTE] Spark 2.3.1 (RC1) Tue, 15 May, 21:02
Marcelo Vanzin     Re: [VOTE] Spark 2.3.1 (RC1) Tue, 15 May, 21:04
Marcelo Vanzin   Re: [VOTE] Spark 2.3.1 (RC1) Tue, 15 May, 21:03
Xiao Li   Re: [VOTE] Spark 2.3.1 (RC1) Tue, 15 May, 21:04
Marcelo Vanzin     Re: [VOTE] Spark 2.3.1 (RC1) Tue, 15 May, 21:07
kant kodali       Re: [VOTE] Spark 2.3.1 (RC1) Wed, 16 May, 10:11
Marco Gaido         Re: [VOTE] Spark 2.3.1 (RC1) Wed, 16 May, 10:22
kant kodali           Re: [VOTE] Spark 2.3.1 (RC1) Wed, 16 May, 21:14
Marcelo Vanzin             Re: [VOTE] Spark 2.3.1 (RC1) Wed, 16 May, 21:40
Saisai Shao               Re: [VOTE] Spark 2.3.1 (RC1) Thu, 17 May, 01:34
Sean Owen   Re: [VOTE] Spark 2.3.1 (RC1) Wed, 16 May, 12:26
Holden Karau     Re: [VOTE] Spark 2.3.1 (RC1) Wed, 16 May, 12:57
Artem Rudoy   Re: [VOTE] Spark 2.3.1 (RC1) Thu, 17 May, 17:13
Marcelo Vanzin     Re: [VOTE] Spark 2.3.1 (RC1) Thu, 17 May, 17:18
Imran Rashid       Re: [VOTE] Spark 2.3.1 (RC1) Thu, 17 May, 21:59
Wenchen Fan         Re: [VOTE] Spark 2.3.1 (RC1) Fri, 18 May, 03:09
Marcelo Vanzin         Re: [VOTE] Spark 2.3.1 (RC1) Fri, 18 May, 17:39
Marcelo Vanzin           Re: [VOTE] Spark 2.3.1 (RC1) Mon, 21 May, 23:37
Li Jin [DISCUSS] PySpark Window UDF Wed, 16 May, 15:34
Re: Running lint-java during PR builds?
Hyukjin Kwon   Re: Running lint-java during PR builds? Mon, 21 May, 05:09
Hyukjin Kwon     Re: Running lint-java during PR builds? Mon, 21 May, 08:47
Marcelo Vanzin       Re: Running lint-java during PR builds? Mon, 21 May, 16:08
Felix Cheung         Re: Running lint-java during PR builds? Mon, 21 May, 16:17
Marcelo Vanzin           Re: Running lint-java during PR builds? Mon, 21 May, 16:20
Dongjoon Hyun             Re: Running lint-java during PR builds? Mon, 21 May, 18:17
Reynold Xin               Re: Running lint-java during PR builds? Mon, 21 May, 18:18
Hyukjin Kwon                 Re: Running lint-java during PR builds? Tue, 22 May, 15:35
Steve Loughran             Re: Running lint-java during PR builds? Mon, 28 May, 10:23
Hyukjin Kwon               Re: Running lint-java during PR builds? Mon, 28 May, 10:35
Jacek Laskowski Repeated FileSourceScanExec.metrics from ColumnarBatchScan.metrics Tue, 22 May, 17:17
Marcelo Vanzin [VOTE] Spark 2.3.1 (RC2) Tue, 22 May, 19:45
Marcelo Vanzin   Re: [VOTE] Spark 2.3.1 (RC2) Tue, 22 May, 19:45
Sean Owen   Re: [VOTE] Spark 2.3.1 (RC2) Wed, 23 May, 13:54
Wenchen Fan     Re: [VOTE] Spark 2.3.1 (RC2) Wed, 23 May, 14:36
chenliang613       Re: [VOTE] Spark 2.3.1 (RC2) Wed, 23 May, 15:04
Xiao Li         Re: [VOTE] Spark 2.3.1 (RC2) Wed, 23 May, 16:02
Marcelo Vanzin           Re: [VOTE] Spark 2.3.1 (RC2) Wed, 23 May, 16:54
Li Jin             Re: [VOTE] Spark 2.3.1 (RC2) Thu, 24 May, 14:08
Marcelo Vanzin   Re: [VOTE] Spark 2.3.1 (RC2) Fri, 25 May, 16:15
Hossein ML Pipelines in R Tue, 22 May, 22:23
Hossein   Re: ML Pipelines in R Tue, 22 May, 22:26
Joseph Torres Design proposal for streaming APIs in data source V2 Thu, 24 May, 17:43
Thodoris Zois Spark version for Mesos 0.27.0 Fri, 25 May, 11:29
Jacek Laskowski   Re: Spark version for Mesos 0.27.0 Fri, 25 May, 13:06
Thodoris Zois     Re: Spark version for Mesos 0.27.0 Wed, 30 May, 23:55
Szuromi Tamás       Re: Spark version for Mesos 0.27.0 Thu, 31 May, 09:08
Thodoris Zois         Re: Spark version for Mesos 0.27.0 Thu, 31 May, 09:22
Szuromi Tamás           Re: Spark version for Mesos 0.27.0 Thu, 31 May, 09:30
Thodoris Zois             Re: Spark version for Mesos 0.27.0 Thu, 31 May, 09:39
Hossein SparkR was removed from CRAN on 2018-05-01 Fri, 25 May, 17:58
Felix Cheung   Re: SparkR was removed from CRAN on 2018-05-01 Fri, 25 May, 21:11
Hadrien Chicault     Re: SparkR was removed from CRAN on 2018-05-01 Mon, 28 May, 05:22
Hossein     Re: SparkR was removed from CRAN on 2018-05-01 Tue, 29 May, 18:48
Shivaram Venkataraman       Re: SparkR was removed from CRAN on 2018-05-01 Tue, 29 May, 18:52
Michael Heuer         Re: SparkR was removed from CRAN on 2018-05-01 Tue, 29 May, 19:02
Shivaram Venkataraman           Re: SparkR was removed from CRAN on 2018-05-01 Tue, 29 May, 23:34
Jacek Laskowski [SQL] Understanding RewriteCorrelatedScalarSubquery optimization (and TreeNode.transform) Sun, 27 May, 19:43
Jacek Laskowski   Re: [SQL] Understanding RewriteCorrelatedScalarSubquery optimization (and TreeNode.transform) Mon, 28 May, 20:22
Message list1 · 2 · Next »Thread · Author · Date
Box list
May 2019136
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333