spark-dev mailing list archives: April 2016

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Reynold Xin [discuss] using deep learning to improve Spark Fri, 01 Apr, 07:15
Michael Malak   Re: [discuss] using deep learning to improve Spark Fri, 01 Apr, 07:33
Xiao Li     Re: [discuss] using deep learning to improve Spark Fri, 01 Apr, 07:37
Takeshi Yamamuro       Re: [discuss] using deep learning to improve Spark Fri, 01 Apr, 09:40
Ricardo Almeida         Re: [discuss] using deep learning to improve Spark Fri, 01 Apr, 15:05
Re: Any documentation on Spark's security model beyond YARN?
Michael Segel   Re: Any documentation on Spark's security model beyond YARN? Fri, 01 Apr, 12:23
Re: how about a custom coalesce() policy?
Nezih Yigitbasi   Re: how about a custom coalesce() policy? Fri, 01 Apr, 17:03
Hemant Bhanawat     Re: how about a custom coalesce() policy? Sun, 03 Apr, 05:39
Hemant Bhanawat       Re: how about a custom coalesce() policy? Sun, 03 Apr, 05:40
Nezih Yigitbasi         Re: how about a custom coalesce() policy? Sun, 03 Apr, 06:27
Renyi Xiong Declare rest of @Experimental items non-experimental if they've existed since 1.2.0 Fri, 01 Apr, 17:10
Sean Owen   Re: Declare rest of @Experimental items non-experimental if they've existed since 1.2.0 Fri, 01 Apr, 19:54
Renyi Xiong     RE: Declare rest of @Experimental items non-experimental if they'veexisted since 1.2.0 Sat, 02 Apr, 01:59
Michael Slavitch Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 18:32
Reynold Xin   Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 20:57
Michael Slavitch     Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 21:10
Reynold Xin       Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 21:22
Reynold Xin         Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 21:57
Mridul Muralidharan       Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 22:05
Michael Slavitch         Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 22:28
Reynold Xin           Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 22:32
Yong Zhang             RE: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 22:37
Reynold Xin               Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 22:38
Michael Slavitch             Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 22:39
Michael Slavitch               Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 22:48
Saisai Shao                 Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 23:25
Michael Slavitch                   Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 23:27
Saisai Shao                     Re: Eliminating shuffle write and spill disk IO reads/writes in Spark Fri, 01 Apr, 23:44
Re: Spark SQL UDF Returning Rows
Michael Armbrust   Re: Spark SQL UDF Returning Rows Fri, 01 Apr, 20:26
Re: What influences the space complexity of Spark operations?
Michael Armbrust   Re: What influences the space complexity of Spark operations? Fri, 01 Apr, 20:29
Steve Johnston     Re: What influences the space complexity of Spark operations? Tue, 05 Apr, 14:15
Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle
Koert Kuipers   Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Fri, 01 Apr, 23:10
Raymond Honderdors     RE: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Sat, 02 Apr, 05:00
Holden Karau       Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Tue, 05 Apr, 23:39
Kostas Sakellis         Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Wed, 06 Apr, 01:54
Dean Wampler           Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Wed, 06 Apr, 17:51
Mark Hamstra             Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Wed, 06 Apr, 18:57
Daniel Siegmann               Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Mon, 11 Apr, 19:10
Mark Hamstra                 Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Mon, 11 Apr, 19:23
Sean Owen           Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Wed, 06 Apr, 18:04
Mridul Muralidharan             Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Wed, 06 Apr, 18:51
Mark Hamstra             Re: Discuss: commit to Scala 2.10 support for Spark 2.x lifecycle Wed, 06 Apr, 18:57
Avinash Dongre [No Subject] Sun, 03 Apr, 11:20
Jacek Laskowski [SQL] Dataset.map gives error: missing parameter type for expanded function? Sun, 03 Apr, 19:23
Michael Armbrust   Re: [SQL] Dataset.map gives error: missing parameter type for expanded function? Mon, 04 Apr, 18:05
Ted Yu explain codegen Sun, 03 Apr, 23:00
Jacek Laskowski   Re: explain codegen Mon, 04 Apr, 04:38
Reynold Xin     Re: explain codegen Mon, 04 Apr, 04:42
Ted Yu       Re: explain codegen Mon, 04 Apr, 10:15
Herman van Hövell tot Westerflier         Re: explain codegen Mon, 04 Apr, 11:06
Ted Yu           Re: explain codegen Mon, 04 Apr, 14:07
Reynold Xin             Re: explain codegen Mon, 04 Apr, 16:37
Ted Yu               Re: explain codegen Mon, 04 Apr, 16:59
Re: [discuss] ending support for Java 7 in Spark 2.0
Reynold Xin   Re: [discuss] ending support for Java 7 in Spark 2.0 Mon, 04 Apr, 05:28
Xuefeng Wu     Re: [discuss] ending support for Java 7 in Spark 2.0 Mon, 04 Apr, 15:41
Steve Loughran       Re: [discuss] ending support for Java 7 in Spark 2.0 Tue, 05 Apr, 10:35
Luciano Resende     Re: [discuss] ending support for Java 7 in Spark 2.0 Mon, 04 Apr, 15:48
Ofir Manor       Re: [discuss] ending support for Java 7 in Spark 2.0 Mon, 04 Apr, 19:58
Karlis Zigurs         Re: [discuss] ending support for Java 7 in Spark 2.0 Mon, 04 Apr, 22:01
Steve Loughran         Re: [discuss] ending support for Java 7 in Spark 2.0 Tue, 05 Apr, 10:41
Sean Owen     Re: [discuss] ending support for Java 7 in Spark 2.0 Tue, 05 Apr, 13:31
Reynold Xin       Re: [discuss] ending support for Java 7 in Spark 2.0 Tue, 05 Apr, 14:06
Kousuke Saruta Spark 1.6.1 binary pre-built for Hadoop 2.6 may be broken Mon, 04 Apr, 12:49
Mike Hynes RDD Partitions not distributed evenly to executors Mon, 04 Apr, 13:12
Michael Slavitch   Re: RDD Partitions not distributed evenly to executors Mon, 04 Apr, 14:25
Ted Yu   Re: RDD Partitions not distributed evenly to executors Mon, 04 Apr, 14:44
Koert Kuipers   Re: RDD Partitions not distributed evenly to executors Mon, 04 Apr, 16:24
Mike Hynes     Re: RDD Partitions not distributed evenly to executors Tue, 05 Apr, 00:17
Koert Kuipers       Re: RDD Partitions not distributed evenly to executors Tue, 05 Apr, 02:57
Khaled Ammar         Re: RDD Partitions not distributed evenly to executors Tue, 05 Apr, 16:06
Mike Hynes           Re: RDD Partitions not distributed evenly to executors Wed, 06 Apr, 13:36
Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt?
Nicholas Chammas   Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Mon, 04 Apr, 13:58
Kousuke Saruta     Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Mon, 04 Apr, 15:02
Jitendra Shelar       Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Mon, 04 Apr, 15:39
Kousuke Saruta         Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Mon, 04 Apr, 15:42
Ted Yu   Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Mon, 04 Apr, 15:45
Nicholas Chammas     Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Mon, 04 Apr, 21:39
Jakob Odersky       Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Mon, 04 Apr, 22:19
Jakob Odersky         Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Mon, 04 Apr, 22:28
Nicholas Chammas           Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Mon, 04 Apr, 22:37
Josh Rosen             Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Wed, 06 Apr, 19:19
Nicholas Chammas               Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Wed, 06 Apr, 19:27
Ted Yu               Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Wed, 06 Apr, 19:54
Josh Rosen                 Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Wed, 06 Apr, 19:55
Ted Yu                   Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? Mon, 11 Apr, 14:29
Re: running lda in spark throws exception
Joseph Bradley   Re: running lda in spark throws exception Mon, 04 Apr, 18:33
Jacek Laskowski error: reference to sql is ambiguous after import org.apache.spark._ in shell? Tue, 05 Apr, 00:16
Ted Yu   Re: error: reference to sql is ambiguous after import org.apache.spark._ in shell? Tue, 05 Apr, 00:20
Re: java.lang.OutOfMemoryError: Unable to acquire bytes of memory
Reynold Xin   Re: java.lang.OutOfMemoryError: Unable to acquire bytes of memory Tue, 05 Apr, 01:16
Reynold Xin     Re: java.lang.OutOfMemoryError: Unable to acquire bytes of memory Tue, 05 Apr, 01:16
Nezih Yigitbasi       Re: java.lang.OutOfMemoryError: Unable to acquire bytes of memory Tue, 05 Apr, 03:52
Imran Rashid         Re: java.lang.OutOfMemoryError: Unable to acquire bytes of memory Thu, 14 Apr, 16:24
Nezih Yigitbasi           Re: java.lang.OutOfMemoryError: Unable to acquire bytes of memory Thu, 14 Apr, 16:31
Marcelo Vanzin Build changes after SPARK-13579 Tue, 05 Apr, 03:00
Koert Kuipers   Re: Build changes after SPARK-13579 Tue, 05 Apr, 04:58
Marcelo Vanzin     Re: Build changes after SPARK-13579 Tue, 05 Apr, 04:59
Reynold Xin       Re: Build changes after SPARK-13579 Tue, 05 Apr, 05:01
Raymond Honderdors Build with Thrift Server & Scala 2.11 Tue, 05 Apr, 10:44
Reynold Xin   Re: Build with Thrift Server & Scala 2.11 Tue, 05 Apr, 12:57
Raymond Honderdors     RE: Build with Thrift Server & Scala 2.11 Tue, 05 Apr, 13:22
Raymond Honderdors       RE: Build with Thrift Server & Scala 2.11 Tue, 05 Apr, 13:27
Ted Yu       Re: Build with Thrift Server & Scala 2.11 Tue, 05 Apr, 16:22
Raymond Honderdors       Re: Build with Thrift Server & Scala 2.11 Tue, 05 Apr, 16:25
Xiangrui Meng Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Tue, 05 Apr, 18:01
Sean Owen   Re: Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Tue, 05 Apr, 18:48
Shivaram Venkataraman     Re: Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Tue, 05 Apr, 19:07
Xiangrui Meng       Re: Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Tue, 05 Apr, 20:44
Matei Zaharia         Re: Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Tue, 05 Apr, 23:58
Joseph Bradley           Re: Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Wed, 06 Apr, 00:32
Holden Karau             Re: Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Wed, 06 Apr, 00:38
Reynold Xin             Re: Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Wed, 06 Apr, 02:00
Chris Fregly               Re: Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Wed, 06 Apr, 03:02
Nick Pentreath                 Re: Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Wed, 06 Apr, 04:12
DB Tsai                 Re: Switch RDD-based MLlib APIs to maintenance mode in Spark 2.0 Wed, 06 Apr, 22:58
Renyi Xiong Spark Streaming UI reporting a different task duration Tue, 05 Apr, 18:02
Josh Rosen Updating Spark PR builder and 2.x test jobs to use Java 8 JDK Tue, 05 Apr, 21:14
Ted Yu   Re: Updating Spark PR builder and 2.x test jobs to use Java 8 JDK Tue, 05 Apr, 23:14
Josh Rosen     Re: Updating Spark PR builder and 2.x test jobs to use Java 8 JDK Wed, 06 Apr, 00:09
Josh Rosen       Re: Updating Spark PR builder and 2.x test jobs to use Java 8 JDK Wed, 06 Apr, 01:23
Jacek Laskowski [STREAMING] DStreamClosureSuite.scala with { return; ssc.sparkContext.emptyRDD[Int] } Why?! Tue, 05 Apr, 22:40
Ted Yu   Re: [STREAMING] DStreamClosureSuite.scala with { return; ssc.sparkContext.emptyRDD[Int] } Why?! Tue, 05 Apr, 22:47
Jacek Laskowski     Re: [STREAMING] DStreamClosureSuite.scala with { return; ssc.sparkContext.emptyRDD[Int] } Why?! Tue, 05 Apr, 23:48
Jacek Laskowski BROKEN BUILD? Is this only me or not? Tue, 05 Apr, 23:51
Ted Yu   Re: BROKEN BUILD? Is this only me or not? Wed, 06 Apr, 00:41
Jacek Laskowski     Re: BROKEN BUILD? Is this only me or not? Wed, 06 Apr, 01:32
Ted Yu       Re: BROKEN BUILD? Is this only me or not? Wed, 06 Apr, 01:40
Nick Pentreath ClassCastException when extracting and collecting DF array column type Wed, 06 Apr, 11:35
Nick Pentreath   Re: ClassCastException when extracting and collecting DF array column type Wed, 06 Apr, 13:56
Chaturvedi Chola Big Data Interview FAQ Wed, 06 Apr, 13:22
Scott walent Agenda Announced for Spark Summit 2016 in San Francisco Wed, 06 Apr, 16:44
Sung Hwan Chung Executor shutdown hooks? Wed, 06 Apr, 19:24
Mark Hamstra   Re: Executor shutdown hooks? Wed, 06 Apr, 19:36
Sung Hwan Chung     Re: Executor shutdown hooks? Wed, 06 Apr, 23:39
Reynold Xin       Re: Executor shutdown hooks? Thu, 07 Apr, 00:38
Hemant Bhanawat         Re: Executor shutdown hooks? Thu, 07 Apr, 04:51
Mihir Monani Possible bug related to [SPARK-5708] Thu, 07 Apr, 07:31
[JIRA] (SPARK-754) Multiple Spark Contexts active in a single Spark Context
Anonymous (JIRA)   [JIRA] (SPARK-754) Multiple Spark Contexts active in a single Spark Context Fri, 08 Apr, 06:33
Wojciech Indyk Delegation of Kerberos tokens Fri, 08 Apr, 09:01
Steve Loughran   Re: Delegation of Kerberos tokens Sat, 09 Apr, 09:45
shane knapp [build system] taking amp-jenkins-worker-06 and -07 offline due to disk space issues Fri, 08 Apr, 18:18
shane knapp   Re: [build system] taking amp-jenkins-worker-06 and -07 offline due to disk space issues Fri, 08 Apr, 18:29
Sung Hwan Chung How Spark handles dead machines during a job. Sat, 09 Apr, 04:19
Reynold Xin   Re: How Spark handles dead machines during a job. Sat, 09 Apr, 06:35
Jacek Laskowski [BUILD FAILURE] Spark Project ML Local Library - me or it's real? Sat, 09 Apr, 19:01
Ted Yu   Re: [BUILD FAILURE] Spark Project ML Local Library - me or it's real? Sat, 09 Apr, 19:40
Ted Yu     Re: [BUILD FAILURE] Spark Project ML Local Library - me or it's real? Sat, 09 Apr, 20:16
Jacek Laskowski       Re: [BUILD FAILURE] Spark Project ML Local Library - me or it's real? Sat, 09 Apr, 23:26
zhang juntao spark graphx storage RDD memory leak Sun, 10 Apr, 16:08
Ted Yu   Re: spark graphx storage RDD memory leak Sun, 10 Apr, 17:15
zhang juntao     Fwd: spark graphx storage RDD memory leak Mon, 11 Apr, 06:23
Robin East       Re: spark graphx storage RDD memory leak Mon, 11 Apr, 18:13
zhang juntao         Fwd: spark graphx storage RDD memory leak Tue, 12 Apr, 01:12
Yash Sharma Spark Sql on large number of files (~500Megs each) fails after couple of hours Mon, 11 Apr, 02:46
Yu, Yucai   RE: Spark Sql on large number of files (~500Megs each) fails after couple of hours Mon, 11 Apr, 03:10
Yash Sharma     Re: Spark Sql on large number of files (~500Megs each) fails after couple of hours Mon, 11 Apr, 03:51
Yu, Yucai       RE: Spark Sql on large number of files (~500Megs each) fails after couple of hours Mon, 11 Apr, 04:52
cherry_zhang Spark Jenkins test configurations Mon, 11 Apr, 02:54
Rahul Tanwani Different maxBins value for categorical and continuous features in RandomForest implementation. Mon, 11 Apr, 09:06
Joseph Bradley   Re: Different maxBins value for categorical and continuous features in RandomForest implementation. Wed, 13 Apr, 03:05
Rahul Tanwani     Re: Different maxBins value for categorical and continuous features in RandomForest implementation. Wed, 13 Apr, 19:18
Re: [Streaming] textFileStream has no events shown in web UI
Yogesh Mahajan   Re: [Streaming] textFileStream has no events shown in web UI Mon, 11 Apr, 18:10
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
May 2019139
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333