spark-user mailing list archives: November 2013

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Re: repartitioning RDDS
Robin Cjc   Re: repartitioning RDDS Fri, 01 Nov, 02:13
Wenlei Xie Is there any way to set the output location for each partition for the RDD? Fri, 01 Nov, 02:44
dachuan   Re: Is there any way to set the output location for each partition for the RDD? Fri, 01 Nov, 02:53
Wenlei Xie     Re: Is there any way to set the output location for each partition for the RDD? Mon, 04 Nov, 08:45
Wenlei Xie     Re: Is there any way to set the output location for each partition for the RDD? Mon, 04 Nov, 08:48
Re: executor failures w/ scala 2.10
Imran Rashid   Re: executor failures w/ scala 2.10 Fri, 01 Nov, 03:05
Sriram Ramachandrasekaran     Re: executor failures w/ scala 2.10 Fri, 01 Nov, 04:11
Matei Zaharia       Re: executor failures w/ scala 2.10 Fri, 01 Nov, 04:38
Sriram Ramachandrasekaran         Re: executor failures w/ scala 2.10 Fri, 01 Nov, 04:58
Matei Zaharia           Re: executor failures w/ scala 2.10 Fri, 01 Nov, 06:15
Imran Rashid             Re: executor failures w/ scala 2.10 Fri, 01 Nov, 14:27
Imran Rashid               Re: executor failures w/ scala 2.10 Fri, 01 Nov, 20:09
Matei Zaharia                 Re: executor failures w/ scala 2.10 Fri, 01 Nov, 21:59
Prashant Sharma                   Re: executor failures w/ scala 2.10 Sat, 02 Nov, 02:53
Matei Zaharia                     Re: executor failures w/ scala 2.10 Sat, 02 Nov, 05:38
Prashant Sharma                       Re: executor failures w/ scala 2.10 Wed, 13 Nov, 08:39
Matei Zaharia                         Re: executor failures w/ scala 2.10 Wed, 13 Nov, 18:07
Prashant Sharma                           Re: executor failures w/ scala 2.10 Thu, 14 Nov, 03:55
Prashant Sharma   Re: executor failures w/ scala 2.10 Fri, 01 Nov, 03:54
Prashant Sharma     Re: executor failures w/ scala 2.10 Fri, 01 Nov, 04:01
Liu, Raymond Executor could not connect to Driver? Fri, 01 Nov, 07:14
Aaron Davidson   Re: Executor could not connect to Driver? Fri, 01 Nov, 16:06
Liu, Raymond     RE: Executor could not connect to Driver? Mon, 04 Nov, 01:58
Jianmin Wu facing problem when launching WordCount on mesos Fri, 01 Nov, 09:16
Andre Kuhnen Spark slow after first stage (big dataset) Fri, 01 Nov, 10:52
Leonidas Fegaras [ANNOUNCE] Apache MRQL 0.9.0-incubating released Fri, 01 Nov, 13:58
dachuan any idea about the difference between windowDuration and slideDuration ? Fri, 01 Nov, 14:04
Patrick Wendell   Re: any idea about the difference between windowDuration and slideDuration ? Fri, 01 Nov, 17:31
dachuan     Re: any idea about the difference between windowDuration and slideDuration ? Fri, 01 Nov, 18:00
Re: cluster hangs for no apparent reason
Walrus theCat   Re: cluster hangs for no apparent reason Fri, 01 Nov, 17:40
Shangyu Luo     Re: cluster hangs for no apparent reason Fri, 01 Nov, 18:31
Walrus theCat       Re: cluster hangs for no apparent reason Sat, 02 Nov, 02:15
Shangyu Luo         Re: cluster hangs for no apparent reason Sat, 02 Nov, 21:55
Walrus theCat           Re: cluster hangs for no apparent reason Sun, 03 Nov, 17:50
Shangyu Luo             Re: cluster hangs for no apparent reason Sun, 03 Nov, 18:47
Walrus theCat               Re: cluster hangs for no apparent reason Sun, 03 Nov, 22:40
Shangyu Luo                 Re: cluster hangs for no apparent reason Mon, 04 Nov, 03:58
Walrus theCat                   Re: cluster hangs for no apparent reason Thu, 07 Nov, 21:26
Shangyu Luo                     Re: cluster hangs for no apparent reason Thu, 07 Nov, 23:34
Walrus theCat                       Re: cluster hangs for no apparent reason Fri, 08 Nov, 18:55
Thorsten Bergler Spark with HDFS: ERROR Worker: Connection to master failed! Shutting down. Fri, 01 Nov, 18:02
Mohit Jaggi trouble with closures Fri, 01 Nov, 22:24
Jason Lenderman   Re: trouble with closures Sat, 02 Nov, 05:11
Mohit Jaggi     Re: trouble with closures Mon, 04 Nov, 21:45
Matt Cheah Out of memory building RDD on local[N] Fri, 01 Nov, 22:51
Matt Cheah   Re: Out of memory building RDD on local[N] Sat, 02 Nov, 00:43
Josh Rosen     Re: Out of memory building RDD on local[N] Sat, 02 Nov, 01:19
Chen Jingci RE: Spark with HDFS: ERROR Worker: Connection to master failed! Shuttingdown. Sat, 02 Nov, 01:00
dachuan   Re: Spark with HDFS: ERROR Worker: Connection to master failed! Shuttingdown. Sat, 02 Nov, 01:11
Thorsten Bergler     Re: Spark with HDFS: ERROR Worker: Connection to master failed! Shuttingdown. Sat, 02 Nov, 11:29
java.io.NotSerializableException on RDD count() in Java
Yadid Ayzenberg   java.io.NotSerializableException on RDD count() in Java Sun, 03 Nov, 18:33
Patrick Wendell     Re: java.io.NotSerializableException on RDD count() in Java Mon, 04 Nov, 00:23
Yadid Ayzenberg       Re: java.io.NotSerializableException on RDD count() in Java Mon, 04 Nov, 00:27
Patrick Wendell         Re: java.io.NotSerializableException on RDD count() in Java Mon, 04 Nov, 00:43
Yadid Ayzenberg           Re: java.io.NotSerializableException on RDD count() in Java Mon, 04 Nov, 00:49
Patrick Wendell             Re: java.io.NotSerializableException on RDD count() in Java Mon, 04 Nov, 01:05
Yadid Ayzenberg               Re: java.io.NotSerializableException on RDD count() in Java Mon, 04 Nov, 01:13
Patrick Wendell                 Re: java.io.NotSerializableException on RDD count() in Java Mon, 04 Nov, 01:19
Yadid Ayzenberg                   Re: java.io.NotSerializableException on RDD count() in Java Mon, 04 Nov, 01:25
Patrick Wendell                     Re: java.io.NotSerializableException on RDD count() in Java Mon, 04 Nov, 03:32
Reynold Xin                       Re: java.io.NotSerializableException on RDD count() in Java Mon, 04 Nov, 05:05
Yadid Ayzenberg                         Re: java.io.NotSerializableException on RDD count() in Java Tue, 05 Nov, 13:04
Patrick Wendell                           Re: java.io.NotSerializableException on RDD count() in Java Thu, 07 Nov, 19:22
Xiang Huo How to filter a sorted RDD Mon, 04 Nov, 06:42
Zongheng Yang   Re: How to filter a sorted RDD Mon, 04 Nov, 06:49
Mark Hamstra   Re: How to filter a sorted RDD Mon, 04 Nov, 07:24
Xiang Huo     Re: How to filter a sorted RDD Mon, 04 Nov, 07:32
Mark Hamstra       Re: How to filter a sorted RDD Mon, 04 Nov, 17:19
Xiang Huo         Re: How to filter a sorted RDD Mon, 04 Nov, 17:28
Ramkumar Chokkalingam Exception in thread "delete Spark temp dir Mon, 04 Nov, 09:43
Andre Kuhnen Help Needed Error communicating with MapOutputTracker Mon, 04 Nov, 11:49
Re: Kryo with Java
Tal Sliwowicz   Re: Kryo with Java Mon, 04 Nov, 16:21
tyc How to solve sbt.ResolveException error? Mon, 04 Nov, 18:57
Imran Rashid   Re: How to solve sbt.ResolveException error? Mon, 04 Nov, 19:17
tyc     Re: How to solve sbt.ResolveException error? Tue, 05 Nov, 12:57
Robin Cjc       Re: How to solve sbt.ResolveException error? Tue, 05 Nov, 14:33
Wenlei Xie Performance drop / unstable in 0.8 release Mon, 04 Nov, 20:03
Reynold Xin   Re: Performance drop / unstable in 0.8 release Wed, 06 Nov, 08:09
Wenlei Xie     Re: Performance drop / unstable in 0.8 release Thu, 07 Nov, 21:53
Markus Losoi Receiving intermediary results of a Spark operation Mon, 04 Nov, 20:22
Mark Hamstra   Re: Receiving intermediary results of a Spark operation Mon, 04 Nov, 21:15
Mark Hamstra     Re: Receiving intermediary results of a Spark operation Mon, 04 Nov, 21:16
Horia   Re: Receiving intermediary results of a Spark operation Mon, 04 Nov, 22:07
Sudarshan Kadambi (BLOOMBERG/ 731 LEXIN) Spark <-> HBase connectivity Mon, 04 Nov, 21:58
dachuan   Re: Spark <-> HBase connectivity Mon, 04 Nov, 22:09
Sudarshan Kadambi (BLOOMBERG/ 731 LEXIN) Re: Spark <-> HBase connectivity Mon, 04 Nov, 22:39
dachuan   Re: Spark <-> HBase connectivity Tue, 05 Nov, 01:09
John Salvatier Enabling Kryo logging Tue, 05 Nov, 00:36
Re: oome from blockmanager
Aaron Davidson   Re: oome from blockmanager Tue, 05 Nov, 16:18
Stephen Haberman     Re: oome from blockmanager Tue, 05 Nov, 16:50
Ashish Rangole       Re: oome from blockmanager Tue, 05 Nov, 18:23
Aaron Davidson         Re: oome from blockmanager Tue, 05 Nov, 19:18
Stephen Haberman   Re: oome from blockmanager Thu, 21 Nov, 21:00
Aaron Davidson     Re: oome from blockmanager Thu, 21 Nov, 22:16
Stephen Haberman       Re: oome from blockmanager Fri, 22 Nov, 06:20
Aaron Davidson         Re: oome from blockmanager Fri, 22 Nov, 06:54
Shao, Saisai           RE: oome from blockmanager Fri, 22 Nov, 09:38
Aaron Davidson             Re: oome from blockmanager Fri, 22 Nov, 17:05
Aaron Davidson               Re: oome from blockmanager Fri, 22 Nov, 22:21
邵赛赛                 Re: oome from blockmanager Sat, 23 Nov, 00:20
Stephen Haberman           Re: oome from blockmanager Fri, 22 Nov, 17:40
Stephen Haberman   Re: oome from blockmanager Thu, 21 Nov, 22:32
Raza Rehman Some confusion about parallelize operations in Spark Tue, 05 Nov, 20:36
Shay Seng suppressing logging in REPL Tue, 05 Nov, 22:36
Reynold Xin   Re: suppressing logging in REPL Wed, 06 Nov, 08:16
Shay Seng     Re: suppressing logging in REPL Wed, 06 Nov, 15:04
Shay Seng       Re: suppressing logging in REPL Thu, 07 Nov, 22:16
Shay Seng         Re: suppressing logging in REPL Thu, 07 Nov, 22:29
Hussam_Jar...@Dell.com JdbcRDD usage Tue, 05 Nov, 23:13
Reynold Xin   Re: JdbcRDD usage Wed, 06 Nov, 08:12
Hussam_Jar...@Dell.com     RE: JdbcRDD usage Wed, 06 Nov, 19:29
Josh Rosen       Re: JdbcRDD usage Wed, 06 Nov, 19:44
Hussam_Jar...@Dell.com         RE: JdbcRDD usage Wed, 06 Nov, 20:17
Hao REN rdd.foreach doesn't act as expected Wed, 06 Nov, 00:40
Mohit Jaggi   Re: rdd.foreach doesn't act as expected Wed, 06 Nov, 21:07
Hao REN     Re: rdd.foreach doesn't act as expected Wed, 06 Nov, 22:41
Matei Zaharia       Re: rdd.foreach doesn't act as expected Thu, 07 Nov, 02:11
Pranay Tonpay Running spark job using maven gives errors at times Wed, 06 Nov, 07:54
Rajeev Srivastava lzo spark example Wed, 06 Nov, 21:50
Shay Seng value join is not a member of org.apache.spark.rdd.RDD Thu, 07 Nov, 01:44
Josh Rosen   Re: value join is not a member of org.apache.spark.rdd.RDD Thu, 07 Nov, 02:01
Pranay Tonpay PMML support in spark Thu, 07 Nov, 04:44
Matei Zaharia   Re: PMML support in spark Thu, 07 Nov, 19:01
Rob Emanuele Spark and geospatial data Thu, 07 Nov, 19:49
andy petrella   Re: Spark and geospatial data Thu, 07 Nov, 20:05
Rob Emanuele     Re: Spark and geospatial data Thu, 07 Nov, 20:32
Philip Ogren Where is reduceByKey? Thu, 07 Nov, 19:54
Josh Rosen   Re: Where is reduceByKey? Thu, 07 Nov, 21:01
Philip Ogren     Re: Where is reduceByKey? Thu, 07 Nov, 21:05
Philip Ogren     Re: Where is reduceByKey? Thu, 07 Nov, 21:15
Matei Zaharia       Re: Where is reduceByKey? Thu, 07 Nov, 23:05
Philip Ogren         Re: Where is reduceByKey? Thu, 07 Nov, 23:46
Matei Zaharia           Re: Where is reduceByKey? Fri, 08 Nov, 00:34
Walrus theCat what happens if default parallelism is set to 4x cores? Thu, 07 Nov, 21:27
Matei Zaharia Spark Summit agenda posted Thu, 07 Nov, 22:30
R. Revert   Re: Spark Summit agenda posted Fri, 08 Nov, 11:27
Matei Zaharia     Re: Spark Summit agenda posted Fri, 08 Nov, 18:47
Hussam_Jar...@Dell.com setting spark worker node jvm options not working as expected Fri, 08 Nov, 03:04
Kapil Malik   RE: setting spark worker node jvm options not working as expected Fri, 08 Nov, 10:29
Hussam_Jar...@Dell.com     RE: setting spark worker node jvm options not working as expected Sat, 09 Nov, 01:39
Stanley Burnitt   RE: setting spark worker node jvm options not working as expected Fri, 08 Nov, 19:24
Grega Kešpret Not caching rdds, spark.storage.memoryFraction setting Fri, 08 Nov, 16:01
Matei Zaharia   Re: Not caching rdds, spark.storage.memoryFraction setting Fri, 08 Nov, 18:46
Christopher Nguyen   Re: Not caching rdds, spark.storage.memoryFraction setting Sat, 09 Nov, 00:40
Grega Kešpret     Re: Not caching rdds, spark.storage.memoryFraction setting Sat, 09 Nov, 19:07
Guillaume Pitel Random StreamCorruptedException during task execution Fri, 08 Nov, 16:23
Message list1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Jul 201998
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137