spark-user mailing list archives: January 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next »Thread · Author · Date
Eugen Cepoi Re: Spark context jar confusions Thu, 02 Jan, 13:55
Eugen Cepoi Re: Spark context jar confusions Sun, 05 Jan, 17:13
Eugen Cepoi Re: debug standalone Spark jobs? Sun, 05 Jan, 18:42
Eugen Cepoi Re: How to confirm serializer type on workers? Thu, 09 Jan, 10:21
Evan R. Sparks Re: what paper is the L2 regularization based on? Thu, 09 Jan, 19:10
Evan R. Sparks Re: performance Fri, 10 Jan, 03:43
Evan R. Sparks Re: Spark on google compute engine Mon, 13 Jan, 18:49
Evan R. Sparks Re: How to perform multi dimensional reduction in spark? Wed, 22 Jan, 19:46
Evan R. Sparks Re: .intersection() method on RDDs? Fri, 24 Jan, 01:26
Evan R. Sparks Re: .intersection() method on RDDs? Fri, 24 Jan, 01:36
Evan R. Sparks Re: Problem with flatmap. Thu, 30 Jan, 18:17
Evan R. Sparks Re: Problem with flatmap. Thu, 30 Jan, 18:18
Evan R. Sparks Re: Problem with flatmap. Thu, 30 Jan, 18:32
Evan R. Sparks Re: Python API Performance Thu, 30 Jan, 19:51
Evan Sparks Re: performance Thu, 09 Jan, 01:28
Evan Sparks Re: .intersection() method on RDDs? Fri, 24 Jan, 06:50
Evgeniy Shishkin Re: NoSuchMethodError: org.apache.commons.io.IOUtils.closeQuietly with cdh4 binary Fri, 10 Jan, 12:47
Ewen Cheslack-Postava Re: newbie : java.lang.OutOfMemoryError: Java heap space Thu, 09 Jan, 01:44
Ewen Cheslack-Postava Re: How does shuffle work in spark ? Thu, 16 Jan, 21:08
Ewen Cheslack-Postava Re: How does shuffle work in spark ? Thu, 16 Jan, 21:40
Ewen Cheslack-Postava Re: Running K-Means on a cluster setup Wed, 22 Jan, 22:11
Frank Austin Nothaft Re: How to create RDD over hashmap? Fri, 24 Jan, 21:00
Guillaume Pitel Re: How to map each line to (line number, line)? Wed, 01 Jan, 12:05
Guillaume Pitel Re: Turning kryo on does not decrease binary output Fri, 03 Jan, 16:56
Guillaume Pitel Re: Turning kryo on does not decrease binary output Fri, 03 Jan, 17:58
Guillaume Pitel Re: Turning kryo on does not decrease binary output Fri, 03 Jan, 18:42
Guillaume Pitel Re: Turning kryo on does not decrease binary output Fri, 03 Jan, 19:26
Guillaume Pitel Re: Turning kryo on does not decrease binary output Fri, 03 Jan, 19:40
Guillaume Pitel Re: Turning kryo on does not decrease binary output Fri, 03 Jan, 20:25
Guillaume Pitel Troubles with the Spark-EC2 stuff Sat, 04 Jan, 20:54
Guillaume Pitel Re: Troubles with the Spark-EC2 stuff Sat, 04 Jan, 22:04
Guillaume Pitel Dying workers since migration to 0.8.1 Wed, 08 Jan, 13:28
Guillaume Pitel Re: Dying workers since migration to 0.8.1 Thu, 09 Jan, 08:24
Guillaume Pitel Re: Dying workers since migration to 0.8.1 Fri, 17 Jan, 14:45
Guillaume Pitel Forcing RDD computation with something else than count() ? Tue, 21 Jan, 09:02
Guillaume Pitel Re: Forcing RDD computation with something else than count() ? Tue, 21 Jan, 13:05
Guillaume Pitel Re: Forcing RDD computation with something else than count() ? Wed, 22 Jan, 08:50
Guillaume Pitel Advices if your worker die often Thu, 23 Jan, 10:56
Guillaume Pitel Re: Exception in thread "DAGScheduler" java.lang.OutOfMemoryError: GC overhead limit exceeded Thu, 23 Jan, 19:52
Guillaume Pitel Re: How to create RDD over hashmap? Fri, 24 Jan, 21:31
Guillermo Cabrera Connecting to remote Spark cluster using Java+Maven Fri, 31 Jan, 20:39
Heiko Braun Purpose of the HTTP Server? Mon, 27 Jan, 14:15
Heiko Braun Re: Purpose of the HTTP Server? Mon, 27 Jan, 15:03
Heiko Braun Re: Cassandra composite and simple keys Fri, 31 Jan, 15:53
Huangguowei 答复: squestion on using spark parallelism vs using num partitions in spark api Tue, 14 Jan, 12:42
Hussam_Jar...@Dell.com is saveAsTextFile in java uses buffered I/O streams? Thu, 09 Jan, 22:54
Hussam_Jar...@Dell.com possible major memory problem in saveAsTextFile Fri, 10 Jan, 01:53
Hussam_Jar...@Dell.com Please help: possible major memory problem in saveAsTextFile Fri, 10 Jan, 17:26
Hussam_Jar...@Dell.com RE: Please help: possible major memory problem in saveAsTextFile Fri, 10 Jan, 20:52
Hussam_Jar...@Dell.com squestion on using spark parallelism vs using num partitions in spark api Tue, 14 Jan, 01:17
Hussam_Jar...@Dell.com RE: squestion on using spark parallelism vs using num partitions in spark api Tue, 14 Jan, 18:35
Hussam_Jar...@Dell.com SparkException: Expect only DirectTaskResults when using localScheduler() Sat, 18 Jan, 00:34
Hussam_Jar...@Dell.com RE: SparkException: Expect only DirectTaskResults when using localScheduler() Mon, 20 Jan, 20:04
Hussam_Jar...@Dell.com Error: Could not find or load main class org.apache.spark.executor.CoarseGrainedExecutorBackend Tue, 21 Jan, 00:44
Ian O'Connell Re: .intersection() method on RDDs? Fri, 24 Jan, 05:26
Imran Rashid Re: Turning kryo on does not decrease binary output Fri, 03 Jan, 19:41
Imran Rashid Re: SequenceFileRDDFunctions cannot be used output of spark package Sat, 04 Jan, 16:22
Imran Rashid Re: ADD_JARS doesn't properly work for spark-shell Sun, 05 Jan, 02:31
Imran Rashid Re: executor failed, cannot find compute-classpath.sh Fri, 24 Jan, 10:05
Imran Rashid setting partitioners with hadoop rdds Tue, 28 Jan, 07:57
Imran Rashid Re: setting partitioners with hadoop rdds Tue, 28 Jan, 15:15
Ionized Exception in serialization hangs saving-to-disk Tue, 28 Jan, 10:26
Ionized Re: Exception in serialization hangs saving-to-disk Tue, 28 Jan, 22:17
Issac Buenrostro Executor metrics in spark application Thu, 02 Jan, 19:18
Issac Buenrostro Re: Lzo + Protobuf Tue, 21 Jan, 17:32
Issac Buenrostro Re: Lzo + Protobuf Wed, 22 Jan, 21:37
Issac Buenrostro Re: Lzo + Protobuf Wed, 29 Jan, 17:40
Izhar ul Hassan Re: yarn SPARK_CLASSPATH Mon, 13 Jan, 22:19
Jason Dai Re: shared variable and ALS in mllib Tue, 07 Jan, 04:27
Jason Lenderman Re: Does foreach operation increase rdd lineage? Sat, 25 Jan, 22:40
Jeff Higgens Re: Running Spark jar on EC2 Wed, 01 Jan, 23:36
Jeff Higgens Re: Running Spark jar on EC2 Thu, 02 Jan, 00:19
Jeremy Freeman Stalling during large iterative PySpark jobs Mon, 13 Jan, 04:45
Jeremy Freeman Re: Stalling during large iterative PySpark jobs Wed, 22 Jan, 23:03
Jeremy Freeman Re: Stalling during large iterative PySpark jobs Mon, 27 Jan, 06:45
Jeremy Freeman Re: Python API Performance Thu, 30 Jan, 19:44
Jey Kottalam Re: Unable to connect spark 0.8.1 (built for hadoop 2.2.0) to connect to mesos 0.14.2 Sat, 04 Jan, 05:21
Jey Kottalam Re: FileNotFoundException on distinct()? Sat, 18 Jan, 17:12
Jey Kottalam Re: Quality of documentation (rant) Mon, 20 Jan, 22:59
Jey Kottalam Re: FileNotFoundException on distinct()? Tue, 21 Jan, 01:32
Jey Kottalam Re: Too many RDD partititons ??? Thu, 23 Jan, 21:55
Jey Kottalam Re: Giraph Vs SPARK Thu, 23 Jan, 22:14
Jey Kottalam Re: Cannot get Hadoop dependencies Mon, 27 Jan, 20:24
John Salvatier Sporadic "IOException: Class not found" in ClosureCleaner Mon, 27 Jan, 23:39
John Zhao Re: yarn SPARK_CLASSPATH Mon, 13 Jan, 21:57
John Zhao Anyone know hot to submit spark job to yarn in java code? Wed, 15 Jan, 18:25
Josh Rosen Re: Troubles with the Spark-EC2 stuff Sat, 04 Jan, 21:13
Josh Rosen Re: hadoop files in Python Thu, 09 Jan, 19:19
Josh Rosen Re: Please help: possible major memory problem in saveAsTextFile Fri, 10 Jan, 19:05
Josh Rosen Re: Spark on google compute engine Mon, 13 Jan, 17:59
Josh Rosen Re: .intersection() method on RDDs? Fri, 24 Jan, 07:09
Josh Rosen Re: Pyspark job not starting Fri, 24 Jan, 22:20
Josh Rosen Re: Non-interactive job fails to copy local variable to remote machines Wed, 29 Jan, 22:57
Josh Rosen Re: Python API Performance Fri, 31 Jan, 22:22
Justin Re: SparkR dev preview package errors when other packages are loaded Wed, 29 Jan, 19:30
Justin Re: SparkR dev preview package errors when other packages are loaded Wed, 29 Jan, 20:38
Justin Re: SparkR dev preview package errors when other packages are loaded Wed, 29 Jan, 20:41
Justin Lent SparkR dev preview package errors when other packages are loaded Wed, 29 Jan, 16:51
Justin Lent SparkR: filter() function? Thu, 30 Jan, 01:45
Jyun-Fan Tsai How to increase spark.worker.timeout? Thu, 09 Jan, 09:47
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next »Thread · Author · Date
Box list
Sep 202197
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137