spark-user mailing list archives: April 2014

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
张志齐 Too many tasks in reduceByKey() when do PageRank iteration Fri, 11 Apr, 13:32
zhxfl How to start history tracking URL Fri, 04 Apr, 13:10
Christophe Préaud Re: How to create a RPM package Fri, 04 Apr, 14:25
Christophe Préaud SPARK_YARN_APP_JAR, SPARK_CLASSPATH and ADD_JARS in a spark-shell on YARN Wed, 16 Apr, 16:27
Christophe Préaud Re: read file from hdfs Fri, 25 Apr, 15:08
Jérémy Subtil Re: Behaviour of caching when dataset does not fit into memory Fri, 11 Apr, 12:49
尹绪森 Re: Behaviour of caching when dataset does not fit into memory Fri, 11 Apr, 09:44
诺铁 confused by reduceByKey usage Thu, 17 Apr, 16:29
诺铁 Re: confused by reduceByKey usage Thu, 17 Apr, 22:53
诺铁 Re: confused by reduceByKey usage Fri, 18 Apr, 01:48
诺铁 Re: confused by reduceByKey usage Fri, 18 Apr, 03:33
Christophe Préaud Re: File list read into single RDD Tue, 29 Apr, 07:55
François Le Lay [ann] Spark-NYC Meetup Mon, 21 Apr, 20:31
Luis Ángel Vicente Sánchez Re: Anyone using value classes in RDDs? Sun, 20 Apr, 14:24
zhxfl Hadoop—streaming Wed, 23 Apr, 09:09
肥肥 SparkException: env SPARK_YARN_APP_JAR is not set Wed, 23 Apr, 10:05
林武康 issue of driver's HA Wed, 09 Apr, 04:07
Christoph Böhm Re: spark-shell on standalone cluster gives error " no mesos in java.library.path" Tue, 08 Apr, 13:06
Christophe Préaud Re: SPARK_YARN_APP_JAR, SPARK_CLASSPATH and ADD_JARS in a spark-shell on YARN Wed, 23 Apr, 15:07
Christophe Préaud Re: SPARK_YARN_APP_JAR, SPARK_CLASSPATH and ADD_JARS in a spark-shell on YARN Thu, 24 Apr, 07:47
Aaron Davidson Re: Best practices: Parallelized write to / read from S3 Tue, 01 Apr, 21:03
Aaron Davidson Re: Generic types and pair RDDs Tue, 01 Apr, 21:10
Aaron Davidson Re: PySpark RDD.partitionBy() requires an RDD of tuples Tue, 01 Apr, 23:38
Aaron Davidson Re: Urgently need help interpreting duration Tue, 08 Apr, 16:21
Aaron Davidson Re: Urgently need help interpreting duration Tue, 08 Apr, 16:24
Aaron Davidson Re: Driver Out of Memory Tue, 08 Apr, 16:32
Aaron Davidson Re: assumption that lib_managed is present Tue, 08 Apr, 18:27
Aaron Davidson Re: Multi master Spark Thu, 10 Apr, 00:35
Aaron Davidson Re: Using pyspark shell in local[n] (single machine) mode unnecessarily tries to connect to HDFS NameNode ... Thu, 10 Apr, 22:00
Aaron Davidson Re: Master registers itself at startup? Sun, 13 Apr, 08:14
Aaron Davidson Re: Master registers itself at startup? Sun, 13 Apr, 08:17
Aaron Davidson Re: Master registers itself at startup? Sun, 13 Apr, 23:22
Aaron Davidson Re: Spark resilience Mon, 14 Apr, 17:30
Aaron Davidson Re: storage.MemoryStore estimated size 7 times larger than real Tue, 15 Apr, 03:00
Aaron Davidson Re: Spark resilience Tue, 15 Apr, 03:12
Aaron Davidson Re: Lost an executor error - Jobs fail Tue, 15 Apr, 03:47
Aaron Davidson Re: Lost an executor error - Jobs fail Tue, 15 Apr, 06:35
Aaron Davidson Re: storage.MemoryStore estimated size 7 times larger than real Tue, 15 Apr, 07:13
Aaron Davidson Re: storage.MemoryStore estimated size 7 times larger than real Tue, 15 Apr, 16:46
Aaron Davidson Re: partitioning of small data sets Tue, 15 Apr, 16:53
Aaron Davidson Re: can't sc.paralellize in Spark 0.7.3 spark-shell Tue, 15 Apr, 18:29
Aaron Davidson Re: Spark resilience Wed, 16 Apr, 06:49
Aaron Davidson Re: How do I access the SPARK SQL Thu, 24 Apr, 17:14
Aaron Davidson Re: parallelize for a large Seq is extreamly slow. Sat, 26 Apr, 17:30
Adam Novak Preconditions on RDDs for creating a Graph? Tue, 08 Apr, 21:33
Adnan How to execute a function from class in distributed jar on each worker node? Tue, 08 Apr, 10:05
Adnan Re: Executing spark jobs with predefined Hadoop user Thu, 10 Apr, 12:32
Adnan Re: Executing spark jobs with predefined Hadoop user Thu, 10 Apr, 13:40
Adnan Re: SparkPi performance-3 cluster standalone mode Thu, 24 Apr, 11:43
Adnan Yaqoob Re: how to set spark.executor.memory and heap size Thu, 24 Apr, 04:23
Adnan Yaqoob Re: Access Last Element of RDD Thu, 24 Apr, 05:00
Adnan Yaqoob Re: Access Last Element of RDD Thu, 24 Apr, 05:44
Adnan Yaqoob Re: how to set spark.executor.memory and heap size Thu, 24 Apr, 08:46
Adnan Yaqoob Re: how to set spark.executor.memory and heap size Thu, 24 Apr, 08:49
Adrian Mocanu writing booleans w Calliope Thu, 17 Apr, 20:11
Adrian Mocanu default spark partitioner Wed, 23 Apr, 15:21
Adrian Mocanu RE: default spark partitioner Wed, 23 Apr, 20:37
Adrian Mocanu reduceByKeyAndWindow - spark internals Thu, 24 Apr, 15:26
Adrian Mocanu FW: reduceByKeyAndWindow - spark internals Fri, 25 Apr, 13:45
Adrian Mocanu What is the recommended way to store state across RDDs? Mon, 28 Apr, 16:44
Adrian Mocanu What is Seq[V] in updateStateByKey? Tue, 29 Apr, 18:50
Adrian Mocanu RE: What is Seq[V] in updateStateByKey? Wed, 30 Apr, 20:23
Akhil Das Re: Java heap space and spark.akka.frameSize Inbox x Mon, 21 Apr, 06:19
Akhil Das Re: how to solve this problem? Tue, 22 Apr, 06:05
Akhil Das Re: no response in spark web UI Wed, 23 Apr, 05:39
Akhil Das Re: Securing Spark's Network Fri, 25 Apr, 17:50
Akhil Das Re: Spark & Shark 0.9.1 on ec2 with Hadoop 2 error Fri, 25 Apr, 17:58
Akhil Das Re: Build times for Spark Fri, 25 Apr, 21:09
Akhil Das Re: Securing Spark's Network Fri, 25 Apr, 22:06
Akhil Das Re: the spark configuage Wed, 30 Apr, 08:35
Akhil Das Re: the spark configuage Wed, 30 Apr, 08:36
Alex Boisvert Re: Spark - ready for prime time? Thu, 10 Apr, 15:08
Alex Boisvert Re: what is the best way to do cartesian Fri, 25 Apr, 16:32
Alex Dean Spark Example Project, runnable on EMR, open sourced Thu, 17 Apr, 14:10
Alex Dean Re: Spark Example Project, runnable on EMR, open sourced Fri, 18 Apr, 06:30
All In A Days Work Example of creating expressions for SchemaRDD methods Thu, 03 Apr, 04:52
All In A Days Work Re: Example of creating expressions for SchemaRDD methods Fri, 04 Apr, 04:12
All In A Days Work Ooyala Server - plans to merge it into Apache ? Fri, 18 Apr, 04:12
All In A Days Work Re: Ooyala Server - plans to merge it into Apache ? Fri, 25 Apr, 03:54
Alton Alexander Re: Using pyspark shell in local[n] (single machine) mode unnecessarily tries to connect to HDFS NameNode ... Thu, 10 Apr, 20:20
Alton Alexander 0.9 wont start cluster on ec2, SSH connection refused? Fri, 11 Apr, 19:37
Alton Alexander Re: 0.9 wont start cluster on ec2, SSH connection refused? Fri, 11 Apr, 19:46
Ameet Kini shuffle memory requirements Thu, 10 Apr, 02:48
Ameet Kini Re: shuffle memory requirements Fri, 11 Apr, 14:32
Ameet Kini Re: shuffle memory requirements Fri, 11 Apr, 14:51
Ameet Kini Re: question on setup() and cleanup() methods for map() and reduce() Tue, 29 Apr, 01:31
Amit Tewari Re: Hadoop 2.X Spark Client Jar 0.9.0 problem Fri, 04 Apr, 14:56
Anand Avati Re: Spark on other parallel filesystems Sat, 05 Apr, 05:45
Andras Barjak Re: Spark runs applications in an inconsistent way Wed, 23 Apr, 09:43
Andras Nemeth Fwd: Spark - ready for prime time? Thu, 10 Apr, 14:11
Andras Nemeth Re: Spark - ready for prime time? Fri, 11 Apr, 15:22
Andras Nemeth Re: Using google cloud storage for spark big data Thu, 17 Apr, 09:24
Andras Nemeth Re: Using google cloud storage for spark big data Tue, 22 Apr, 09:50
Andras Nemeth Re: understanding stages Thu, 24 Apr, 10:26
Andras Nemeth Storage information about an RDD from the API Tue, 29 Apr, 16:34
Andras Nemeth Re: the spark configuage Wed, 30 Apr, 11:39
Andras Nemeth Re: NoSuchMethodError from Spark Java Wed, 30 Apr, 11:40
Andre Bois-Crettez Re: Spark program thows OutOfMemoryError Wed, 16 Apr, 09:49
Andre Bois-Crettez Re: Create cache fails on first time Thu, 17 Apr, 08:11
Andre Bois-Crettez Re: Spark running slow for small hadoop files of 10 mb size Tue, 22 Apr, 10:07
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Box list
Sep 2019120
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137