spark-user mailing list archives: July 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Ruchir Jha Debugging spark Sat, 19 Jul, 23:01
chutium Spark 1.0.1 SQL on 160 G parquet file (snappy compressed, made by cloudera impala), 23 core and 60G mem / node, yarn-client mode, always failed Sat, 19 Jul, 23:10
Yin Huai   Re: Spark 1.0.1 SQL on 160 G parquet file (snappy compressed, made by cloudera impala), 23 core and 60G mem / node, yarn-client mode, always failed Sun, 20 Jul, 00:46
chutium     Re: Spark 1.0.1 SQL on 160 G parquet file (snappy compressed, made by cloudera impala), 23 core and 60G mem / node, yarn-client mode, always failed Sun, 20 Jul, 15:58
Yin Huai       Re: Spark 1.0.1 SQL on 160 G parquet file (snappy compressed, made by cloudera impala), 23 core and 60G mem / node, yarn-client mode, always failed Mon, 21 Jul, 17:23
chutium         Re: Spark 1.0.1 SQL on 160 G parquet file (snappy compressed, made by cloudera impala), 23 core and 60G mem / node, yarn-client mode, always failed Mon, 21 Jul, 18:20
Aaron Davidson           Re: Spark 1.0.1 SQL on 160 G parquet file (snappy compressed, made by cloudera impala), 23 core and 60G mem / node, yarn-client mode, always failed Mon, 21 Jul, 19:58
chutium             Re: Spark 1.0.1 SQL on 160 G parquet file (snappy compressed, made by cloudera impala), 23 core and 60G mem / node, yarn-client mode, always failed Mon, 21 Jul, 20:46
Andre Schumacher               Re: Spark 1.0.1 SQL on 160 G parquet file (snappy compressed, made by cloudera impala), 23 core and 60G mem / node, yarn-client mode, always failed Tue, 22 Jul, 17:10
Sandy Ryza                 Re: Spark 1.0.1 SQL on 160 G parquet file (snappy compressed, made by cloudera impala), 23 core and 60G mem / node, yarn-client mode, always failed Tue, 22 Jul, 19:20
chutium                   Re: Spark 1.0.1 SQL on 160 G parquet file (snappy compressed, made by cloudera impala), 23 core and 60G mem / node, yarn-client mode, always failed Wed, 23 Jul, 11:38
Hu, Leo spark1.0.1 & hadoop2.2.0 issue Sun, 20 Jul, 01:16
Debasish Das   Re: spark1.0.1 & hadoop2.2.0 issue Sun, 20 Jul, 03:14
Debasish Das     Re: spark1.0.1 & hadoop2.2.0 issue Sun, 20 Jul, 07:08
Chris DuBois Launching with m3.2xlarge instances: /mnt and /mnt2 mounted on 7gb drive Sun, 20 Jul, 08:22
Matei Zaharia   Re: Launching with m3.2xlarge instances: /mnt and /mnt2 mounted on 7gb drive Sun, 20 Jul, 21:08
Chris DuBois     Re: Launching with m3.2xlarge instances: /mnt and /mnt2 mounted on 7gb drive Sun, 20 Jul, 21:25
Matei Zaharia       Re: Launching with m3.2xlarge instances: /mnt and /mnt2 mounted on 7gb drive Sun, 20 Jul, 23:35
Xiangrui Meng         Re: Launching with m3.2xlarge instances: /mnt and /mnt2 mounted on 7gb drive Mon, 21 Jul, 23:28
Ahmed Ibrahim JDBC Connections / newbie question Sun, 20 Jul, 18:18
jay vyas RDD.pipe(...) Sun, 20 Jul, 20:09
jay vyas   Re: RDD.pipe(...) Sun, 20 Jul, 20:14
Ahmed Ibrahim JDBCRDD / Example Mon, 21 Jul, 01:27
Frank van Lankvelt   Re: JDBCRDD / Example Mon, 21 Jul, 12:34
我是will What does @developerApi means? Mon, 21 Jul, 03:46
Stephen Boesch   Re: What does @developerApi means? Mon, 21 Jul, 03:55
william     回复: What does @developerApi means? Mon, 21 Jul, 05:52
william which kind of BlockId should I use? Mon, 21 Jul, 05:25
Aaron Davidson   Re: which kind of BlockId should I use? Mon, 21 Jul, 05:40
william     回复: which kind of BlockId should I use? Mon, 21 Jul, 05:53
Jiusheng Chen LabeledPoint with weight Mon, 21 Jul, 07:58
Xiangrui Meng   Re: LabeledPoint with weight Mon, 21 Jul, 19:20
Brian Cohn Data row-operation processing advice Mon, 21 Jul, 10:04
binbinbin915 Can't see any thing one the storage panel of application UI Mon, 21 Jul, 10:46
Preeti Khurana   Re: Can't see any thing one the storage panel of application UI Mon, 21 Jul, 10:50
Yifan LI java.lang.OutOfMemoryError: GC overhead limit exceeded Mon, 21 Jul, 12:48
Abel Coronado Iruegas   Re: java.lang.OutOfMemoryError: GC overhead limit exceeded Mon, 21 Jul, 14:16
Yifan LI     Re: java.lang.OutOfMemoryError: GC overhead limit exceeded Mon, 21 Jul, 14:56
Nan Zhu DROP IF EXISTS still throws exception about "table does not exist"? Mon, 21 Jul, 14:10
Nan Zhu   Re: DROP IF EXISTS still throws exception about "table does not exist"? Mon, 21 Jul, 14:10
Yin Huai     Re: DROP IF EXISTS still throws exception about "table does not exist"? Mon, 21 Jul, 21:00
Nan Zhu       Re: DROP IF EXISTS still throws exception about "table does not exist"? Mon, 21 Jul, 23:19
hawkwang Is there anyone who use streaming join to filter spam as guide mentioned? Mon, 21 Jul, 14:23
Tathagata Das   Re: Is there anyone who use streaming join to filter spam as guide mentioned? Mon, 21 Jul, 21:58
hawkwang     Re: Is there anyone who use streaming join to filter spam as guide mentioned? Tue, 22 Jul, 14:27
Sam Liu Why spark-submit command hangs? Mon, 21 Jul, 14:47
Andrew Or   Re: Why spark-submit command hangs? Mon, 21 Jul, 17:31
Earthson     Re: Why spark-submit command hangs? Tue, 22 Jul, 08:25
Andrew Or       Re: Why spark-submit command hangs? Tue, 22 Jul, 17:54
Earthson   Re: Why spark-submit command hangs? Tue, 22 Jul, 08:22
Harry Brundage Is deferred execution of multiple RDDs ever coming? Mon, 21 Jul, 15:23
mrm gain access to persisted rdd Mon, 21 Jul, 15:37
Andrew Or   Re: gain access to persisted rdd Mon, 21 Jul, 17:56
chutium     Re: gain access to persisted rdd Mon, 21 Jul, 18:25
mrm       Re: gain access to persisted rdd Tue, 22 Jul, 08:24
Nick R. Katsipoulakis Give more Java Heap Memory on Standalone mode Mon, 21 Jul, 16:35
Abel Coronado Iruegas   Re: Give more Java Heap Memory on Standalone mode Mon, 21 Jul, 16:42
Nick R. Katsipoulakis     Re: Give more Java Heap Memory on Standalone mode Mon, 21 Jul, 17:01
Andrew Or       Re: Give more Java Heap Memory on Standalone mode Mon, 21 Jul, 18:07
Philip Ogren relationship of RDD[Array[String]] to Array[Array[String]] Mon, 21 Jul, 17:01
Michael Malak   Re: relationship of RDD[Array[String]] to Array[Array[String]] Mon, 21 Jul, 17:20
Philip Ogren     Re: relationship of RDD[Array[String]] to Array[Array[String]] Mon, 21 Jul, 17:46
andy petrella   Re: relationship of RDD[Array[String]] to Array[Array[String]] Mon, 21 Jul, 17:22
Re: LiveListenerBus throws exception and weird web UI bug
mrm   Re: LiveListenerBus throws exception and weird web UI bug Mon, 21 Jul, 17:23
Andrew Or     Re: LiveListenerBus throws exception and weird web UI bug Mon, 21 Jul, 17:50
余根茂(木艮)       答复: LiveListenerBus throws exception and weird web UI bug Tue, 22 Jul, 00:15
Jaonary Rabarisoa RDD pipe partitionwise Mon, 21 Jul, 17:51
M@ launching a spark cluster in ec2 from within an application Mon, 21 Jul, 19:04
srinivas Does spark streaming fit to our application Mon, 21 Jul, 20:54
Nan Zhu broadcast variable get cleaned by ContextCleaner unexpectedly ? Mon, 21 Jul, 21:29
Tathagata Das   Re: broadcast variable get cleaned by ContextCleaner unexpectedly ? Mon, 21 Jul, 21:40
Nan Zhu     Re: broadcast variable get cleaned by ContextCleaner unexpectedly ? Mon, 21 Jul, 22:11
Nan Zhu       Re: broadcast variable get cleaned by ContextCleaner unexpectedly ? Mon, 21 Jul, 22:52
Tathagata Das         Re: broadcast variable get cleaned by ContextCleaner unexpectedly ? Mon, 21 Jul, 23:17
Nan Zhu           Re: broadcast variable get cleaned by ContextCleaner unexpectedly ? Mon, 21 Jul, 23:47
Marcelo Elias Del Valle Spark Partitioner vs Cassandra Partitioner Mon, 21 Jul, 22:16
umeshdangat unable to create rdd with pyspark newAPIHadoopRDD Mon, 21 Jul, 23:10
Re: How to map each line to (line number, line)?
Andrew Ash   Re: How to map each line to (line number, line)? Mon, 21 Jul, 23:40
durga Joining by timestamp. Tue, 22 Jul, 00:41
Cheng, Hao   RE: Joining by timestamp. Tue, 22 Jul, 01:33
durga     RE: Joining by timestamp. Tue, 22 Jul, 03:55
Cheng, Hao       RE: Joining by timestamp. Tue, 22 Jul, 04:30
durga         RE: Joining by timestamp. Tue, 22 Jul, 04:45
Cheng, Hao           RE: Joining by timestamp. Tue, 22 Jul, 05:43
durga             RE: Joining by timestamp. Wed, 23 Jul, 00:33
Barnaby saveAsSequenceFile for DStream Tue, 22 Jul, 01:06
Sean Owen   Re: saveAsSequenceFile for DStream Tue, 22 Jul, 08:56
Barnaby Falls     Re: saveAsSequenceFile for DStream Tue, 22 Jul, 15:39
omergul123 Understanding Spark Tue, 22 Jul, 01:49
Wang, Jensen defaultMinPartitions in textFile Tue, 22 Jul, 02:18
Ye Xianjin   Re: defaultMinPartitions in textFile Tue, 22 Jul, 03:37
Wang, Jensen     RE: defaultMinPartitions in textFile Tue, 22 Jul, 03:46
Bin WU Question about initial message in graphx Tue, 22 Jul, 03:05
Ankur Dave   Re: Question about initial message in graphx Tue, 22 Jul, 03:20
Nathan Kronenfeld new error for me Tue, 22 Jul, 03:35
phoenix bai   Re: new error for me Thu, 24 Jul, 13:12
Re: Executor metrics in spark application
Denes   Re: Executor metrics in spark application Tue, 22 Jul, 06:01
Denes     Re: Executor metrics in spark application Tue, 22 Jul, 06:24
Shao, Saisai     RE: Executor metrics in spark application Tue, 22 Jul, 06:40
Denes       RE: Executor metrics in spark application Tue, 22 Jul, 10:38
Shao, Saisai         RE: Executor metrics in spark application Tue, 22 Jul, 13:00
Denes           RE: Executor metrics in spark application Wed, 23 Jul, 05:46
Haopu Wang number of "Cached Partitions" v.s. "Total Partitions" Tue, 22 Jul, 07:09
Shao, Saisai   RE: number of "Cached Partitions" v.s. "Total Partitions" Tue, 22 Jul, 07:38
jay vyas Spark over graphviz (SPARK-1015, SPARK-975) Tue, 22 Jul, 12:57
Sparky collect() on small group of Avro files causes plain NullPointerException Tue, 22 Jul, 13:01
Sparky   Re: collect() on small list causes NullPointerException Tue, 22 Jul, 13:18
Eugen Cepoi   Re: collect() on small group of Avro files causes plain NullPointerException Tue, 22 Jul, 13:28
mrm hadoop version Tue, 22 Jul, 14:07
Andrew Or   Re: hadoop version Tue, 22 Jul, 17:57
mrm     Re: hadoop version Wed, 23 Jul, 09:57
Yifan LI the implications of some items in webUI Tue, 22 Jul, 14:08
Ankur Dave   Re: the implications of some items in webUI Wed, 23 Jul, 00:26
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Box list
Sep 2020116
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137