spark-user mailing list archives: October 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · Next »Thread · Author · Date
octavian.ganea Re: Accumulators : Task not serializable: java.io.NotSerializableException: org.apache.spark.SparkContext Sun, 26 Oct, 18:52
octavian.ganea Re: Bug in Accumulators... Mon, 27 Oct, 16:28
peng xia issue on applying SVM to 5 million examples. Thu, 30 Oct, 15:22
peng xia Re: issue on applying SVM to 5 million examples. Thu, 30 Oct, 18:44
peng xia Re: issue on applying SVM to 5 million examples. Fri, 31 Oct, 00:01
peng xia Re: issue on applying SVM to 5 million examples. Fri, 31 Oct, 00:25
pkl Spark tasks still scheduled after Spark goes down Wed, 15 Oct, 20:37
poiuytrez Bug a spark task Thu, 09 Oct, 13:16
poiuytrez Spark SQL - Exception only when using cacheTable Thu, 09 Oct, 13:37
poiuytrez Re: Bug a spark task Thu, 09 Oct, 14:25
poiuytrez Re: Spark SQL - Exception only when using cacheTable Fri, 10 Oct, 12:26
poiuytrez Re: Spark SQL - Exception only when using cacheTable Fri, 10 Oct, 12:28
poiuytrez Re: Spark SQL - Exception only when using cacheTable Mon, 13 Oct, 07:56
poiuytrez Spark dev environment best practices Wed, 15 Oct, 09:22
poiuytrez MLlib and pyspark features Fri, 17 Oct, 07:58
poiuytrez Re: MLlib linking error Mac OS X Fri, 17 Oct, 09:00
poiuytrez Re: MLlib linking error Mac OS X Mon, 20 Oct, 07:15
pol Configuration is not effective or configuration errors? Mon, 13 Oct, 09:19
preeze Designed behavior when master is unreachable. Fri, 17 Oct, 10:51
preeze Re: Designed behavior when master is unreachable. Mon, 20 Oct, 14:04
qihong Is possible to invoke updateStateByKey twice on the same RDD Fri, 10 Oct, 05:19
qinwei about aggregateByKey and standard deviation Fri, 31 Oct, 07:56
quintona Re: Hive Parquet Serde from Spark Tue, 07 Oct, 10:27
randylu something about rdd.collect Wed, 15 Oct, 01:25
randylu Re: something about rdd.collect Wed, 15 Oct, 02:43
randylu Re: something about rdd.collect Wed, 15 Oct, 03:42
randylu why do RDD's partitions migrate between worker nodes in different iterations Fri, 17 Oct, 09:32
randylu why does driver connects to master fail ? Sun, 19 Oct, 09:14
randylu Re: why does driver connects to master fail ? Sun, 19 Oct, 09:18
randylu Re: why does driver connects to master fail ? Mon, 20 Oct, 09:46
randylu Re: why does driver connects to master fail ? Tue, 21 Oct, 02:02
randylu Re: why does driver connects to master fail ? Tue, 21 Oct, 05:27
rapelly kartheek Rdd repartitioning Fri, 10 Oct, 16:01
rapelly kartheek How to convert a non-rdd data to rdd. Sun, 12 Oct, 06:15
rapelly kartheek Confusion with webUI parameters Mon, 13 Oct, 06:26
raymond Re: All executors run on just a few nodes Mon, 20 Oct, 03:35
raymond Re: All executors run on just a few nodes Mon, 20 Oct, 06:24
raymond SparkSQL , best way to divide data into partitions? Thu, 23 Oct, 02:03
rok sharing RDDs between PySpark and Scala Thu, 30 Oct, 10:11
rrussell25 Re: Running Spark cluster on local machine, cannot connect to master error Wed, 08 Oct, 20:29
rzykov Solution for small files in HDFS Wed, 01 Oct, 12:07
sadhan spark-sql failing for some tables in hive Thu, 09 Oct, 16:25
sadhan how to find the sources for spark-project Fri, 10 Oct, 23:24
sadhan Re: persist table schema in spark-sql Tue, 14 Oct, 14:56
sadhan Re: persist table schema in spark-sql Tue, 14 Oct, 15:06
sadhan spark sql not able to find classes with --jars option Mon, 20 Oct, 18:58
sadhan spark ui redirecting to port 8100 Tue, 21 Oct, 22:29
sadhan Re: spark sql not able to find classes with --jars option Tue, 21 Oct, 23:17
salemi rule engine based on spark Tue, 14 Oct, 22:21
sameerf Re: How to read BZ2 XML file in Spark? Tue, 21 Oct, 22:38
sameerf Re: Usage of spark-ec2: how to deploy a revised version of spark 1.1.0? Tue, 21 Oct, 22:52
sanath kumar spark sql query optimization , and decision tree building Wed, 22 Oct, 04:58
sanath kumar Re: spark sql query optimization , and decision tree building Wed, 22 Oct, 17:09
serkan.dogan spark 1.1.0 - hbase 0.98.6-hadoop2 version - py4j.protocol.Py4JJavaError java.lang.ClassNotFoundException Fri, 03 Oct, 08:53
serkan.dogan spark 1.1.0 - hbase 0.98.6-hadoop2 version - py4j.protocol.Py4JJavaError java.lang.ClassNotFoundException Fri, 03 Oct, 08:55
serkan.dogan Re: Fixed:spark 1.1.0 - hbase 0.98.6-hadoop2 version - py4j.protocol.Py4JJavaError java.lang.ClassNotFoundException Mon, 06 Oct, 07:22
shahab Nested Query using SparkSQL 1.1.0 Sun, 12 Oct, 21:20
shahab Is "Array Of Struct" supported in json RDDs? is it possible to query this? Mon, 13 Oct, 09:08
shahab Re: Nested Query using SparkSQL 1.1.0 Mon, 13 Oct, 14:50
shahab What's wrong with my spark filter? I get "org.apache.spark.SparkException: Task not serializable" Fri, 17 Oct, 10:37
shahab Does SQLSpark support Hive built in functions? Wed, 22 Oct, 21:20
shahab Measuring execution time Fri, 24 Oct, 12:51
shahab What this exception means? ConnectionManager: key already cancelled ? Mon, 27 Oct, 15:43
shahab Why RDD is not cached? Tue, 28 Oct, 07:18
shahab Re: Why RDD is not cached? Tue, 28 Oct, 08:18
shahab How many executor process does an application receives? Tue, 28 Oct, 09:56
shahab How can number of partitions be set in "spark-env.sh"? Tue, 28 Oct, 13:20
shahab Re: How can number of partitions be set in "spark-env.sh"? Tue, 28 Oct, 13:56
shahab Best way to partition RDD Thu, 30 Oct, 16:16
shahab Re: Best way to partition RDD Thu, 30 Oct, 17:22
shahab Doing RDD."count" in parallel , at at least parallelize it as much as possible? Thu, 30 Oct, 17:25
shahab Re: Best way to partition RDD Thu, 30 Oct, 21:45
shahab Accessing Cassandra with SparkSQL, Does not work? Fri, 31 Oct, 17:25
shahab Re: Accessing Cassandra with SparkSQL, Does not work? Fri, 31 Oct, 17:59
shahab Re: Accessing Cassandra with SparkSQL, Does not work? Fri, 31 Oct, 18:20
shuluster spark sql union all is slow Tue, 14 Oct, 18:51
sid Python code crashing on ReduceByKey if I return custom class object Mon, 27 Oct, 06:57
sid Re: Python code crashing on ReduceByKey if I return custom class object Tue, 28 Oct, 03:12
sivarani Re: checkpoint and not running out of disk space Mon, 20 Oct, 06:27
sivarani Submiting Spark application through code Tue, 28 Oct, 08:20
sivarani Re: Spark Streaming Applications Tue, 28 Oct, 08:23
sivarani Re: Spark Streaming - How to remove state for key Tue, 28 Oct, 08:26
sivarani Re: Submiting Spark application through code Tue, 28 Oct, 09:14
sivarani Streaming Question regarding lazy calculations Wed, 29 Oct, 12:55
sivarani Spark Streaming Issue not running 24/7 Fri, 31 Oct, 04:39
sivarani Re: Submiting Spark application through code Fri, 31 Oct, 06:14
skane Re: org/I0Itec/zkclient/serialize/ZkSerializer ClassNotFound Tue, 21 Oct, 05:15
sparkuser How to calculate percentiles with Spark? Tue, 21 Oct, 19:22
spr SparkStreaming program does not start Tue, 07 Oct, 22:47
spr Re: SparkStreaming program does not start Tue, 07 Oct, 23:09
spr Re: SparkStreaming program does not start Tue, 14 Oct, 18:10
spr what does DStream.union() do? Wed, 29 Oct, 22:15
spr how to extract/combine elements of an Array in DStream element? Wed, 29 Oct, 22:29
spr Re: what does DStream.union() do? Wed, 29 Oct, 22:39
spr does updateStateByKey accept a state that is a tuple? Thu, 30 Oct, 18:38
spr Re: does updateStateByKey accept a state that is a tuple? Thu, 30 Oct, 22:15
spr Re: does updateStateByKey accept a state that is a tuple? Fri, 31 Oct, 15:42
sranga Spark-Shell: OOM: GC overhead limit exceeded Wed, 08 Oct, 01:57
sranga Re: Spark-Shell: OOM: GC overhead limit exceeded Wed, 08 Oct, 15:53
st553 Re: How could I start new spark cluster with hadoop2.0.2 Wed, 08 Oct, 15:14
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · Next »Thread · Author · Date
Box list
Sep 202181
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137