spark-user mailing list archives: October 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · Next »Thread · Author · Date
Sean Owen Re: preferredNodeLocationData, SPARK-8949, and SparkContext - a leftover? Sun, 04 Oct, 09:50
Sean Owen Re: Broadcast var is null Tue, 06 Oct, 14:43
Sean Owen Re: does KafkaCluster can be public ? Tue, 06 Oct, 14:45
Sean Owen Re: Does feature parity exist between Spark and PySpark Wed, 07 Oct, 08:02
Sean Owen Re: RDD of ImmutableList Wed, 07 Oct, 13:08
Sean Owen Re: spark performance non-linear response Wed, 07 Oct, 15:45
Sean Owen Re: Spark standalone hangup during shuffle flatMap or explode in cluster Wed, 07 Oct, 17:37
Sean Owen Re: spark performance non-linear response Thu, 08 Oct, 08:52
Sean Owen Re: spark performance non-linear response Thu, 08 Oct, 19:35
Sean Owen Re: Different partition number of GroupByKey leads different result Fri, 09 Oct, 09:22
Sean Owen Re: Different partition number of GroupByKey leads different result Fri, 09 Oct, 09:37
Sean Owen Re: Different partition number of GroupByKey leads different result Fri, 09 Oct, 10:17
Sean Owen Re: Is there any better way of writing this code Mon, 12 Oct, 11:51
Sean Owen Re: Cannot get spark-streaming_2.10-1.5.0.pom from the maven repository Tue, 13 Oct, 04:57
Sean Owen Re: Ensuring eager evaluation inside mapPartitions Fri, 16 Oct, 10:08
Sean Owen Re: Ahhhh... Spark creates >30000 partitions... What can I do? Tue, 20 Oct, 12:42
Sean Owen Re: Top 10 count Tue, 20 Oct, 15:07
Sean Owen Re: mailing list subscription Tue, 20 Oct, 16:24
Sean Owen Re: Maven Repository Hosting for Spark SQL 1.5.1 Thu, 22 Oct, 20:44
Sean Owen Re: Maven build failed (Spark master) Fri, 23 Oct, 13:17
Sean Owen Re: I don't understand what this sentence means."7.1 GB of 7 GB physical memory used" Fri, 23 Oct, 13:48
Sean Owen Re: Newbie Help for spark compilation problem Sun, 25 Oct, 16:29
Sean Owen Re: Newbie Help for spark compilation problem Sun, 25 Oct, 20:07
Sean Owen Re: Loading Files from HDFS Incurs Network Communication Mon, 26 Oct, 09:00
Sean Owen Re: Loading Files from HDFS Incurs Network Communication Mon, 26 Oct, 09:18
Sean Owen Re: Loading Files from HDFS Incurs Network Communication Mon, 26 Oct, 09:31
Sean Owen Re: Loading Files from HDFS Incurs Network Communication Mon, 26 Oct, 11:21
Sean Owen Re: Loading Files from HDFS Incurs Network Communication Mon, 26 Oct, 11:44
Sean Owen Re: Error Compiling Spark 1.4.1 w/ Scala 2.11 & Hive Support Mon, 26 Oct, 14:28
Sean Owen Re: Problem with make-distribution.sh Mon, 26 Oct, 17:29
Sean Owen Re: doc building process hangs on Failed to load class “org.slf4j.impl.StaticLoggerBinder” Tue, 27 Oct, 14:31
Sebastian Kuepers Save RandomForest Model from ML package Thu, 22 Oct, 12:33
Sebastian Nadorp Re: [spark1.5.1] HiveQl.parse throws org.apache.spark.sql.AnalysisException: null Wed, 21 Oct, 10:06
Sebastian YEPES FERNANDEZ HTTP 500 if try to access Spark UI in yarn-cluster (only) Fri, 16 Oct, 14:39
Sela, Amit NullPointerException when adding to accumulator Wed, 14 Oct, 14:30
Sela, Amit Re: NullPointerException when adding to accumulator Wed, 14 Oct, 14:46
Sela, Amit Re: NullPointerException when adding to accumulator Thu, 15 Oct, 06:03
Sela, Amit Re: NullPointerException when adding to accumulator Thu, 15 Oct, 07:35
Sela, Amit Accumulators internals and reliability Mon, 26 Oct, 09:13
Shams ul Haque Separate all values from Iterable Tue, 27 Oct, 10:50
Shepherd Question of RDD in calculation Fri, 16 Oct, 19:14
Shepherd How to calculate row by now and output retults in Spark Mon, 19 Oct, 17:35
Shepherd Filter RDD Mon, 19 Oct, 23:27
Shepherd Get statistic result from RDD Tue, 20 Oct, 20:33
Shixiong Zhu Re: What is the best way to submit multiple tasks? Thu, 01 Oct, 06:21
Shixiong Zhu Re: Worker node timeout exception Thu, 01 Oct, 06:23
Shixiong Zhu Re: Spark Streaming Standalone 1.5 - Stage cancelled because SparkContext was shut down Thu, 01 Oct, 06:28
Shixiong Zhu Re: calling persist would cause java.util.NoSuchElementException: key not found: Fri, 02 Oct, 06:36
Shixiong Zhu Re: What is the abstraction for a Worker process in Spark code Mon, 12 Oct, 13:20
Shixiong Zhu Re: Spark UI consuming lots of memory Tue, 13 Oct, 03:17
Shixiong Zhu Re: Creating Custom Receiver for Spark Streaming Tue, 13 Oct, 03:25
Shixiong Zhu Re: Unexplained sleep time Tue, 13 Oct, 03:38
Shixiong Zhu Re: Data skipped while writing Spark Streaming output to HDFS Tue, 13 Oct, 03:47
Shixiong Zhu Re: Spark UI consuming lots of memory Tue, 13 Oct, 03:59
Shixiong Zhu Re: Spark UI consuming lots of memory Tue, 13 Oct, 04:00
Shixiong Zhu Re: [SQL] Memory leak with spark streaming and spark sql in spark 1.5.1 Thu, 15 Oct, 06:31
Shixiong Zhu Re: NullPointerException when adding to accumulator Thu, 15 Oct, 06:45
Shixiong Zhu Re: spark-shell :javap fails with complaint about JAVA_HOME, but it is set correctly Thu, 15 Oct, 07:46
Shreeharsha G Neelakantachar java.io.InvalidClassException using spark1.4.1 for Terasort Wed, 14 Oct, 08:42
Shyam Parimal Katti Multiple joins in Spark Sat, 17 Oct, 00:01
Shyam Parimal Katti Re: Multiple joins in Spark Tue, 20 Oct, 13:24
Siegfried Bilstein Re: Does feature parity exist between Spark and PySpark Wed, 07 Oct, 00:49
Silvio Fiorito Re: Java REST custom receiver Thu, 01 Oct, 21:40
Silvio Fiorito RE: Dynamic Resource Allocation with Spark Streaming (Standalone Cluster, Spark 1.5.1) Mon, 26 Oct, 21:26
Silvio Fiorito RE: Concurrent execution of actions within a driver Tue, 27 Oct, 05:08
Silvio Fiorito RE: Maintaining overall cumulative data in Spark Streaming Thu, 29 Oct, 22:57
Silvio Fiorito Re: Maintaining overall cumulative data in Spark Streaming Fri, 30 Oct, 14:00
Silvio Fiorito Re: how to merge two dataframes Fri, 30 Oct, 20:02
Silvio Fiorito RE: key not found: sportingpulse.com in Spark SQL 1.5.0 Fri, 30 Oct, 22:40
Silvio Fiorito Re: key not found: sportingpulse.com in Spark SQL 1.5.0 Sat, 31 Oct, 01:31
Simon Elliston Ball Re: Running 2 spark application in parallel Thu, 22 Oct, 18:40
Simon Hafner Compiling spark 1.5.1 fails with scala.reflect.internal.Types$TypeError: bad symbolic reference. Fri, 16 Oct, 14:54
Simon Hebert Trying PCA on spark but serialization is error thrown Tue, 06 Oct, 15:12
Sjoerd Mulder Re: If you use Spark 1.5 and disabled Tungsten mode ... Tue, 27 Oct, 19:56
Sjoerd Mulder Re: If you use Spark 1.5 and disabled Tungsten mode ... Tue, 27 Oct, 20:12
Snehal Nagmote Getting spark application driver ID programmatically Thu, 01 Oct, 17:44
Something Something Creating Custom Receiver for Spark Streaming Mon, 12 Oct, 15:47
Something Something Storing object in spark streaming Mon, 12 Oct, 21:03
Sonal Goyal Re: java.io.InvalidClassException using spark1.4.1 for Terasort Wed, 14 Oct, 11:41
Sonal Goyal Re: In-memory computing and cache() in Spark Mon, 19 Oct, 05:32
Sonal Goyal Re: Spark: How to find similar text title Tue, 20 Oct, 16:06
Sourabh Chandak spark.streaming.kafka.maxRatePerPartition for direct stream Thu, 01 Oct, 20:39
Sourabh Chandak Re: spark.streaming.kafka.maxRatePerPartition for direct stream Fri, 02 Oct, 06:10
Sourabh Chandak Checkpointing is super slow Fri, 02 Oct, 06:17
Sourabh Chandak Re: Checkpointing is super slow Fri, 02 Oct, 16:35
Sourabh Chandak Re: Checkpointing is super slow Fri, 02 Oct, 21:56
Sourabh Chandak Re: Checkpointing is super slow Sat, 03 Oct, 01:28
Sourav Mazumder Sensitivity analysis using Spark MlLib Thu, 15 Oct, 03:37
Sourav Mazumder SQL Context error in 1.5.1 - any work around ? Thu, 15 Oct, 16:59
Sourav Mazumder java.util.NoSuchElementException: key not found error Wed, 21 Oct, 23:40
Spark Newbie Spark checkpoint restore failure due to s3 consistency issue Fri, 09 Oct, 21:13
Spark Newbie Re: Spark checkpoint restore failure due to s3 consistency issue Fri, 09 Oct, 21:34
Spark Newbie DEBUG level log in receivers and executors Mon, 12 Oct, 23:09
Spark Newbie Spark 1.5 java.net.ConnectException: Connection refused Tue, 13 Oct, 21:47
Spark Newbie Re: Spark 1.5 java.net.ConnectException: Connection refused Wed, 14 Oct, 18:01
Spark Newbie Re: Spark 1.5 java.net.ConnectException: Connection refused Wed, 14 Oct, 18:05
Spark Newbie Re: Spark 1.5 java.net.ConnectException: Connection refused Thu, 15 Oct, 19:23
Spark Newbie Re: s3a file system and spark deployment mode Thu, 15 Oct, 19:26
Sri Re: Create hashmap using two RDD's Sat, 10 Oct, 22:07
Starch, Michael D (398M) Reusing Spark Functions Wed, 14 Oct, 17:18
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · Next »Thread · Author · Date
Box list
Nov 201973
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137