spark-user mailing list archives: January 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Dmitriy Lyubimov Task result deserialization error (1.1.0) Wed, 21 Jan, 02:36
TJ Klein Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) Wed, 21 Jan, 05:00
Davies Liu   Re: Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) Wed, 21 Jan, 06:17
Tassilo Klein     Re: Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) Wed, 21 Jan, 07:12
Davies Liu       Re: Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) Wed, 21 Jan, 07:21
Tassilo Klein         Re: Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) Thu, 22 Jan, 00:56
Davies Liu           Re: Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) Thu, 22 Jan, 01:20
Tassilo Klein             Re: Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) Thu, 22 Jan, 01:53
critikaled   Re: Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) Wed, 21 Jan, 10:27
Davies Liu     Re: Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) Wed, 21 Jan, 18:33
TJ Klein     Re: Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) Thu, 22 Jan, 14:18
Rishi Yadav RangePartitioner Wed, 21 Jan, 05:07
Sandy Ryza   Re: RangePartitioner Wed, 21 Jan, 08:20
Fwd: [Spark Streaming] The FileInputDStream newFilesOnly=false does not work in 1.2 since
Terry Hole   Fwd: [Spark Streaming] The FileInputDStream newFilesOnly=false does not work in 1.2 since Wed, 21 Jan, 05:17
Sean Owen     Re: [Spark Streaming] The FileInputDStream newFilesOnly=false does not work in 1.2 since Wed, 21 Jan, 06:29
Terry Hole       Re: [Spark Streaming] The FileInputDStream newFilesOnly=false does not work in 1.2 since Wed, 21 Jan, 10:06
DEVAN M.S. KNN for large data set Wed, 21 Jan, 05:55
Xiangrui Meng   Re: KNN for large data set Wed, 21 Jan, 18:55
DEVAN M.S.     Re: KNN for large data set Thu, 22 Jan, 13:29
Sudipta Banerjee       Re: KNN for large data set Fri, 23 Jan, 03:41
Fengyun RAO spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 06:39
Davies Liu   Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 07:04
Fengyun RAO     Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 07:13
Sean Owen       Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 07:45
Fengyun RAO         Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 08:30
Fengyun RAO         Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 08:41
Paul Wais       Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 08:07
Fengyun RAO         Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 08:38
Davies Liu       Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 20:33
Fengyun RAO         Re: spark 1.2 three times slower than spark 1.1, why? Sat, 24 Jan, 12:32
JaeBoo Jung   Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 09:01
Fengyun RAO     Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 09:40
Fengyun RAO   Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 09:53
Fengyun RAO     Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 09:57
Kay Ousterhout       Re: spark 1.2 three times slower than spark 1.1, why? Wed, 21 Jan, 19:25
Tobias Pfeiffer Closing over a var with changing value in Streaming application Wed, 21 Jan, 07:23
Akhil Das   Re: Closing over a var with changing value in Streaming application Wed, 21 Jan, 07:46
Tobias Pfeiffer     Re: Closing over a var with changing value in Streaming application Wed, 21 Jan, 07:53
Tobias Pfeiffer       Re: Closing over a var with changing value in Streaming application Wed, 21 Jan, 12:02
Bob Tiernay   RE: Closing over a var with changing value in Streaming application Wed, 21 Jan, 12:13
Tobias Pfeiffer     Re: Closing over a var with changing value in Streaming application Wed, 21 Jan, 12:32
Re: SPARK-streaming app running 10x slower on YARN vs STANDALONE cluster
Mukesh Jha   Re: SPARK-streaming app running 10x slower on YARN vs STANDALONE cluster Wed, 21 Jan, 08:42
Gerard Maas     Re: SPARK-streaming app running 10x slower on YARN vs STANDALONE cluster Wed, 21 Jan, 09:49
Mukesh Jha       Re: SPARK-streaming app running 10x slower on YARN vs STANDALONE cluster Wed, 21 Jan, 18:07
Ashic Mahtab Are these numbers abnormal for spark streaming? Wed, 21 Jan, 11:26
Ashic Mahtab   RE: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 11:11
Tathagata Das     Re: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 11:15
Gerard Maas       Re: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 11:30
Ashic Mahtab         RE: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 12:32
Ashic Mahtab           RE: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 14:43
Sudipta Banerjee             Re: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 15:12
Gerard Maas               Re: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 15:28
Gerard Maas                 Re: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 15:34
Ashic Mahtab                 RE: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 15:40
Ashic Mahtab                 RE: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 15:50
Ashic Mahtab   RE: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 11:37
Ashic Mahtab   RE: Are these numbers abnormal for spark streaming? Thu, 22 Jan, 15:27
Aniket Bhatnagar ClosureCleaner should use ClassLoader created by SparkContext Wed, 21 Jan, 12:04
Aniket Bhatnagar   Re: ClosureCleaner should use ClassLoader created by SparkContext Wed, 21 Jan, 12:26
Luis Ángel Vicente Sánchez NullPointer when access rdd.sparkContext (Spark 1.1.1) Wed, 21 Jan, 12:35
Luis Ángel Vicente Sánchez   Re: NullPointer when access rdd.sparkContext (Spark 1.1.1) Wed, 21 Jan, 12:49
Sean Owen     Re: NullPointer when access rdd.sparkContext (Spark 1.1.1) Wed, 21 Jan, 14:18
Luis Ángel Vicente Sánchez       Re: NullPointer when access rdd.sparkContext (Spark 1.1.1) Wed, 21 Jan, 14:31
jamborta Possible to restart (or stop and create) a StreamingContext Wed, 21 Jan, 12:56
jamborta   Re: Possible to restart (or stop and create) a StreamingContext Wed, 21 Jan, 14:59
Hao Ren Broadcast variable questions Wed, 21 Jan, 14:24
Wang, Ningjun (LNG-NPV) sparkcontext.objectFile return thousands of partitions Wed, 21 Jan, 15:31
Noam Barcay   Re: sparkcontext.objectFile return thousands of partitions Wed, 21 Jan, 18:01
Sean Owen   Re: sparkcontext.objectFile return thousands of partitions Wed, 21 Jan, 19:32
Wang, Ningjun (LNG-NPV)     RE: sparkcontext.objectFile return thousands of partitions Thu, 22 Jan, 18:51
Sean Owen       Re: sparkcontext.objectFile return thousands of partitions Thu, 22 Jan, 19:01
Imran Rashid         Re: sparkcontext.objectFile return thousands of partitions Fri, 23 Jan, 00:57
Zsolt Tóth [mllib] Decision Tree - prediction probabilites of label classes Wed, 21 Jan, 15:36
Sean Owen   Re: [mllib] Decision Tree - prediction probabilites of label classes Thu, 22 Jan, 10:50
Joseph Bradley     Re: [mllib] Decision Tree - prediction probabilites of label classes Sun, 25 Jan, 01:16
Cheuk Lam How to delete graph checkpoints? Wed, 21 Jan, 17:25
Corey Nolet [SQL] Conflicts in inferred Json Schemas Wed, 21 Jan, 17:26
Tobias Pfeiffer   Re: [SQL] Conflicts in inferred Json Schemas Mon, 26 Jan, 01:41
Otis Gospodnetic Spark job for demoing Spark metrics monitoring? Wed, 21 Jan, 19:07
Akhil Das   Re: Spark job for demoing Spark metrics monitoring? Thu, 22 Jan, 07:17
YaoPau Connect to Hive metastore (on YARN) from Spark Shell? Wed, 21 Jan, 20:35
Zhan Zhang   Re: Connect to Hive metastore (on YARN) from Spark Shell? Wed, 21 Jan, 21:14
JacquesH Is Apache Spark less accurate than Scikit Learn? Wed, 21 Jan, 20:39
Robin East   Re: Is Apache Spark less accurate than Scikit Learn? Wed, 21 Jan, 23:57
Jacques Heunis     Re: Is Apache Spark less accurate than Scikit Learn? Thu, 22 Jan, 06:44
Robin East       Re: Is Apache Spark less accurate than Scikit Learn? Thu, 22 Jan, 08:01
Nathan Stott loading utf16le file with sc.textFile Wed, 21 Jan, 21:00
Re: Exception in connection from worker to worker
vantoniuk   Re: Exception in connection from worker to worker Wed, 21 Jan, 22:35
Akhil Das     Re: Exception in connection from worker to worker Thu, 22 Jan, 07:05
Larry Liu How to use more executors Wed, 21 Jan, 22:43
Ted Yu   Re: How to use more executors Wed, 21 Jan, 22:50
Larry Liu     Re: How to use more executors Wed, 21 Jan, 23:50
Nan Zhu       Re: How to use more executors Wed, 21 Jan, 23:57
Announcing SF / East Bay Area Stream Processing Meetup
Siva Jagadeesan   Announcing SF / East Bay Area Stream Processing Meetup Thu, 22 Jan, 00:01
Siva Jagadeesan   Announcing SF / East Bay Area Stream Processing Meetup Thu, 22 Jan, 00:52
daze5112 reading a csv dynamically Thu, 22 Jan, 00:25
Pankaj Narang   Re: reading a csv dynamically Thu, 22 Jan, 02:46
Imran Rashid     Re: reading a csv dynamically Fri, 23 Jan, 01:26
ey-chih chow spark 1.1.0 save data to hdfs failed Thu, 22 Jan, 00:51
Ted Yu   Re: spark 1.1.0 save data to hdfs failed Thu, 22 Jan, 00:56
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Thu, 22 Jan, 07:12
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Thu, 22 Jan, 22:32
Sean Owen     Re: spark 1.1.0 save data to hdfs failed Thu, 22 Jan, 22:34
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Fri, 23 Jan, 01:05
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Fri, 23 Jan, 09:42
Sean Owen   Re: spark 1.1.0 save data to hdfs failed Fri, 23 Jan, 10:41
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Fri, 23 Jan, 13:53
Sean Owen   Re: spark 1.1.0 save data to hdfs failed Fri, 23 Jan, 14:01
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Fri, 23 Jan, 14:43
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Fri, 23 Jan, 15:47
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Fri, 23 Jan, 19:17
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Fri, 23 Jan, 23:38
Sean Owen     Re: spark 1.1.0 save data to hdfs failed Sat, 24 Jan, 09:46
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Sat, 24 Jan, 15:30
ey-chih chow   RE: spark 1.1.0 save data to hdfs failed Sun, 25 Jan, 00:58
Shailesh Birari Spark 1.2 – How to change Default (Random) port …. Thu, 22 Jan, 02:14
Shailesh Birari   Re: Spark 1.2 – How to change Default (Random) port …. Mon, 26 Jan, 02:28
Aaron Davidson     Re: Spark 1.2 – How to change Default (Random) port …. Mon, 26 Jan, 05:34
Shailesh Birari       Re: Spark 1.2 – How to change Default (Random) port …. Tue, 27 Jan, 00:42
Re: Confused why I'm losing workers/executors when writing a large file to S3
Tsai Li Ming   Re: Confused why I'm losing workers/executors when writing a large file to S3 Thu, 22 Jan, 04:43
LinQili Is there a way to delete hdfs file/directory using spark API? Thu, 22 Jan, 06:45
Raghavendra Pandey   Re: Is there a way to delete hdfs file/directory using spark API? Thu, 22 Jan, 06:53
Akhil Das   Re: Is there a way to delete hdfs file/directory using spark API? Thu, 22 Jan, 06:54
Vladimir Protsenko spark-shell has syntax error on windows. Thu, 22 Jan, 08:16
Yana Kadiyska   Re: spark-shell has syntax error on windows. Thu, 22 Jan, 16:31
Josh Rosen     Re: spark-shell has syntax error on windows. Fri, 23 Jan, 21:44
Yana Kadiyska       Re: spark-shell has syntax error on windows. Fri, 23 Jan, 22:23
Vladimir Protsenko         Re: spark-shell has syntax error on windows. Sat, 24 Jan, 11:01
Skanda unable to write SequenceFile using saveAsNewAPIHadoopFile Thu, 22 Jan, 08:42
Sean Owen   Re: unable to write SequenceFile using saveAsNewAPIHadoopFile Thu, 22 Jan, 08:58
Skanda     Re: unable to write SequenceFile using saveAsNewAPIHadoopFile Thu, 22 Jan, 09:42
NicolasC GraphX: ShortestPaths does not terminate on a grid graph Thu, 22 Jan, 10:06
Ankur Dave   Re: GraphX: ShortestPaths does not terminate on a grid graph Thu, 22 Jan, 22:32
Jay Hutfles     Re: GraphX: ShortestPaths does not terminate on a grid graph Thu, 29 Jan, 15:25
Ankur Dave       Re: GraphX: ShortestPaths does not terminate on a grid graph Thu, 29 Jan, 19:31
Saumitra Shahapure (Vizury) Spark performance for small queries Thu, 22 Jan, 10:37
Saumitra Shahapure (Vizury)   Re: Spark performance for small queries Thu, 22 Jan, 11:03
Fwd: Spark Team - Paco Nathan said that your team can help
Sudipta Banerjee   Fwd: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 11:36
Marco Shaw     Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 12:03
Sudipta Banerjee       Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 14:51
Babu, Prashanth         RE: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 15:03
Jerry Lam           Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 15:23
Sean Owen         Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 15:49
Nicos           Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 17:14
Sudipta Banerjee           Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 17:25
Marco Shaw             Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 17:30
Lukas Nalezenec               Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 17:32
Sudipta Banerjee                 Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 17:35
Joseph Ottinger                   Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 17:57
Pankaj     Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 12:08
Marco Shaw     Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 17:27
Sudipta Banerjee       Re: Spark Team - Paco Nathan said that your team can help Thu, 22 Jan, 17:30
Re: Trying to run SparkSQL over Spark Streaming
nirandap   Re: Trying to run SparkSQL over Spark Streaming Thu, 22 Jan, 12:33
Adrian Mocanu Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions Thu, 22 Jan, 15:57
Sean Owen   Re: Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions Thu, 22 Jan, 16:39
Adrian Mocanu     RE: Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions Thu, 22 Jan, 20:47
Adrian Mocanu       RE: Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions Thu, 22 Jan, 20:50
Yana Kadiyska         Re: Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions Fri, 23 Jan, 18:35
Installing Spark Standalone to a Cluster
riginos   Installing Spark Standalone to a Cluster Thu, 22 Jan, 17:06
Yana Kadiyska     Re: Installing Spark Standalone to a Cluster Thu, 22 Jan, 17:39
riginos   Installing Spark Standalone to a Cluster Fri, 23 Jan, 17:54
HARIPRIYA AYYALASOMAYAJULA     Re: Installing Spark Standalone to a Cluster Fri, 23 Jan, 18:00
riginos   Installing Spark Standalone to a Cluster Fri, 23 Jan, 18:20
Akhil Das     Re: Installing Spark Standalone to a Cluster Sat, 24 Jan, 07:51
Akhil Das       Re: Installing Spark Standalone to a Cluster Sat, 24 Jan, 10:56
Ankur Srivastava Would Join on PairRDD's result in co-locating data by keys? Thu, 22 Jan, 17:44
Edwin Apache Spark broadcast error: Error sending message as driverActor is null [message = UpdateBlockInfo(BlockManagerId Thu, 22 Jan, 17:52
Mohit Singh Using third party libraries in pyspark Thu, 22 Jan, 19:23
Davies Liu   Re: Using third party libraries in pyspark Fri, 23 Jan, 05:09
Felix C   Re: Using third party libraries in pyspark Fri, 23 Jan, 06:53
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
Aug 2019139
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137