spark-user mailing list archives: January 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Pierre B MissingRequirementError with spark Thu, 15 Jan, 09:12
sarsol   Re: MissingRequirementError with spark 1.2 Thu, 15 Jan, 10:27
Pierre B   Re: MissingRequirementError with spark Thu, 15 Jan, 10:57
sarsol     Re: MissingRequirementError with spark Thu, 15 Jan, 12:56
sarsol       Re: MissingRequirementError with spark Fri, 16 Jan, 11:42
YANG Fan spark fault tolerance mechanism Thu, 15 Jan, 10:42
Hafiz Mujadid kinesis creating stream scala code exception Thu, 15 Jan, 11:28
Aniket Bhatnagar   Re: kinesis creating stream scala code exception Thu, 15 Jan, 11:49
Tom Seddon PySpark saveAsTextFile gzip Thu, 15 Jan, 11:46
Akhil Das   Re: PySpark saveAsTextFile gzip Fri, 16 Jan, 06:51
ahmedabdelrahman Spark-Sql not using cluster slaves Thu, 15 Jan, 12:06
lev Using native blas with mllib Thu, 15 Jan, 12:41
Shing Hing Man How to query Spark master for cluster status ? Thu, 15 Jan, 13:00
Akhil Das   Re: How to query Spark master for cluster status ? Fri, 16 Jan, 06:47
Ajay Srivastava Some tasks are taking long time Thu, 15 Jan, 13:42
RK   Re: Some tasks are taking long time Thu, 15 Jan, 14:32
Ajay Srivastava     Re: Some tasks are taking long time Thu, 15 Jan, 14:49
Nicos       Re: Some tasks are taking long time Thu, 15 Jan, 18:24
Ajay Srivastava         Re: Some tasks are taking long time Fri, 16 Jan, 04:42
Hafiz Mujadid Inserting an element in RDD[String] Thu, 15 Jan, 14:16
Aniket Bhatnagar   Re: Inserting an element in RDD[String] Thu, 15 Jan, 14:29
Prannoy   Re: Inserting an element in RDD[String] Thu, 15 Jan, 14:35
Hafiz Mujadid     Re: Inserting an element in RDD[String] Thu, 15 Jan, 15:46
jvuillermet SQL JSON array operations Thu, 15 Jan, 15:02
Ayoub Benali   Re: SQL JSON array operations Thu, 15 Jan, 17:13
Ayoub   Re: SQL JSON array operations Thu, 15 Jan, 19:46
jvuillermet     Re: SQL JSON array operations Thu, 15 Jan, 19:50
kirillfish small error in the docs? Thu, 15 Jan, 16:43
Sean Owen   Re: small error in the docs? Thu, 15 Jan, 16:59
using hiveContext to select a nested Map-data-type from an AVROmodel+parquet file
BB   using hiveContext to select a nested Map-data-type from an AVROmodel+parquet file Thu, 15 Jan, 16:52
Cheng, Hao     RE: using hiveContext to select a nested Map-data-type from an AVROmodel+parquet file Fri, 16 Jan, 02:24
BB     Re: using hiveContext to select a nested Map-data-type from an AVROmodel+parquet file Mon, 19 Jan, 10:02
Cheng, Hao   RE: using hiveContext to select a nested Map-data-type from an AVROmodel+parquet file Sat, 17 Jan, 09:42
txw Is spark suitable for large scale pagerank, such as 200 million nodes, 2 billion edges? Thu, 15 Jan, 17:29
Ted Yu   Re: Is spark suitable for large scale pagerank, such as 200 million nodes, 2 billion edges? Thu, 15 Jan, 18:23
Re: Testing if an RDD is empty?
Al M   Re: Testing if an RDD is empty? Thu, 15 Jan, 17:33
freedafeng     Re: Testing if an RDD is empty? Thu, 15 Jan, 22:31
Tobias Pfeiffer       Re: Testing if an RDD is empty? Fri, 16 Jan, 04:12
Sean Owen         Re: Testing if an RDD is empty? Fri, 16 Jan, 04:22
Manoj Samel Error when running SparkPi on Secure HA Hadoop cluster Thu, 15 Jan, 19:23
Marcelo Vanzin   Re: Error when running SparkPi on Secure HA Hadoop cluster Thu, 15 Jan, 19:31
Shuai Zheng Executor vs Mapper in Hadoop Thu, 15 Jan, 20:16
Sean Owen   Re: Executor vs Mapper in Hadoop Fri, 16 Jan, 04:13
Shuai Zheng     Re: Executor vs Mapper in Hadoop Fri, 16 Jan, 12:02
Shuai Zheng Executor parameter doesn't work for Spark-shell on EMR Yarn Thu, 15 Jan, 20:52
Shuai Zheng   RE: Executor parameter doesn't work for Spark-shell on EMR Yarn Thu, 15 Jan, 21:03
Shuai Zheng     RE: Executor parameter doesn't work for Spark-shell on EMR Yarn Thu, 15 Jan, 21:23
Wang, Ningjun (LNG-NPV) How to force parallel processing of RDD using multiple thread Thu, 15 Jan, 20:54
Sean Owen   Re: How to force parallel processing of RDD using multiple thread Thu, 15 Jan, 21:29
Wang, Ningjun (LNG-NPV)     RE: How to force parallel processing of RDD using multiple thread Thu, 15 Jan, 22:53
Sean Owen       Re: How to force parallel processing of RDD using multiple thread Fri, 16 Jan, 04:03
Wang, Ningjun (LNG-NPV)         RE: How to force parallel processing of RDD using multiple thread Fri, 16 Jan, 14:14
Gerard Maas           Re: How to force parallel processing of RDD using multiple thread Fri, 16 Jan, 14:44
Wang, Ningjun (LNG-NPV)             RE: How to force parallel processing of RDD using multiple thread Fri, 16 Jan, 15:01
Steve Lewis Distributing Computation across slaves Thu, 15 Jan, 21:15
jamborta spark streaming python files not packaged in assembly jar Thu, 15 Jan, 23:49
逸君曹 Anyway to make RDD preserve input directories structures? Fri, 16 Jan, 02:15
Sean Owen   Re: Anyway to make RDD preserve input directories structures? Fri, 16 Jan, 03:57
Anand Mohan OutOfMemory error in Spark Core Fri, 16 Jan, 05:11
Akhil Das   Re: OutOfMemory error in Spark Core Fri, 16 Jan, 06:41
Corey Nolet Spark SQL Custom Predicate Pushdown Fri, 16 Jan, 05:50
Cheng, Hao   RE: Spark SQL Custom Predicate Pushdown Fri, 16 Jan, 07:07
Corey Nolet     Re: Spark SQL Custom Predicate Pushdown Sat, 17 Jan, 03:17
Corey Nolet       Re: Spark SQL Custom Predicate Pushdown Sat, 17 Jan, 16:25
Michael Armbrust         Re: Spark SQL Custom Predicate Pushdown Sat, 17 Jan, 20:38
Corey Nolet           Re: Spark SQL Custom Predicate Pushdown Sat, 17 Jan, 20:54
Michael Armbrust             Re: Spark SQL Custom Predicate Pushdown Sat, 17 Jan, 21:29
Corey Nolet               Re: Spark SQL Custom Predicate Pushdown Sat, 17 Jan, 21:40
Re: Low Level Kafka Consumer for Spark
mykidong   Re: Low Level Kafka Consumer for Spark Fri, 16 Jan, 05:55
Dibyendu Bhattacharya     Re: Low Level Kafka Consumer for Spark Fri, 16 Jan, 06:20
Dibyendu Bhattacharya       Re: Low Level Kafka Consumer for Spark Fri, 16 Jan, 06:53
Akhil Das         Re: Low Level Kafka Consumer for Spark Fri, 16 Jan, 07:18
Debasish Das           Re: Low Level Kafka Consumer for Spark Sat, 17 Jan, 04:13
Dibyendu Bhattacharya             Re: Low Level Kafka Consumer for Spark Sat, 17 Jan, 05:38
spraveen UserGroupInformation: PriviledgedActionException as Fri, 16 Jan, 07:15
Tobias Pfeiffer MatchError in JsonRDD.toLong Fri, 16 Jan, 07:25
Tobias Pfeiffer   Re: MatchError in JsonRDD.toLong Fri, 16 Jan, 08:01
Wang, Daoyuan     RE: MatchError in JsonRDD.toLong Fri, 16 Jan, 08:55
Tobias Pfeiffer       Re: MatchError in JsonRDD.toLong Fri, 16 Jan, 09:10
Wang, Daoyuan         RE: MatchError in JsonRDD.toLong Fri, 16 Jan, 09:14
Wang, Daoyuan           RE: MatchError in JsonRDD.toLong Fri, 16 Jan, 09:17
Tobias Pfeiffer           Re: MatchError in JsonRDD.toLong Tue, 20 Jan, 01:25
Wang, Daoyuan             RE: MatchError in JsonRDD.toLong Tue, 20 Jan, 01:33
kundan kumar ERROR UserGroupInformation: PriviledgedActionException in standalone mode Fri, 16 Jan, 08:55
MLib: How to set preferences for ALS implicit feedback in Collaborative Filtering?
Zork Sail   MLib: How to set preferences for ALS implicit feedback in Collaborative Filtering? Fri, 16 Jan, 09:58
Sean Owen     Re: MLib: How to set preferences for ALS implicit feedback in Collaborative Filtering? Fri, 16 Jan, 15:08
Julian Ricardo   MLib: How to set preferences for ALS implicit feedback in Collaborative Filtering? Fri, 16 Jan, 11:03
Xiangrui Meng     Re: MLib: How to set preferences for ALS implicit feedback in Collaborative Filtering? Tue, 20 Jan, 20:38
Zork   MLib: How to set preferences for ALS implicit feedback in Collaborative Filtering? Fri, 16 Jan, 11:10
Xiaoyu Wang Why custom parquet format hive table execute "ParquetTableScan" physical plan, not "HiveTableScan"? Fri, 16 Jan, 10:09
yana   RE: Why custom parquet format hive table execute "ParquetTableScan" physical plan, not "HiveTableScan"? Fri, 16 Jan, 12:51
Xiaoyu Wang     Re: Why custom parquet format hive table execute "ParquetTableScan" physical plan, not "HiveTableScan"? Fri, 16 Jan, 13:51
Xiaoyu Wang       Re: Why custom parquet format hive table execute "ParquetTableScan" physical plan, not "HiveTableScan"? Mon, 19 Jan, 08:46
Yana Kadiyska         Re: Why custom parquet format hive table execute "ParquetTableScan" physical plan, not "HiveTableScan"? Mon, 19 Jan, 22:52
Xiaoyu Wang           Re: Why custom parquet format hive table execute "ParquetTableScan" physical plan, not "HiveTableScan"? Tue, 20 Jan, 01:02
Yana Kadiyska             Re: Why custom parquet format hive table execute "ParquetTableScan" physical plan, not "HiveTableScan"? Tue, 20 Jan, 15:52
Cheng Lian             Re: Why custom parquet format hive table execute "ParquetTableScan" physical plan, not "HiveTableScan"? Tue, 20 Jan, 19:35
Cheng Lian             Re: Why custom parquet format hive table execute "ParquetTableScan" physical plan, not "HiveTableScan"? Tue, 20 Jan, 19:38
lonely Feb terasort on spark Fri, 16 Jan, 10:24
Fwd: Problems with TeraValidate
lonely Feb   Fwd: Problems with TeraValidate Fri, 16 Jan, 11:10
Nick Allen How to 'Pipe' Binary Data in Apache Spark Fri, 16 Jan, 15:09
Sean Owen   Re: How to 'Pipe' Binary Data in Apache Spark Fri, 16 Jan, 15:20
Nick Allen     Re: How to 'Pipe' Binary Data in Apache Spark Fri, 16 Jan, 15:40
Nick Allen       Re: How to 'Pipe' Binary Data in Apache Spark Fri, 16 Jan, 18:46
Venkat, Ankam         Processing .wav files in PySpark Fri, 16 Jan, 22:11
Davies Liu           Re: Processing .wav files in PySpark Fri, 16 Jan, 23:48
Venkat, Ankam         RE: How to 'Pipe' Binary Data in Apache Spark Wed, 21 Jan, 17:17
Frank Austin Nothaft           Re: How to 'Pipe' Binary Data in Apache Spark Wed, 21 Jan, 19:30
Venkat, Ankam             RE: How to 'Pipe' Binary Data in Apache Spark Thu, 22 Jan, 15:11
Frank Austin Nothaft               Re: How to 'Pipe' Binary Data in Apache Spark Thu, 22 Jan, 16:07
Venkat, Ankam                 RE: How to 'Pipe' Binary Data in Apache Spark Thu, 22 Jan, 16:34
Venkat, Ankam                   RE: How to 'Pipe' Binary Data in Apache Spark Fri, 23 Jan, 20:58
Silvio Fiorito   Re: How to 'Pipe' Binary Data in Apache Spark Thu, 22 Jan, 16:38
Re: Scala vs Python performance differences
philpearl   Re: Scala vs Python performance differences Fri, 16 Jan, 15:38
Davies Liu     Re: Scala vs Python performance differences Fri, 16 Jan, 19:03
Hafiz Mujadid kinesis multiple records adding into stream Fri, 16 Jan, 16:08
Aniket Bhatnagar   Re: kinesis multiple records adding into stream Fri, 16 Jan, 17:13
Kelly, Jonathan     Re: kinesis multiple records adding into stream Fri, 16 Jan, 18:05
Antony Mayi remote Akka client disassociated - some timeout? Fri, 16 Jan, 18:00
Akhil Das   Re: remote Akka client disassociated - some timeout? Sat, 17 Jan, 09:15
Ted Yu   Re: remote Akka client disassociated - some timeout? Sat, 17 Jan, 11:21
RE: Determine number of running executors
Shuai Zheng   RE: Determine number of running executors Fri, 16 Jan, 18:05
Tobias Pfeiffer     Re: Determine number of running executors Mon, 19 Jan, 09:34
If an RDD appeared twice in a DAG, of which calculation is triggered by a single action, will this RDD be calculated twice?
Peng Cheng   If an RDD appeared twice in a DAG, of which calculation is triggered by a single action, will this RDD be calculated twice? Fri, 16 Jan, 18:37
Xuefeng Wu     Re: If an RDD appeared twice in a DAG, of which calculation is triggered by a single action, will this RDD be calculated twice? Mon, 19 Jan, 15:24
Tobias Pfeiffer     Re: If an RDD appeared twice in a DAG, of which calculation is triggered by a single action, will this RDD be calculated twice? Tue, 20 Jan, 00:53
Peng Cheng   If an RDD appeared twice in a DAG, of which calculation is triggered by a single action, will this RDD be calculated twice? Fri, 16 Jan, 18:40
Kane Kim spark java options Fri, 16 Jan, 19:12
Yana Kadiyska   Re: spark java options Fri, 16 Jan, 19:19
Marcelo Vanzin   Re: spark java options Fri, 16 Jan, 19:22
Marcelo Vanzin   Re: spark java options Fri, 16 Jan, 19:30
olegshirokikh Creating Apache Spark-powered “As Service” applications Fri, 16 Jan, 19:31
Corey Nolet   Re: Creating Apache Spark-powered “As Service” applications Fri, 16 Jan, 19:38
Robert C Senkbeil   Re: Creating Apache Spark-powered “As Service” applications Fri, 16 Jan, 20:20
Oleg Shirokikh     RE: Creating Apache Spark-powered “As Service” applications Fri, 16 Jan, 21:33
kevinkim   Re: Creating Apache Spark-powered “As Service” applications Sat, 17 Jan, 07:37
Andrew Musselman Subscribe Fri, 16 Jan, 19:51
Ted Yu   Re: Subscribe Fri, 16 Jan, 19:56
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
Sep 2019107
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137