spark-user mailing list archives: April 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Sean Owen HashingTF "compatibility" across Python, Scala? Thu, 07 Apr, 15:59
Nick Pentreath   Re: HashingTF "compatibility" across Python, Scala? Thu, 07 Apr, 16:19
Nick Pentreath     Re: HashingTF "compatibility" across Python, Scala? Tue, 12 Apr, 13:13
Re: mapWithState not compacting removed state
Ofir Kerker   Re: mapWithState not compacting removed state Thu, 07 Apr, 16:06
Iain Cundy     RE: mapWithState not compacting removed state Thu, 07 Apr, 16:27
Sudhanshu Janghel building kafka project on intellij Help is much appreciated Thu, 07 Apr, 16:08
Haroon Rasheed   Re: building kafka project on intellij Help is much appreciated Thu, 07 Apr, 16:14
Ted Yu     Re: building kafka project on intellij Help is much appreciated Thu, 07 Apr, 16:19
tminima Working with zips in pyspark Thu, 07 Apr, 17:15
JasmineGeorge Only 60% of Total Spark Batch Application execution time spent in Task Processing Thu, 07 Apr, 18:03
Ted Yu   Re: Only 60% of Total Spark Batch Application execution time spent in Task Processing Thu, 07 Apr, 20:43
Ted Yu     Re: Only 60% of Total Spark Batch Application execution time spent in Task Processing Sun, 10 Apr, 15:10
antoniosi Is Hive CREATE DATABASE IF NOT EXISTS atomic Thu, 07 Apr, 22:23
Xiao Li   Re: Is Hive CREATE DATABASE IF NOT EXISTS atomic Thu, 07 Apr, 22:29
Mich Talebzadeh   Re: Is Hive CREATE DATABASE IF NOT EXISTS atomic Thu, 07 Apr, 23:24
Re: Anyone have a tutorial or guide to implement Spark + AWS + Caffe/CUDA?
jamborta   Re: Anyone have a tutorial or guide to implement Spark + AWS + Caffe/CUDA? Thu, 07 Apr, 22:40
Colin Woodbury MLlib ALS MatrixFactorizationModel.save fails consistently Thu, 07 Apr, 22:56
Nick Pentreath   Re: MLlib ALS MatrixFactorizationModel.save fails consistently Fri, 08 Apr, 07:06
Divya Gehlot [HELP:]Save Spark Dataframe in Phoenix Table Fri, 08 Apr, 05:22
Josh Mahonin   Re: [HELP:]Save Spark Dataframe in Phoenix Table Fri, 08 Apr, 11:06
zhanghn how to use udf in spark thrift server. Fri, 08 Apr, 06:22
Tenghuan He About nested RDD Fri, 08 Apr, 06:45
Holden Karau   Re: About nested RDD Fri, 08 Apr, 08:22
Rishi Mishra     Re: About nested RDD Fri, 08 Apr, 08:39
Tenghuan He     Re: About nested RDD Fri, 08 Apr, 09:03
Rishi Mishra       Re: About nested RDD Fri, 08 Apr, 09:15
Re: [ERROR]: Spark 1.5.2 + Hbase 1.1 + Hive 1.2 + HbaseIntegration
Wojciech Indyk   Re: [ERROR]: Spark 1.5.2 + Hbase 1.1 + Hive 1.2 + HbaseIntegration Fri, 08 Apr, 06:45
Teng Qiu     Re: [ERROR]: Spark 1.5.2 + Hbase 1.1 + Hive 1.2 + HbaseIntegration Thu, 14 Apr, 15:55
YaoPau Why do I need to handle dependencies on EMR but not on-prem Hadoop? Fri, 08 Apr, 07:28
Sean Owen   Re: Why do I need to handle dependencies on EMR but not on-prem Hadoop? Fri, 08 Apr, 09:02
Hustjackie May I ask a question about SparkSql Fri, 08 Apr, 08:28
Kasinathan, Prabhu   Re: May I ask a question about SparkSql Fri, 08 Apr, 08:41
Mich Talebzadeh   Re: May I ask a question about SparkSql Fri, 08 Apr, 08:45
Mich Talebzadeh Work on Spark engine for Hive Fri, 08 Apr, 09:02
Mich Talebzadeh   Re: Work on Spark engine for Hive Fri, 08 Apr, 14:47
Szehon Ho     Re: Work on Spark engine for Hive Fri, 08 Apr, 18:16
Mich Talebzadeh       Re: Work on Spark engine for Hive Fri, 08 Apr, 20:03
Szehon Ho         Re: Work on Spark engine for Hive Sat, 09 Apr, 00:21
Spark Streaming share state between two streams
Shekhar Bansal   Spark Streaming share state between two streams Fri, 08 Apr, 10:23
Rishi Mishra     Re: Spark Streaming share state between two streams Fri, 08 Apr, 18:52
JH P can not join dataset with itself Fri, 08 Apr, 10:53
Ted Yu   Re: can not join dataset with itself Fri, 08 Apr, 12:43
JH P     Re: can not join dataset with itself Fri, 08 Apr, 13:01
Priya Ch Streaming k-means visualization Fri, 08 Apr, 13:50
Chadha Pooja How to import D3 library in Spark Fri, 08 Apr, 14:07
Chaturvedi Chola Good Book on Hadoop Interview Fri, 08 Apr, 15:56
nihed mbarek How to configure parquet.block.size on Spark 1.6 Fri, 08 Apr, 16:01
Ted Yu   Re: How to configure parquet.block.size on Spark 1.6 Fri, 08 Apr, 16:05
Silvio Fiorito   Re: How to configure parquet.block.size on Spark 1.6 Fri, 08 Apr, 16:19
nihed mbarek     Re: How to configure parquet.block.size on Spark 1.6 Fri, 08 Apr, 16:23
bdev Need clarification regd deploy-mode client Fri, 08 Apr, 16:32
bdev   Re: Need clarification regd deploy-mode client Fri, 08 Apr, 20:48
imax What is the best way to process streaming data from multiple channels simultaneously using Spark 2.0 API's? Fri, 08 Apr, 17:08
OmkarP Handling of slow elements in dstream's processing Fri, 08 Apr, 19:10
Benjamin Kim Monitoring S3 Bucket with Spark Streaming Fri, 08 Apr, 19:14
Natu Lauchande   Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 04:15
Nezih Yigitbasi     Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 07:25
Natu Lauchande       Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 09:06
Benjamin Kim       Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 14:55
programminggee...@gmail.com         Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 16:45
Benjamin Kim           Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 16:54
Benjamin Kim             Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 21:49
Benjamin Kim               Re: Monitoring S3 Bucket with Spark Streaming Sun, 10 Apr, 01:12
Benjamin Kim                 Re: Monitoring S3 Bucket with Spark Streaming Tue, 12 Apr, 16:55
Benjamin Kim     Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 14:44
Natu Lauchande       Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 17:58
Nezih Yigitbasi         Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 19:02
Gourav Sengupta   Re: Monitoring S3 Bucket with Spark Streaming Sat, 09 Apr, 21:36
entee DataFrame job fails on parsing error, help? Fri, 08 Apr, 19:36
Ted Yu   Re: DataFrame job fails on parsing error, help? Fri, 08 Apr, 20:13
Ted Yu     Re: DataFrame job fails on parsing error, help? Fri, 08 Apr, 20:31
Night Wolf       Re: DataFrame job fails on parsing error, help? Thu, 28 Apr, 07:31
Copying all Hive tables from Prod to UAT
Ashok Kumar   Copying all Hive tables from Prod to UAT Fri, 08 Apr, 22:24
Ali Gouta     Re: Copying all Hive tables from Prod to UAT Fri, 08 Apr, 22:54
Xiao Li       Re: Copying all Hive tables from Prod to UAT Fri, 08 Apr, 23:03
Sung Hwan Chung How Spark handles dead machines during a job. Sat, 09 Apr, 04:19
Reynold Xin   Re: How Spark handles dead machines during a job. Sat, 09 Apr, 06:35
maheshmath Unable run Spark in YARN mode Sat, 09 Apr, 05:57
Natu Lauchande   Re: Unable run Spark in YARN mode Sat, 09 Apr, 18:06
Ted Yu     Re: Unable run Spark in YARN mode Sat, 09 Apr, 18:12
Yu, Yucai   RE: Unable run Spark in YARN mode Sun, 10 Apr, 13:02
Daniela S Use only latest values Sat, 09 Apr, 07:03
Natu Lauchande   Re: Use only latest values Sat, 09 Apr, 09:14
Sebastian Piu   Re: Use only latest values Sat, 09 Apr, 09:38
Spark GUI, Workers and Executors
Ashok Kumar   Spark GUI, Workers and Executors Sat, 09 Apr, 07:28
Mark Hamstra     Re: Spark GUI, Workers and Executors Sat, 09 Apr, 20:47
bdev How to estimate the size of dataframe using pyspark? Sat, 09 Apr, 17:37
ndj...@gmail.com   Re: How to estimate the size of dataframe using pyspark? Sat, 09 Apr, 17:47
Buntu Dev     Re: How to estimate the size of dataframe using pyspark? Sat, 09 Apr, 18:33
Ndjido Ardo BAR       Re: How to estimate the size of dataframe using pyspark? Sat, 09 Apr, 18:43
Buntu Dev         Re: How to estimate the size of dataframe using pyspark? Sat, 09 Apr, 23:33
Davies Liu           Re: How to estimate the size of dataframe using pyspark? Mon, 11 Apr, 17:44
Buntu Dev             Re: How to estimate the size of dataframe using pyspark? Wed, 13 Apr, 01:53
bdev   Re: How to estimate the size of dataframe using pyspark? Sat, 09 Apr, 23:22
SURAJ SHETH Weird error while serialization Sat, 09 Apr, 19:25
Ted Yu   Re: Weird error while serialization Sat, 09 Apr, 19:49
SURAJ SHETH     Re: Weird error while serialization Sat, 09 Apr, 21:00
Gourav Sengupta       Re: Weird error while serialization Sat, 09 Apr, 21:31
Ted Yu       Re: Weird error while serialization Sun, 10 Apr, 15:14
java.lang.ClassCastException when I execute a Spark SQL command
P.S. Aravind   java.lang.ClassCastException when I execute a Spark SQL command Sat, 09 Apr, 22:57
Mich Talebzadeh     Re: java.lang.ClassCastException when I execute a Spark SQL command Sat, 09 Apr, 23:10
P.S. Aravind       Re: java.lang.ClassCastException when I execute a Spark SQL command Sat, 09 Apr, 23:17
Buntu Dev Graphframes pattern causing java heap space errors Sat, 09 Apr, 23:51
Jacek Laskowski   Re: Graphframes pattern causing java heap space errors Sun, 10 Apr, 00:52
Buntu Dev     Re: Graphframes pattern causing java heap space errors Sun, 10 Apr, 04:02
Ted Yu       Re: Graphframes pattern causing java heap space errors Sun, 10 Apr, 11:28
Buntu Dev         Re: Graphframes pattern causing java heap space errors Mon, 11 Apr, 05:01
Amit Sela Datasets combineByKey Sun, 10 Apr, 02:38
Ted Yu   Re: Datasets combineByKey Sun, 10 Apr, 12:00
Amit Sela     Re: Datasets combineByKey Sun, 10 Apr, 13:08
Amit Sela       Re: Datasets combineByKey Sun, 10 Apr, 19:17
Koert Kuipers         Re: Datasets combineByKey Mon, 11 Apr, 03:07
Maurin Lenglart alter table add columns aternatives or hive refresh Sun, 10 Apr, 04:06
Mich Talebzadeh   Re: alter table add columns aternatives or hive refresh Sun, 10 Apr, 10:41
Maurin Lenglart     Re: alter table add columns aternatives or hive refresh Sun, 10 Apr, 18:34
Mich Talebzadeh       Re: alter table add columns aternatives or hive refresh Sun, 10 Apr, 19:25
Maurin Lenglart         Re: alter table add columns aternatives or hive refresh Mon, 11 Apr, 00:36
Mich Talebzadeh           Re: alter table add columns aternatives or hive refresh Mon, 11 Apr, 06:54
Maurin Lenglart             Re: alter table add columns aternatives or hive refresh Mon, 11 Apr, 19:38
Maurin Lenglart               Re: alter table add columns aternatives or hive refresh Fri, 15 Apr, 19:45
Mich Talebzadeh                 Re: alter table add columns aternatives or hive refresh Fri, 15 Apr, 20:07
Vikash Pareek Number of executors in spark-1.6 and spark-1.5 Sun, 10 Apr, 07:26
Mich Talebzadeh   Re: Number of executors in spark-1.6 and spark-1.5 Sun, 10 Apr, 09:30
Vikash Pareek     Re: Number of executors in spark-1.6 and spark-1.5 Sun, 10 Apr, 14:23
Deepak Sharma LinkedIn streams in Spark Sun, 10 Apr, 12:38
Hemalatha A How Application jar is copied to worker machines? Sun, 10 Apr, 15:30
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Box list
Sep 2021111
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137