spark-user mailing list archives: October 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Meeraj Kunnumpurath Scientific Notation and Precision Error Sun, 09 Oct, 01:50
Vikash Kumar "How to change rdd fields for each key combination." Sun, 09 Oct, 04:11
Sree Eedupuganti Convert hive sql to spark sql Sun, 09 Oct, 08:55
ayan guha   Re: Convert hive sql to spark sql Sun, 09 Oct, 08:58
Mich Talebzadeh     Re: Convert hive sql to spark sql Sun, 09 Oct, 10:21
Miro Karpis java: see logging output in in UI Sun, 09 Oct, 15:50
Koert Kuipers when does a Row object have a schema Sun, 09 Oct, 20:50
Divya Gehlot   Re: when does a Row object have a schema Mon, 10 Oct, 04:47
kant kodali This Exception has been really hard to trace Mon, 10 Oct, 03:13
Reynold Xin   Re: This Exception has been really hard to trace Mon, 10 Oct, 03:48
kant kodali     Re: This Exception has been really hard to trace Mon, 10 Oct, 04:30
Shixiong(Ryan) Zhu   Re: This Exception has been really hard to trace Mon, 10 Oct, 06:44
kant kodali     Re: This Exception has been really hard to trace Mon, 10 Oct, 09:33
Reynold Xin SPARK-17845 - window function frame boundary API Mon, 10 Oct, 04:50
ayan guha   Re: SPARK-17845 - window function frame boundary API Mon, 10 Oct, 05:48
vaibhav thapliyal ClassCastException while running a simple wordCount Mon, 10 Oct, 07:05
vaibhav thapliyal   Re: ClassCastException while running a simple wordCount Mon, 10 Oct, 07:19
vaibhav thapliyal     Re: ClassCastException while running a simple wordCount Mon, 10 Oct, 10:23
kant kodali       Re: ClassCastException while running a simple wordCount Mon, 10 Oct, 10:42
Jakob Odersky         Re: ClassCastException while running a simple wordCount Mon, 10 Oct, 21:00
Jakob Odersky           Re: ClassCastException while running a simple wordCount Mon, 10 Oct, 23:06
vaibhav thapliyal             Re: ClassCastException while running a simple wordCount Tue, 11 Oct, 07:28
kant kodali               Re: ClassCastException while running a simple wordCount Tue, 11 Oct, 10:29
Manjunath, Kiran Spark Streaming Custom Receivers - How to use metadata store API during processing Mon, 10 Oct, 09:17
Samy Dindane What happens when an executor crashes? Mon, 10 Oct, 09:19
Samy Dindane   Re: What happens when an executor crashes? Mon, 10 Oct, 10:26
Cody Koeninger     Re: What happens when an executor crashes? Mon, 10 Oct, 14:29
Samy Dindane       Re: What happens when an executor crashes? Mon, 10 Oct, 17:12
Cody Koeninger         Re: What happens when an executor crashes? Mon, 10 Oct, 18:14
Samy Dindane           Re: What happens when an executor crashes? Mon, 10 Oct, 22:36
Cody Koeninger             Re: What happens when an executor crashes? Mon, 10 Oct, 23:23
Samy Dindane               Re: What happens when an executor crashes? Wed, 12 Oct, 13:34
Cody Koeninger                 Re: What happens when an executor crashes? Wed, 12 Oct, 14:43
Paweł Szulc spark using two different versions of netty? Mon, 10 Oct, 10:56
Sean Owen   Re: spark using two different versions of netty? Mon, 10 Oct, 11:15
Paweł Szulc     Re: spark using two different versions of netty? Mon, 10 Oct, 14:38
Cesar Logistic Regression Standardization in ML Mon, 10 Oct, 14:15
Sean Owen   Re: Logistic Regression Standardization in ML Mon, 10 Oct, 14:27
Yanbo Liang     Re: Logistic Regression Standardization in ML Mon, 10 Oct, 16:33
static-max Manually committing offset in Spark 2.0 with Kafka 0.10 and Java Mon, 10 Oct, 15:34
Cody Koeninger   Re: Manually committing offset in Spark 2.0 with Kafka 0.10 and Java Mon, 10 Oct, 18:18
static-max     Re: Manually committing offset in Spark 2.0 with Kafka 0.10 and Java Tue, 11 Oct, 07:54
Cody Koeninger       Re: Manually committing offset in Spark 2.0 with Kafka 0.10 and Java Tue, 11 Oct, 12:27
Jean Georges Perrin JSON Arrays and Spark Mon, 10 Oct, 16:57
Luciano Resende   Re: JSON Arrays and Spark Mon, 10 Oct, 18:08
Jean Georges Perrin     Re: JSON Arrays and Spark Mon, 10 Oct, 18:19
Hyukjin Kwon       Re: JSON Arrays and Spark Mon, 10 Oct, 23:56
Kappaganthu, Sivaram (ES)     RE: JSON Arrays and Spark Wed, 12 Oct, 06:04
Hyukjin Kwon       Re: JSON Arrays and Spark Wed, 12 Oct, 06:15
sujeet jog       Re: JSON Arrays and Spark Wed, 12 Oct, 06:18
Jean Georges Perrin   Re: JSON Arrays and Spark Mon, 10 Oct, 18:15
cuevasclemente Error: PartitioningCollection requires all of its partitionings have the same numPartitions. Mon, 10 Oct, 17:24
Pulasthi Supun Wickramasinghe Large variation in spark in Task Deserialization Time Mon, 10 Oct, 17:53
Mich Talebzadeh converting hBaseRDD to DataFrame Mon, 10 Oct, 18:02
Divya Gehlot   Re: converting hBaseRDD to DataFrame Tue, 11 Oct, 06:38
Selvam Raman Spark S3 Mon, 10 Oct, 21:46
ayan guha   Re: Spark S3 Mon, 10 Oct, 22:06
Selvam Raman     Re: Spark S3 Tue, 11 Oct, 05:03
Abhinay Mehta       Re: Spark S3 Tue, 11 Oct, 09:22
diplomatic Guru [Spark] RDDs are not persisting in memory Mon, 10 Oct, 22:14
Chin Wei Low   Re: [Spark] RDDs are not persisting in memory Tue, 11 Oct, 02:34
diplomatic Guru     Re: [Spark] RDDs are not persisting in memory Tue, 11 Oct, 10:23
diplomatic Guru       Re: [Spark] RDDs are not persisting in memory Tue, 11 Oct, 11:44
Mich Talebzadeh Design consideration for a trading System Mon, 10 Oct, 22:40
Fei Hu Kryo on Zeppelin Tue, 11 Oct, 04:11
cashinpj GraphFrame BFS Tue, 11 Oct, 04:32
Gimantha Bandara Exception while shutting down the Spark master. Tue, 11 Oct, 09:57
Gimantha Bandara   Re: Exception while shutting down the Spark master. Tue, 11 Oct, 10:53
DandyDev Can mapWithState state func be called every batchInterval? Tue, 11 Oct, 11:28
Cody Koeninger   Re: Can mapWithState state func be called every batchInterval? Tue, 11 Oct, 13:41
Daan Debie     Re: Can mapWithState state func be called every batchInterval? Tue, 11 Oct, 14:49
Cody Koeninger       Re: Can mapWithState state func be called every batchInterval? Tue, 11 Oct, 15:14
manasdebashiskar   Re: Can mapWithState state func be called every batchInterval? Thu, 13 Oct, 20:54
Nicolas Long mllib model in production web API Tue, 11 Oct, 15:53
Sean Owen   Re: mllib model in production web API Tue, 11 Oct, 16:52
Aseem Bansal     Re: mllib model in production web API Wed, 12 Oct, 09:52
Nicolas Long       Re: mllib model in production web API Sat, 15 Oct, 15:12
Aseem Bansal         Re: mllib model in production web API Tue, 18 Oct, 03:58
vincent gromakowski           Re: mllib model in production web API Tue, 18 Oct, 07:17
Aseem Bansal             Re: mllib model in production web API Tue, 18 Oct, 12:03
Samy Dindane Limit Kafka batches size with Spark Streaming Tue, 11 Oct, 15:57
Cody Koeninger   Re: Limit Kafka batches size with Spark Streaming Tue, 11 Oct, 16:08
Samy Dindane     Re: Limit Kafka batches size with Spark Streaming Wed, 12 Oct, 13:53
Cody Koeninger       Re: Limit Kafka batches size with Spark Streaming Wed, 12 Oct, 14:40
Samy Dindane         Re: Limit Kafka batches size with Spark Streaming Wed, 12 Oct, 16:00
Cody Koeninger           Re: Limit Kafka batches size with Spark Streaming Wed, 12 Oct, 17:31
Samy Dindane             Re: Limit Kafka batches size with Spark Streaming Thu, 13 Oct, 09:33
Cody Koeninger               Re: Limit Kafka batches size with Spark Streaming Thu, 13 Oct, 14:35
Samy Dindane                 Re: Limit Kafka batches size with Spark Streaming Thu, 13 Oct, 16:41
sandesh deshmane Spark 2.0.0 Error Caused by: java.lang.IllegalArgumentException: requirement failed: Block broadcast_21_piece0 is already present in the MemoryStore Tue, 11 Oct, 16:10
pandees waran Recommended way to run spark streaming in production in EMR Tue, 11 Oct, 18:09
doruchiulan Spark Docker Container - Jars problem when deploying my app Tue, 11 Oct, 19:10
Denis Bolshakov   Re: Spark Docker Container - Jars problem when deploying my app Tue, 11 Oct, 20:27
Xiaoye Sun one executor runs multiple parallel tasks VS multiple excutors each runs one task Tue, 11 Oct, 20:49
Denis Bolshakov   Re: one executor runs multiple parallel tasks VS multiple excutors each runs one task Tue, 11 Oct, 21:45
Nick textFileStream dStream to DataFrame issues Tue, 11 Oct, 23:43
Andrew James Anyone attending spark summit? Wed, 12 Oct, 01:04
Andrew Gelinas   Re: Anyone attending spark summit? Thu, 13 Oct, 08:21
Ankur Srivastava Spark Shuffle Issue Wed, 12 Oct, 06:16
Ankur Srivastava   Re: Spark Shuffle Issue Wed, 12 Oct, 23:19
陈哲 Spark ML OOM problem Wed, 12 Oct, 07:24
Jörn Franke   Re: Spark ML OOM problem Wed, 12 Oct, 11:46
Haopu Wang Kafka integration: get existing Kafka messages? Wed, 12 Oct, 09:15
Cody Koeninger   Re: Kafka integration: get existing Kafka messages? Wed, 12 Oct, 12:10
Haopu Wang     RE: Kafka integration: get existing Kafka messages? Thu, 13 Oct, 00:35
Cody Koeninger       Re: Kafka integration: get existing Kafka messages? Thu, 13 Oct, 01:30
Haopu Wang         RE: Kafka integration: get existing Kafka messages? Fri, 14 Oct, 07:54
Cody Koeninger           Re: Kafka integration: get existing Kafka messages? Fri, 14 Oct, 17:01
Aseem Bansal Reading from and writing to different S3 buckets in spark Wed, 12 Oct, 09:49
Steve Loughran   Re: Reading from and writing to different S3 buckets in spark Wed, 12 Oct, 10:05
Mridul Muralidharan   Re: Reading from and writing to different S3 buckets in spark Wed, 12 Oct, 19:39
Selvam Raman Spark-Sql 2.0 nullpointerException Wed, 12 Oct, 15:10
Selvam Raman   Re: Spark-Sql 2.0 nullpointerException Wed, 12 Oct, 15:19
Samy Dindane How to prevent having more than one instance of a specific job running on the cluster Wed, 12 Oct, 16:36
DataFrame/Dataset join not producing correct results in Spark 2.0/Yarn
Stephen Hankinson   DataFrame/Dataset join not producing correct results in Spark 2.0/Yarn Wed, 12 Oct, 16:55
shankinson   DataFrame/Dataset join not producing correct results in Spark 2.0/Yarn Thu, 13 Oct, 01:44
Meeraj Kunnumpurath UDF on multiple columns Wed, 12 Oct, 17:56
Meeraj Kunnumpurath   Re: UDF on multiple columns Wed, 12 Oct, 18:02
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Box list
Sep 202178
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137