spark-user mailing list archives: December 2016

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Carl Ballantyne Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 05:20
Miguel Morales   Re: Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 05:21
Carl Ballantyne     Re: Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 05:30
Miguel Morales       Re: Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 05:33
Carl Ballantyne         Re: Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 05:59
Miguel Morales           Re: Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 06:00
Carl Ballantyne             Re: Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 06:07
Patnaik, Vandana SPARK-SUBMIT and optional args like -h etc Thu, 01 Dec, 05:23
Daniel van der Ende   Re: SPARK-SUBMIT and optional args like -h etc Thu, 01 Dec, 06:58
Re: updateStateByKey -- when the key is multi-column (like a composite key )
shyla deshpande   Re: updateStateByKey -- when the key is multi-column (like a composite key ) Thu, 01 Dec, 06:20
Bhavani Sudha Saktheeswaran mapWithState's checkpoint size Thu, 01 Dec, 06:25
Shixiong(Ryan) Zhu   Re: mapWithState's checkpoint size Thu, 01 Dec, 20:00
Re: java.lang.Exception: Could not compute split, block input-0-1480539568000 not found
kant kodali   Re: java.lang.Exception: Could not compute split, block input-0-1480539568000 not found Thu, 01 Dec, 06:40
kant kodali     Re: java.lang.Exception: Could not compute split, block input-0-1480539568000 not found Thu, 01 Dec, 06:44
kant kodali       Re: java.lang.Exception: Could not compute split, block input-0-1480539568000 not found Thu, 01 Dec, 08:42
kant kodali         Re: java.lang.Exception: Could not compute split, block input-0-1480539568000 not found Thu, 01 Dec, 08:55
kant kodali           Re: java.lang.Exception: Could not compute split, block input-0-1480539568000 not found Thu, 01 Dec, 09:43
Marco Mistroni             Re: java.lang.Exception: Could not compute split, block input-0-1480539568000 not found Thu, 01 Dec, 12:15
shyla deshpande Spark 2.0.2 , using DStreams in Spark Streaming . How do I create SQLContext? Please help Thu, 01 Dec, 06:57
Deepak Sharma   Re: Spark 2.0.2 , using DStreams in Spark Streaming . How do I create SQLContext? Please help Thu, 01 Dec, 07:02
shyla deshpande     Re: Spark 2.0.2 , using DStreams in Spark Streaming . How do I create SQLContext? Please help Thu, 01 Dec, 18:55
Re: Spark Job not exited and shows running
Daniel van der Ende   Re: Spark Job not exited and shows running Thu, 01 Dec, 07:03
ayan guha     Re: Spark Job not exited and shows running Thu, 01 Dec, 07:22
Selvam Raman     Re: Spark Job not exited and shows running Thu, 01 Dec, 09:37
RE: PySpark to remote cluster
Schaefers, Klaus   RE: PySpark to remote cluster Thu, 01 Dec, 08:38
Re: [structured streaming] How to remove outdated data when use Window Operations
Tathagata Das   Re: [structured streaming] How to remove outdated data when use Window Operations Thu, 01 Dec, 08:53
Tathagata Das     Re: [structured streaming] How to remove outdated data when use Window Operations Thu, 01 Dec, 08:54
ayan guha       Re: [structured streaming] How to remove outdated data when use Window Operations Thu, 01 Dec, 20:57
Michael Armbrust         Re: [structured streaming] How to remove outdated data when use Window Operations Thu, 01 Dec, 23:20
rockinf...@gmail.com How to Check Dstream is empty or not? Thu, 01 Dec, 12:28
bryan.jeff...@gmail.com   RE: How to Check Dstream is empty or not? Fri, 02 Dec, 00:11
Evgenii Morozov newly added Executors couldn't fetch jar files from Master Thu, 01 Dec, 14:28
Otávio Carvalho Spark-shell doesn't see changes coming from Kafka topic Thu, 01 Dec, 14:31
Tathagata Das   Re: Spark-shell doesn't see changes coming from Kafka topic Thu, 01 Dec, 19:36
Otávio Carvalho     Re: Spark-shell doesn't see changes coming from Kafka topic Tue, 06 Dec, 00:40
RE: build models in parallel
Masood Krohy   RE: build models in parallel Thu, 01 Dec, 15:23
Unsubscribe
hardik nagda   Unsubscribe Thu, 01 Dec, 16:03
Sivakumar S   Unsubscribe Sat, 03 Dec, 15:12
S Malligarjunan     Re: Unsubscribe Sat, 03 Dec, 17:55
kote rao       Re: Unsubscribe Sat, 03 Dec, 22:55
mehak soni         Re: Unsubscribe Tue, 06 Dec, 03:28
S Malligarjunan   Unsubscribe Sat, 03 Dec, 18:06
Siddhartha Khaitan   Unsubscribe Thu, 08 Dec, 04:05
Kranthi Gmail     Unsubscribe Thu, 08 Dec, 05:08
Nicholas Chammas       Re: Unsubscribe Thu, 08 Dec, 14:56
Ajit Jaokar   Unsubscribe Thu, 08 Dec, 05:12
Nicholas Chammas     Re: Unsubscribe Thu, 08 Dec, 14:56
Prashant Singh Thakur   Unsubscribe Thu, 08 Dec, 05:17
Nicholas Chammas     Re: Unsubscribe Thu, 08 Dec, 14:57
Roger Holenweger   Unsubscribe Thu, 08 Dec, 05:54
Jeff Sadowski     Re: Unsubscribe Thu, 08 Dec, 14:19
Nicholas Chammas     Re: Unsubscribe Thu, 08 Dec, 14:57
Vinicius Barreto   Unsubscribe Thu, 08 Dec, 11:27
Nicholas Chammas     Re: Unsubscribe Thu, 08 Dec, 14:57
Chen, Yan I   Unsubscribe Thu, 08 Dec, 14:25
Chen, Yan I   Unsubscribe Thu, 08 Dec, 14:41
Nicholas Chammas     Re: Unsubscribe Thu, 08 Dec, 14:57
Tao Lu   Unsubscribe Thu, 08 Dec, 14:45
Nicholas Chammas     Re: Unsubscribe Thu, 08 Dec, 14:57
Kishorkumar Patil   Unsubscribe Thu, 08 Dec, 14:54
Nicholas Chammas     Re: Unsubscribe Thu, 08 Dec, 14:58
cjuexuan   Unsubscribe Sat, 10 Dec, 03:41
Mostafa Alaa Mohamed   Unsubscribe Wed, 14 Dec, 08:42
krishna ramachandran   Unsubscribe Fri, 16 Dec, 16:52
Vinayak Joshi5 Spark 2.x Pyspark Spark SQL createDataframe Error Thu, 01 Dec, 17:23
Vinayak Joshi5   Re: Spark 2.x Pyspark Spark SQL createDataframe Error Thu, 01 Dec, 17:33
Michal Šenkýř     Re: Spark 2.x Pyspark Spark SQL createDataframe Error Fri, 02 Dec, 00:19
Vinayak Joshi5       Re: Spark 2.x Pyspark Spark SQL createDataframe Error Fri, 02 Dec, 10:12
roni support vector regression in spark Thu, 01 Dec, 20:08
unsubscribe
Vishal Soni   unsubscribe Thu, 01 Dec, 20:14
Patnaik, Vandana   unsubscribe Thu, 01 Dec, 23:59
Ajith Jose   unsubscribe Thu, 08 Dec, 03:53
Nicholas Chammas     Re: unsubscribe Thu, 08 Dec, 14:56
Ramon Rosa da Silva   unsubscribe Thu, 08 Dec, 12:45
Nicholas Chammas     Re: unsubscribe Thu, 08 Dec, 14:58
Di Zhu       Re: unsubscribe Thu, 08 Dec, 15:00
Nicholas Chammas         Re: unsubscribe Thu, 08 Dec, 15:02
Chen, Yan I           RE: unsubscribe Thu, 08 Dec, 15:14
Nicholas Chammas             Re: unsubscribe Thu, 08 Dec, 15:55
Chen, Yan I               RE: unsubscribe Thu, 08 Dec, 16:14
Nicholas Chammas                 Re: unsubscribe Thu, 08 Dec, 16:34
Juan Caravaca   unsubscribe Thu, 08 Dec, 12:49
Nicholas Chammas     Re: unsubscribe Thu, 08 Dec, 14:58
Niki Pavlopoulou   unsubscribe Thu, 08 Dec, 13:01
Nicholas Chammas     Re: unsubscribe Thu, 08 Dec, 14:58
Chris Harvey   unsubscribe Mon, 12 Dec, 19:29
Minikek   Re: unsubscribe Wed, 28 Dec, 03:43
kant kodali quick question Thu, 01 Dec, 20:25
Weiwei Zhang [GraphFrame, Pyspark] Weighted Edge in PageRank Thu, 01 Dec, 22:41
Felix Cheung   Re: [GraphFrame, Pyspark] Weighted Edge in PageRank Fri, 02 Dec, 01:22
Weiwei Zhang     Re: [GraphFrame, Pyspark] Weighted Edge in PageRank Fri, 02 Dec, 03:03
Dale Wang [Spark Dataset]: How to conduct co-partition join in the new Dataset API in Spark 2.0 Fri, 02 Dec, 05:23
w.zhaokang Fwd: [Spark Dataset]: How to conduct co-partition join in the new Dataset API in Spark 2.0 Fri, 02 Dec, 05:26
Kanchan W Usage of -javaagent with spark.executor.extrajavaoptions configuration Fri, 02 Dec, 05:41
Nisrina Luthfiyati Accessing log for lost executors Fri, 02 Dec, 06:30
Benyi Wang   Re: Accessing log for lost executors Fri, 02 Dec, 09:45
Georg Heiler Spark sql generated dynamically Fri, 02 Dec, 11:33
ayan guha   Re: Spark sql generated dynamically Fri, 02 Dec, 14:17
Georg Heiler     Re: Spark sql generated dynamically Sat, 03 Dec, 00:31
gabrielperez2484 Kafka 0.10 & Spark Streaming 2.0.2 Fri, 02 Dec, 13:43
Jacek Laskowski   Re: Kafka 0.10 & Spark Streaming 2.0.2 Fri, 02 Dec, 16:47
Gabriel Perez     Re: Kafka 0.10 & Spark Streaming 2.0.2 Fri, 02 Dec, 16:54
Jacek Laskowski       Re: Kafka 0.10 & Spark Streaming 2.0.2 Fri, 02 Dec, 17:21
Gabriel Perez         Re: Kafka 0.10 & Spark Streaming 2.0.2 Fri, 02 Dec, 17:25
Mich Talebzadeh       Re: Kafka 0.10 & Spark Streaming 2.0.2 Fri, 02 Dec, 17:26
Gabriel Perez         Re: Kafka 0.10 & Spark Streaming 2.0.2 Fri, 02 Dec, 17:28
Jacek Laskowski           Re: Kafka 0.10 & Spark Streaming 2.0.2 Fri, 02 Dec, 18:45
im281 RDD flatmap to multiple key/value pairs Fri, 02 Dec, 16:05
Michal Šenkýř   Re: RDD flatmap to multiple key/value pairs Fri, 02 Dec, 18:38
Re: TallSkinnyQR
Iman Mohtashemi   Re: TallSkinnyQR Fri, 02 Dec, 16:13
Sean Owen     Re: TallSkinnyQR Fri, 02 Dec, 16:19
Iman Mohtashemi       Re: TallSkinnyQR Fri, 02 Dec, 16:23
Iman Mohtashemi         Re: TallSkinnyQR Fri, 02 Dec, 16:25
Huamin Li         Re: TallSkinnyQR Fri, 02 Dec, 18:54
Iman Mohtashemi           Re: TallSkinnyQR Fri, 02 Dec, 19:07
Huamin Li             Re: TallSkinnyQR Fri, 02 Dec, 22:49
Iman Mohtashemi               Re: TallSkinnyQR Fri, 02 Dec, 23:03
Iman Mohtashemi                 Re: TallSkinnyQR Fri, 30 Dec, 17:18
Sean Owen                   Re: TallSkinnyQR Fri, 30 Dec, 17:22
Amit Sela RDD getPartitions() size and HashPartitioner numPartitions Fri, 02 Dec, 21:53
Manish Malhotra   Re: RDD getPartitions() size and HashPartitioner numPartitions Sun, 04 Dec, 09:10
kant kodali What benefits do we really get out of colocation? Sat, 03 Dec, 06:38
vincent gromakowski   Re: What benefits do we really get out of colocation? Sat, 03 Dec, 08:34
kant kodali     Re: What benefits do we really get out of colocation? Sat, 03 Dec, 08:42
Sean Owen       Re: What benefits do we really get out of colocation? Sat, 03 Dec, 08:56
kant kodali         Re: What benefits do we really get out of colocation? Sat, 03 Dec, 09:12
kant kodali           Re: What benefits do we really get out of colocation? Sat, 03 Dec, 09:14
Manish Malhotra           Re: What benefits do we really get out of colocation? Sat, 03 Dec, 09:16
kant kodali             Re: What benefits do we really get out of colocation? Sat, 03 Dec, 09:22
kant kodali               Re: What benefits do we really get out of colocation? Sat, 03 Dec, 10:05
Steve Loughran             Re: What benefits do we really get out of colocation? Sat, 03 Dec, 12:08
David Mitchell   Re: What benefits do we really get out of colocation? Sat, 03 Dec, 12:28
vincent gromakowski     Re: What benefits do we really get out of colocation? Sat, 03 Dec, 16:28
kant kodali       Re: What benefits do we really get out of colocation? Sat, 03 Dec, 17:42
Mich Talebzadeh Parquet timestamp storage in Hive and possible use case of spark instead of impala Sat, 03 Dec, 12:11
Vasu Gourabathina Design patterns for Spark implementation Sat, 03 Dec, 16:59
Pradeep Gaddam   Re: Design patterns for Spark implementation Sun, 04 Dec, 17:32
Mich Talebzadeh     Re: Design patterns for Spark implementation Sun, 04 Dec, 20:01
Vasu Gourabathina       Re: Design patterns for Spark implementation Mon, 05 Dec, 20:36
Lars Albertsson         Re: Design patterns for Spark implementation Fri, 09 Dec, 16:15
Peter Figliozzi   Re: Design patterns for Spark implementation Thu, 08 Dec, 19:38
Sachin Naik     Re: Design patterns for Spark implementation Thu, 08 Dec, 19:51
Mich Talebzadeh       Re: Design patterns for Spark implementation Thu, 08 Dec, 22:54
Mich Talebzadeh         Re: Design patterns for Spark implementation Sat, 10 Dec, 14:06
Swapnil Shinde Spark shuffle: FileNotFound exception Sun, 04 Dec, 06:03
Evgenii Morozov   Re: Spark shuffle: FileNotFound exception Sun, 04 Dec, 22:52
Mendelson, Assaf Creating schema from json representation Sun, 04 Dec, 09:10
Mendelson, Assaf   RE: Creating schema from json representation Sun, 04 Dec, 09:58
ayan guha Access multiple cluster Sun, 04 Dec, 21:45
Mich Talebzadeh   Re: Access multiple cluster Sun, 04 Dec, 22:22
Jörn Franke   Re: Access multiple cluster Mon, 05 Dec, 06:17
ayan guha     Re: Access multiple cluster Mon, 05 Dec, 06:34
Steve Loughran   Re: Access multiple cluster Mon, 05 Dec, 11:24
Re: SVM regression in Spark
Evgenii Morozov   Re: SVM regression in Spark Sun, 04 Dec, 22:55
John Fang Can spark support exactly once based kafka ? Due to these following question? Sun, 04 Dec, 23:49
LQ   how to use Dataset of transform method Mon, 05 Dec, 01:33
Michal Šenkýř   Re: Can spark support exactly once based kafka ? Due to these following question? Mon, 05 Dec, 07:59
Piotr Smoliński     Re: Can spark support exactly once based kafka ? Due to these following question? Mon, 05 Dec, 09:08
Jörn Franke     Re: Can spark support exactly once based kafka ? Due to these following question? Mon, 05 Dec, 10:17
Cody Koeninger       Re: Can spark support exactly once based kafka ? Due to these following question? Tue, 06 Dec, 02:23
Devi P.V How to convert a unix timestamp column into date format(yyyy-MM-dd) ? Mon, 05 Dec, 07:38
Marco Mistroni   Re: How to convert a unix timestamp column into date format(yyyy-MM-dd) ? Mon, 05 Dec, 07:50
Devi P.V     Re: How to convert a unix timestamp column into date format(yyyy-MM-dd) ? Mon, 05 Dec, 08:04
Deepak Sharma       Re: How to convert a unix timestamp column into date format(yyyy-MM-dd) ? Mon, 05 Dec, 08:16
Deepak Sharma         Re: How to convert a unix timestamp column into date format(yyyy-MM-dd) ? Mon, 05 Dec, 08:19
Deepak Sharma           Re: How to convert a unix timestamp column into date format(yyyy-MM-dd) ? Mon, 05 Dec, 08:22
Michal Šenkýř             Re: How to convert a unix timestamp column into date format(yyyy-MM-dd) ? Mon, 05 Dec, 08:33
Devi P.V               Re: How to convert a unix timestamp column into date format(yyyy-MM-dd) ? Mon, 05 Dec, 08:47
Re: How do I flatten JSON blobs into a Data Frame using Spark/Spark SQL
kant kodali   Re: How do I flatten JSON blobs into a Data Frame using Spark/Spark SQL Mon, 05 Dec, 10:51
Hyukjin Kwon     Re: How do I flatten JSON blobs into a Data Frame using Spark/Spark SQL Mon, 05 Dec, 12:45
kant kodali       Re: How do I flatten JSON blobs into a Data Frame using Spark/Spark SQL Mon, 05 Dec, 19:10
Hyukjin Kwon         Re: How do I flatten JSON blobs into a Data Frame using Spark/Spark SQL Mon, 05 Dec, 22:20
Gerard Casey Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Mon, 05 Dec, 12:35
Gerard Casey   Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Mon, 05 Dec, 12:49
Jorge Sánchez     Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Mon, 05 Dec, 17:38
Marcelo Vanzin   Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Mon, 05 Dec, 18:26
Gerard Casey     Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Mon, 05 Dec, 18:44
Marcelo Vanzin       Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Mon, 05 Dec, 18:45
Gerard Casey         Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Wed, 07 Dec, 20:15
Marcelo Vanzin           Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Wed, 07 Dec, 21:03
Gerard Casey             Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Wed, 07 Dec, 21:09
Marcelo Vanzin               Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Wed, 07 Dec, 21:10
Gerard Casey                 Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Thu, 08 Dec, 07:35
Gerard Casey                   Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Thu, 08 Dec, 07:39
Marcin Pastecki                     Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Thu, 08 Dec, 07:46
Gerard Casey                       Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Thu, 08 Dec, 07:54
Marcelo Vanzin                         Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Thu, 08 Dec, 17:43
Gerard Casey                           Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Thu, 08 Dec, 19:17
Marcelo Vanzin                             Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Thu, 08 Dec, 19:18
Gerard Casey                               Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Thu, 08 Dec, 20:29
Marcelo Vanzin                                 Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Thu, 08 Dec, 20:43
Mich Talebzadeh Livy with Spark Mon, 05 Dec, 14:33
Richard Startin   Re: Livy with Spark Mon, 05 Dec, 14:50
Mich Talebzadeh     Re: Livy with Spark Mon, 05 Dec, 16:00
Mich Talebzadeh     Re: Livy with Spark Tue, 06 Dec, 21:51
Saisai Shao       Re: Livy with Spark Wed, 07 Dec, 09:05
Vadim Semenov   Re: Livy with Spark Mon, 05 Dec, 20:14
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Box list
Dec 201926
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137