spark-user mailing list archives: November 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next »Thread · Author · Date
Abhishek Anand Insert a JavaPairDStream into multiple cassandra table on the basis of key. Thu, 03 Nov, 06:28
Aseem Bansal Is Spark launcher's listener API considered production ready? Thu, 03 Nov, 07:22
Aseem Bansal   Re: Is Spark launcher's listener API considered production ready? Fri, 04 Nov, 09:46
saurabh3d How to join dstream and JDBCRDD with checkpointing enabled Thu, 03 Nov, 08:14
lxw SparkSQL with Hive got "java.lang.NullPointerException" Thu, 03 Nov, 10:20
Carlo.Allocca LinearRegressionWithSGD and Rank Features By Importance Thu, 03 Nov, 10:35
Mohit Jaggi   Re: LinearRegressionWithSGD and Rank Features By Importance Thu, 03 Nov, 20:41
Carlo.Allocca     Re: LinearRegressionWithSGD and Rank Features By Importance Fri, 04 Nov, 07:38
Robin East       Re: LinearRegressionWithSGD and Rank Features By Importance Fri, 04 Nov, 09:19
Carlo.Allocca         Re: LinearRegressionWithSGD and Rank Features By Importance Fri, 04 Nov, 09:57
Masood Krohy       Re: LinearRegressionWithSGD and Rank Features By Importance Mon, 07 Nov, 15:31
Carlo.Allocca         Re: LinearRegressionWithSGD and Rank Features By Importance Mon, 07 Nov, 15:47
Robin East           Re: LinearRegressionWithSGD and Rank Features By Importance Mon, 07 Nov, 16:20
Masood Krohy           Re: LinearRegressionWithSGD and Rank Features By Importance Mon, 07 Nov, 16:27
Carlo.Allocca             Re: LinearRegressionWithSGD and Rank Features By Importance Mon, 07 Nov, 17:12
Carlo.Allocca               Re: LinearRegressionWithSGD and Rank Features By Importance Mon, 07 Nov, 17:14
Carlo.Allocca                 Re: LinearRegressionWithSGD and Rank Features By Importance Tue, 08 Nov, 16:01
Masood Krohy                   Re: LinearRegressionWithSGD and Rank Features By Importance Tue, 08 Nov, 17:19
Carlo.Allocca                     Re: LinearRegressionWithSGD and Rank Features By Importance Wed, 09 Nov, 11:07
Rabin Banerjee Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 11:53
Robin East   Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 12:37
Koert Kuipers   Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 13:21
Koert Kuipers   Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 13:29
Rabin Banerjee   Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 13:59
ayan guha     Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 14:13
Koert Kuipers     Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 14:37
Robin East       Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 15:09
Michael Armbrust   Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 20:10
Koert Kuipers     Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 23:46
Michael Armbrust       Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 00:59
Koert Kuipers         Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 02:25
Koert Kuipers           Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 02:31
Michael Armbrust             Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 04:59
Koert Kuipers               Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 13:18
Koert Kuipers                 Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 14:06
Michael Armbrust                   Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 18:39
Koert Kuipers                     Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 19:57
Zsolt Tóth Delegation Token renewal in yarn-cluster Thu, 03 Nov, 14:22
Zsolt Tóth   Re: Delegation Token renewal in yarn-cluster Thu, 03 Nov, 20:29
Marcelo Vanzin   Re: Delegation Token renewal in yarn-cluster Thu, 03 Nov, 20:34
Zsolt Tóth     Re: Delegation Token renewal in yarn-cluster Thu, 03 Nov, 21:02
Marcelo Vanzin       Re: Delegation Token renewal in yarn-cluster Thu, 03 Nov, 21:42
Zsolt Tóth         Re: Delegation Token renewal in yarn-cluster Thu, 03 Nov, 22:47
Marcelo Vanzin           Re: Delegation Token renewal in yarn-cluster Fri, 04 Nov, 01:37
Zsolt Tóth             Re: Delegation Token renewal in yarn-cluster Fri, 04 Nov, 08:57
Marcelo Vanzin               Re: Delegation Token renewal in yarn-cluster Fri, 04 Nov, 17:23
Steve Loughran             Re: Delegation Token renewal in yarn-cluster Fri, 04 Nov, 10:36
Donald Matthews incomplete aggregation in a GROUP BY Thu, 03 Nov, 15:05
Michael Armbrust   Re: incomplete aggregation in a GROUP BY Thu, 03 Nov, 20:11
Jain, Nishit How do I convert a data frame to broadcast variable? Thu, 03 Nov, 15:53
Denny Lee   Re: How do I convert a data frame to broadcast variable? Thu, 03 Nov, 15:59
Jain, Nishit     Re: How do I convert a data frame to broadcast variable? Thu, 03 Nov, 16:32
Silvio Fiorito     Re: How do I convert a data frame to broadcast variable? Thu, 03 Nov, 17:26
Jain, Nishit       Re: How do I convert a data frame to broadcast variable? Fri, 04 Nov, 14:00
Zakaria Hili PySpark 2: Kmeans The input data is not directly cached Thu, 03 Nov, 16:16
Re: mLIb solving linear regression with sparse inputs
Robineast   Re: mLIb solving linear regression with sparse inputs Thu, 03 Nov, 18:07
Robineast     Re: mLIb solving linear regression with sparse inputs Sun, 06 Nov, 11:35
im281       Re: mLIb solving linear regression with sparse inputs Sun, 06 Nov, 14:43
im281       Re: mLIb solving linear regression with sparse inputs Sun, 06 Nov, 16:28
im281       Re: mLIb solving linear regression with sparse inputs Sun, 06 Nov, 16:34
jamborta example LDA code ClassCastException Thu, 03 Nov, 18:20
Asher Krim   Re: example LDA code ClassCastException Fri, 04 Nov, 02:53
Tamas Jambor     Re: example LDA code ClassCastException Fri, 04 Nov, 11:18
Andrés Ivaldi Aggregation Calculation Thu, 03 Nov, 18:29
Stephen Boesch   Re: Aggregation Calculation Thu, 03 Nov, 19:04
Andrés Ivaldi     Re: Aggregation Calculation Thu, 03 Nov, 20:17
Andrés Ivaldi       Re: Aggregation Calculation Fri, 04 Nov, 13:23
Fwd: Stream compressed data from KafkaUtils.createDirectStream
baki hayat   Fwd: Stream compressed data from KafkaUtils.createDirectStream Thu, 03 Nov, 18:46
bhayat Stream compressed data from KafkaUtils.createDirectStream Thu, 03 Nov, 18:53
Daniel Haviv   Re: Stream compressed data from KafkaUtils.createDirectStream Thu, 03 Nov, 19:27
Daniel Haviv     Re: Stream compressed data from KafkaUtils.createDirectStream Thu, 03 Nov, 19:40
kant kodali How do I specify StorageLevel in KafkaUtils.createDirectStream? Thu, 03 Nov, 20:05
morfious902002 Slow Parquet write to HDFS using Spark Thu, 03 Nov, 20:52
Arun Patel Spark XML ignore namespaces Thu, 03 Nov, 21:37
Hyukjin Kwon   Re: Spark XML ignore namespaces Fri, 04 Nov, 05:01
Yanwei Zhang Use BLAS object for matrix operation Thu, 03 Nov, 23:04
Stephen Boesch   Re: Use BLAS object for matrix operation Thu, 03 Nov, 23:10
shyla deshpande Error creating SparkSession, in IntelliJ Fri, 04 Nov, 00:10
Hyukjin Kwon   Re: Error creating SparkSession, in IntelliJ Fri, 04 Nov, 05:03
shyla deshpande     Re: Error creating SparkSession, in IntelliJ Fri, 04 Nov, 17:35
Haopu Wang expected behavior of Kafka dynamic topic subscription Fri, 04 Nov, 02:43
Cody Koeninger   Re: expected behavior of Kafka dynamic topic subscription Fri, 04 Nov, 14:35
Haopu Wang     RE: expected behavior of Kafka dynamic topic subscription Mon, 07 Nov, 01:31
Cody Koeninger       Re: expected behavior of Kafka dynamic topic subscription Mon, 07 Nov, 15:35
blazespinnaker sanboxing spark executors Fri, 04 Nov, 06:41
Steve Loughran   Re: sanboxing spark executors Fri, 04 Nov, 10:23
Andrew Holway   Re: sanboxing spark executors Fri, 04 Nov, 13:31
Calvin Jia     Re: sanboxing spark executors Fri, 04 Nov, 21:51
blazespinnaker   Re: sanboxing spark executors Fri, 04 Nov, 23:13
Michael Gummelt     Re: sanboxing spark executors Fri, 04 Nov, 23:36
Michael Segel     Re: sanboxing spark executors Tue, 08 Nov, 16:30
颜发才(Yan Facai) Vector is not found in case class after import Fri, 04 Nov, 08:43
Haopu Wang InvalidClassException when load KafkaDirectStream from checkpoint (Spark 2.0.0) Fri, 04 Nov, 09:23
Haopu Wang   RE: InvalidClassException when load KafkaDirectStream from checkpoint (Spark 2.0.0) Tue, 08 Nov, 08:06
Mikael Ståldal WARN 1 block locks were not released with MLlib ALS Fri, 04 Nov, 13:09
vonnagy Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 04 Nov, 17:20
Cody Koeninger   Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 04 Nov, 17:28
vonnagy   Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 04 Nov, 18:48
Cody Koeninger     Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 04 Nov, 20:24
Ivan von Nagy       Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 04 Nov, 20:37
Cody Koeninger         Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 04 Nov, 20:48
Sean McKibben           Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Mon, 07 Nov, 19:08
Cody Koeninger             Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Mon, 07 Nov, 19:16
Ivan von Nagy               Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Mon, 07 Nov, 19:35
Cody Koeninger                 Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Mon, 07 Nov, 19:55
Ivan von Nagy                   Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Thu, 10 Nov, 16:26
Shixiong(Ryan) Zhu                     Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 11 Nov, 01:43
Cody Koeninger                       Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 11 Nov, 20:12
Ivan von Nagy                         Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Sat, 12 Nov, 18:14
Sean McKibben                           Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Sat, 12 Nov, 19:46
Ivan von Nagy                             Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Sat, 12 Nov, 20:15
Cody Koeninger                               Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Sat, 12 Nov, 21:25
Ivan von Nagy                                 Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Sun, 13 Nov, 18:47
Cody Koeninger                                   Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Sun, 13 Nov, 22:21
lminer SAXParseException while writing to parquet on s3 Fri, 04 Nov, 17:53
Reth RM Clustering Webpages using KMean and Spark Apis : GC limit exceed. Fri, 04 Nov, 18:13
Reth RM   Re: Clustering Webpages using KMean and Spark Apis : GC limit exceed. Fri, 04 Nov, 19:18
Manjunath, Kiran GenericRowWithSchema cannot be cast to java.lang.Double : UDAF error Fri, 04 Nov, 20:46
Manjunath, Kiran   Re: GenericRowWithSchema cannot be cast to java.lang.Double : UDAF error Fri, 04 Nov, 20:48
Manish Tripathi Spark Float to VectorUDT for ML evaluator lib Fri, 04 Nov, 20:51
levt NoSuchElementException when trying to use dataset Fri, 04 Nov, 20:56
shyla deshpande java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession$ . Please Help!!!!!!! Fri, 04 Nov, 21:00
Holden Karau   Re: java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession$ . Please Help!!!!!!! Fri, 04 Nov, 21:05
shyla deshpande     Re: java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession$ . Please Help!!!!!!! Fri, 04 Nov, 21:56
levt java.util.NoSuchElementException when trying to use dataset from worker Fri, 04 Nov, 22:27
Sam Goodwin Upgrading to Spark 2.0.1 broke array<string> in parquet DataFrame Sat, 05 Nov, 00:11
Michael Armbrust   Re: Upgrading to Spark 2.0.1 broke array<string> in parquet DataFrame Mon, 07 Nov, 16:28
Lev Tsentsiper NoSuchElementException Sat, 05 Nov, 00:15
Michael Armbrust   Re: NoSuchElementException Mon, 07 Nov, 16:27
Elkhan Dadashov SparkLauncer 2.0.1 version working incosistently in yarn-client mode Sat, 05 Nov, 09:54
Marcelo Vanzin   Re: SparkLauncer 2.0.1 version working incosistently in yarn-client mode Mon, 07 Nov, 17:46
Elkhan Dadashov     Re: SparkLauncer 2.0.1 version working incosistently in yarn-client mode Thu, 10 Nov, 08:31
母延年(YDB技术支持) why visitCreateFileFormat doesn`t support hive STORED BY ,just support store as Sat, 05 Nov, 12:27
Rohit Verma Optimized way to use spark as db to hdfs etl Sat, 05 Nov, 14:39
Deepak Sharma   Re: Optimized way to use spark as db to hdfs etl Sat, 05 Nov, 16:12
Sabarish Sasidharan     Re: Optimized way to use spark as db to hdfs etl Sun, 06 Nov, 16:25
Femi Anthony Reading csv files with quoted fields containing embedded commas Sat, 05 Nov, 21:58
Hyukjin Kwon   Re: Reading csv files with quoted fields containing embedded commas Sun, 06 Nov, 11:59
Femi Anthony     Re: Reading csv files with quoted fields containing embedded commas Mon, 07 Nov, 02:28
Rohit Verma Spark dataset cache vs tempview Sun, 06 Nov, 03:44
Mich Talebzadeh   Re: Spark dataset cache vs tempview Sun, 06 Nov, 09:16
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next »Thread · Author · Date
Box list
Sep 2021113
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137