spark-user mailing list archives: June 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · Next »Thread · Author · Date
Brandon White Spark ML - Is it safe to schedule two trainings job at the same time or will worker state be corrupted? Thu, 09 Jun, 17:28
Jacek Laskowski   Re: Spark ML - Is it safe to schedule two trainings job at the same time or will worker state be corrupted? Thu, 09 Jun, 17:35
John Simon Spark Streaming getting slower Thu, 09 Jun, 18:09
John Simon   Re: Spark Streaming getting slower Thu, 09 Jun, 18:19
Re: Processing Time Spikes (Spark Streaming)
christian.dancu...@rbc.com   Re: Processing Time Spikes (Spark Streaming) Thu, 09 Jun, 18:38
Re: Spark Streaming heap space out of memory
christian.dancu...@rbc.com   Re: Spark Streaming heap space out of memory Thu, 09 Jun, 18:43
SRK How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Thu, 09 Jun, 20:01
Stephen Boesch   Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Thu, 09 Jun, 20:16
swetha kasireddy     Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Thu, 09 Jun, 22:39
Mich Talebzadeh     Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Thu, 09 Jun, 22:40
swetha kasireddy       Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Thu, 09 Jun, 22:43
Mich Talebzadeh         Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Fri, 10 Jun, 04:25
Bijay Pathak           Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Fri, 10 Jun, 07:10
swetha kasireddy             Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Mon, 13 Jun, 17:47
swetha kasireddy               Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Mon, 13 Jun, 17:57
swetha kasireddy                 Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Mon, 13 Jun, 18:41
Bijay Pathak                   Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Tue, 14 Jun, 04:25
Sree Eedupuganti                     Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Tue, 14 Jun, 14:40
Mich Talebzadeh                       Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Tue, 14 Jun, 17:43
Mich Talebzadeh                         Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Tue, 14 Jun, 17:44
swetha kasireddy                           Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Wed, 15 Jun, 18:39
swetha kasireddy                     Re: How to insert data into 2000 partitions(directories) of ORC/parquet at a time using Spark SQL? Tue, 14 Jun, 17:33
Mahender Sarangam how to store results of Scala Query in Text format or tab delimiter Thu, 09 Jun, 20:11
Natu Lauchande Issues when using the streaming checkpoint Thu, 09 Jun, 20:57
Re: pyspark.GroupedData.agg works incorrectly when one column is aggregated twice?
Davies Liu   Re: pyspark.GroupedData.agg works incorrectly when one column is aggregated twice? Fri, 10 Jun, 00:00
Peter Halliday Error writing parquet to S3 Fri, 10 Jun, 04:00
Peter Halliday   Re: Error writing parquet to S3 Fri, 10 Jun, 17:38
april_ZMQ SparkR : glm model Fri, 10 Jun, 04:14
Sun Rui   Re: SparkR : glm model Sun, 12 Jun, 03:30
Srinivasan Hariharan02 Catalyst optimizer cpu/Io cost Fri, 10 Jun, 06:29
Takeshi Yamamuro   Re: Catalyst optimizer cpu/Io cost Fri, 10 Jun, 09:07
Srinivasan Hariharan02     RE: Catalyst optimizer cpu/Io cost Fri, 10 Jun, 09:45
Mich Talebzadeh       Re: Catalyst optimizer cpu/Io cost Fri, 10 Jun, 09:57
Srinivasan Hariharan02         RE: Catalyst optimizer cpu/Io cost Fri, 10 Jun, 11:46
Mich Talebzadeh           Re: Catalyst optimizer cpu/Io cost Fri, 10 Jun, 12:37
Jörn Franke             Re: Catalyst optimizer cpu/Io cost Fri, 10 Jun, 13:41
Mich Talebzadeh               Re: Catalyst optimizer cpu/Io cost Fri, 10 Jun, 15:33
Kazuaki Ishizaki     Re: Catalyst optimizer cpu/Io cost Fri, 10 Jun, 13:47
[No Subject]
pooja mehta   [No Subject] Fri, 10 Jun, 06:53
Rama Perubotla   [No Subject] Sat, 25 Jun, 01:59
pooja mehta   [No Subject] Wed, 29 Jun, 09:50
Ram Krishna Spark Installation to work on Spark Streaming and MLlib Fri, 10 Jun, 07:20
Holden Karau   Re: Spark Installation to work on Spark Streaming and MLlib Fri, 10 Jun, 07:24
Ram Krishna   Re: Spark Installation to work on Spark Streaming and MLlib Fri, 10 Jun, 11:52
Holden Karau     Re: Spark Installation to work on Spark Streaming and MLlib Fri, 10 Jun, 14:48
Ram Krishna       Re: Spark Installation to work on Spark Streaming and MLlib Sat, 11 Jun, 03:54
Asfandyar Ashraf Malik Spark Getting data from MongoDB in JAVA Fri, 10 Jun, 09:39
Alonso Isidoro Roman   Re: Spark Getting data from MongoDB in JAVA Fri, 10 Jun, 09:47
Asfandyar Ashraf Malik     Re: Spark Getting data from MongoDB in JAVA Fri, 10 Jun, 09:50
vaquar khan       Re: Spark Getting data from MongoDB in JAVA Sun, 12 Jun, 16:24
Ted Yu       Re: Spark Getting data from MongoDB in JAVA Sun, 12 Jun, 16:36
Asfandyar Ashraf Malik         Re: Spark Getting data from MongoDB in JAVA Mon, 13 Jun, 09:29
Chandra Mohan, Ananda Vel Murugan Kmeans Streaming process flow Fri, 10 Jun, 11:04
RuchitaGoyal IndexedRowMatrix multiplication with a local Sparse Matrix Fri, 10 Jun, 13:17
Umair Janjua Java MongoDB Spark Stratio (Please give me a hint) Fri, 10 Jun, 13:36
Umair Janjua   Re: Java MongoDB Spark Stratio (Please give me a hint) Mon, 13 Jun, 09:30
Umair Janjua     Re: Java MongoDB Spark Stratio (Please give me a hint) Mon, 13 Jun, 09:33
Re: word2vec: how to save an mllib model and reload it?
sharad82   Re: word2vec: how to save an mllib model and reload it? Fri, 10 Jun, 15:23
Ajay Chander SAS_TO_SPARK_SQL_(Could be a Bug?) Fri, 10 Jun, 16:07
Ajay Chander   Re: SAS_TO_SPARK_SQL_(Could be a Bug?) Fri, 10 Jun, 20:54
Mich Talebzadeh     Re: SAS_TO_SPARK_SQL_(Could be a Bug?) Fri, 10 Jun, 22:28
Ajay Chander       Re: SAS_TO_SPARK_SQL_(Could be a Bug?) Fri, 10 Jun, 22:38
Mich Talebzadeh         Re: SAS_TO_SPARK_SQL_(Could be a Bug?) Fri, 10 Jun, 22:58
Ajay Chander           Re: SAS_TO_SPARK_SQL_(Could be a Bug?) Sat, 11 Jun, 00:38
Ajay Chander             Re: SAS_TO_SPARK_SQL_(Could be a Bug?) Sat, 11 Jun, 12:57
Mohit Jaggi               Re: SAS_TO_SPARK_SQL_(Could be a Bug?) Sun, 12 Jun, 10:37
Ajay Chander                 SAS_TO_SPARK_SQL_(Could be a Bug?) Mon, 13 Jun, 16:45
Deepak Sharma                   Re: SAS_TO_SPARK_SQL_(Could be a Bug?) Mon, 13 Jun, 17:52
john.simon Long Running Spark Streaming getting slower Fri, 10 Jun, 17:21
Mich Talebzadeh   Re: Long Running Spark Streaming getting slower Fri, 10 Jun, 17:31
John Simon     Re: Long Running Spark Streaming getting slower Fri, 10 Jun, 17:48
Mich Talebzadeh       Re: Long Running Spark Streaming getting slower Fri, 10 Jun, 18:13
John Simon         Re: Long Running Spark Streaming getting slower Fri, 10 Jun, 18:46
John Simon           Re: Long Running Spark Streaming getting slower Fri, 10 Jun, 18:53
Mich Talebzadeh             Re: Long Running Spark Streaming getting slower Fri, 10 Jun, 19:45
John Simon               Re: Long Running Spark Streaming getting slower Fri, 10 Jun, 20:45
Mich Talebzadeh                 Re: Long Running Spark Streaming getting slower Fri, 10 Jun, 21:43
John Simon                   Re: Long Running Spark Streaming getting slower Fri, 10 Jun, 22:49
Mich Talebzadeh                     Re: Long Running Spark Streaming getting slower Sat, 11 Jun, 06:55
John Simon                       Re: Long Running Spark Streaming getting slower Mon, 13 Jun, 22:54
Mich Talebzadeh                         Re: Long Running Spark Streaming getting slower Tue, 14 Jun, 05:45
David Newberger                           RE: Long Running Spark Streaming getting slower Wed, 15 Jun, 15:31
Ewan Leith                             RE: Long Running Spark Streaming getting slower Wed, 15 Jun, 21:22
Cesar Flores Cleaning spark memory Fri, 10 Jun, 18:18
Takeshi Yamamuro   Re: Cleaning spark memory Sat, 11 Jun, 04:15
Ricky     回复:Cleaning spark memory Sat, 11 Jun, 04:17
Marco Mistroni Pls assist: Spark DecisionTree question Fri, 10 Jun, 18:39
Mohammad Tariq DataFrame.foreach(scala.Function1) example Fri, 10 Jun, 19:51
Matei Zaharia Updated Spark logo Fri, 10 Jun, 20:01
Marco1982 Neither previous window has value for key, nor new values found. Fri, 10 Jun, 20:19
N B   Re: Neither previous window has value for key, nor new values found. Thu, 16 Jun, 22:29
Jonathan Mortensen Slow collecting of large Spark Data Frames into R Sat, 11 Jun, 00:31
Sun Rui   Re: Slow collecting of large Spark Data Frames into R Sun, 12 Jun, 02:44
Neither previous window has value for key, nor new values found
Marco Platania   Neither previous window has value for key, nor new values found Sat, 11 Jun, 00:34
Chaturvedi Chola Big Data Interview Sat, 11 Jun, 06:54
Deepak Goel Book for Machine Learning (MLIB and other libraries on Spark) Sat, 11 Jun, 15:04
Ted Yu   Re: Book for Machine Learning (MLIB and other libraries on Spark) Sat, 11 Jun, 15:10
Mich Talebzadeh     Re: Book for Machine Learning (MLIB and other libraries on Spark) Sat, 11 Jun, 15:47
Ted Yu       Re: Book for Machine Learning (MLIB and other libraries on Spark) Sat, 11 Jun, 18:00
Mich Talebzadeh         Re: Book for Machine Learning (MLIB and other libraries on Spark) Sat, 11 Jun, 19:01
mylistt...@gmail.com           Re: Book for Machine Learning (MLIB and other libraries on Spark) Sun, 12 Jun, 10:09
Deepak Goel             Re: Book for Machine Learning (MLIB and other libraries on Spark) Sun, 12 Jun, 11:57
Chris Fregly               Re: Book for Machine Learning (MLIB and other libraries on Spark) Sun, 12 Jun, 17:00
Running Spark in Standalone or local modes
Ashok Kumar   Running Spark in Standalone or local modes Sat, 11 Jun, 18:08
Mohammad Tariq     Re: Running Spark in Standalone or local modes Sat, 11 Jun, 18:39
Ashok Kumar       Re: Running Spark in Standalone or local modes Sat, 11 Jun, 19:40
Gavin Yue         Re: Running Spark in Standalone or local modes Sat, 11 Jun, 21:26
Mich Talebzadeh           Re: Running Spark in Standalone or local modes Sat, 11 Jun, 21:35
Gavin Yue             Re: Running Spark in Standalone or local modes Sat, 11 Jun, 21:38
Mich Talebzadeh               Re: Running Spark in Standalone or local modes Sat, 11 Jun, 22:32
Ashok Kumar             Re: Running Spark in Standalone or local modes Sun, 12 Jun, 15:48
Marco Mistroni Accuracy of BinaryClassificationMetrics Sat, 11 Jun, 20:08
Haopu Wang Should I avoid "state" in an Spark application? Sun, 12 Jun, 08:40
Haopu Wang   RE: Should I avoid "state" in an Spark application? Mon, 13 Jun, 01:11
Alonso Isidoro Roman     Re: Should I avoid "state" in an Spark application? Mon, 13 Jun, 08:08
Hayri Volkan Agun How to use a model generated early in a stage in ML pipelines Sun, 12 Jun, 09:02
XapaJIaMnu Several questions about how pyspark.ml works Sun, 12 Jun, 10:08
sharad82 OutOfMemoryError - When saving Word2Vec Sun, 12 Jun, 10:08
vaquar khan   Re: OutOfMemoryError - When saving Word2Vec Sun, 12 Jun, 15:45
sharad82   Re: OutOfMemoryError - When saving Word2Vec Mon, 13 Jun, 12:04
Yuhao Yang     Re: OutOfMemoryError - When saving Word2Vec Tue, 14 Jun, 03:10
Re: Questions about Spark Worker
Mich Talebzadeh   Re: Questions about Spark Worker Sun, 12 Jun, 13:27
vaquar khan     Re: Questions about Spark Worker Sun, 12 Jun, 16:11
Mich Talebzadeh What is the interpretation of Cores in Spark doc Sun, 12 Jun, 19:23
Daniel Darabos   Re: What is the interpretation of Cores in Spark doc Sun, 12 Jun, 22:57
Mich Talebzadeh     Re: What is the interpretation of Cores in Spark doc Mon, 13 Jun, 07:02
Mark Hamstra       Re: What is the interpretation of Cores in Spark doc Mon, 13 Jun, 17:17
Mich Talebzadeh         Re: What is the interpretation of Cores in Spark doc Wed, 15 Jun, 22:08
Robin East           Re: What is the interpretation of Cores in Spark doc Thu, 16 Jun, 12:02
Mich Talebzadeh             Re: What is the interpretation of Cores in Spark doc Thu, 16 Jun, 14:45
Deepak Goel               Re: What is the interpretation of Cores in Spark doc Thu, 16 Jun, 16:09
Mark Hamstra               Re: What is the interpretation of Cores in Spark doc Thu, 16 Jun, 17:54
Mark Hamstra               Re: What is the interpretation of Cores in Spark doc Thu, 16 Jun, 18:07
Mich Talebzadeh                 Re: What is the interpretation of Cores in Spark doc Thu, 16 Jun, 18:33
Mark Hamstra                   Re: What is the interpretation of Cores in Spark doc Thu, 16 Jun, 18:42
Robin East               Re: What is the interpretation of Cores in Spark doc Fri, 17 Jun, 11:01
Mich Talebzadeh                 Re: What is the interpretation of Cores in Spark doc Fri, 17 Jun, 15:10
pooja mehta Spark Thrift Server in CDH 5.3 Mon, 13 Jun, 04:51
Michael Armbrust   Re: Spark Thrift Server in CDH 5.3 Mon, 13 Jun, 18:56
Roshan Singh Spark Kafka stream processing time increasing gradually Mon, 13 Jun, 06:19
N B   Re: Spark Kafka stream processing time increasing gradually Thu, 16 Jun, 22:13
Roshan Singh     Re: Spark Kafka stream processing time increasing gradually Fri, 17 Jun, 03:12
N B       Re: Spark Kafka stream processing time increasing gradually Mon, 20 Jun, 07:32
Roshan Singh         Re: Spark Kafka stream processing time increasing gradually Thu, 23 Jun, 04:56
Zakaria Hili Dataframe : Column features must be of type org.apache.spark.mllib.linalg.VectorUDT Mon, 13 Jun, 07:55
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · Next »Thread · Author · Date
Box list
Sep 202178
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137