spark-user mailing list archives: November 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Michael Armbrust Re: Does Data pipeline using kafka and structured streaming work? Wed, 02 Nov, 01:29
Michael Armbrust Re: error: Unable to find encoder for type stored in a Dataset. when trying to map through a DataFrame Wed, 02 Nov, 17:59
Michael Armbrust Re: How to return a case class in map function? Wed, 02 Nov, 18:01
Michael Armbrust Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 20:10
Michael Armbrust Re: incomplete aggregation in a GROUP BY Thu, 03 Nov, 20:11
Michael Armbrust Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 00:59
Michael Armbrust Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 04:59
Michael Armbrust Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Fri, 04 Nov, 18:39
Michael Armbrust Re: NoSuchElementException Mon, 07 Nov, 16:27
Michael Armbrust Re: Upgrading to Spark 2.0.1 broke array<string> in parquet DataFrame Mon, 07 Nov, 16:28
Michael Armbrust Re: Aggregations on every column on dataframe causing StackOverflowError Wed, 09 Nov, 20:08
Michael Armbrust Re: Aggregations on every column on dataframe causing StackOverflowError Wed, 09 Nov, 21:30
Michael Armbrust Re: type-safe join in the new DataSet API? Thu, 10 Nov, 19:18
Michael Armbrust Re: How do I convert json_encoded_blob_column into a data frame? (This may be a feature request) Wed, 16 Nov, 18:50
Michael Armbrust Re: Create a Column expression from a String Tue, 22 Nov, 00:56
Michael Armbrust Re: Spark 2.0.2, Structured Streaming with kafka source... Unable to parse the value to Object.. Tue, 22 Nov, 01:00
Michael Armbrust Re: Stateful aggregations with Structured Streaming Tue, 22 Nov, 01:10
Michael Armbrust Re: How do I flatten JSON blobs into a Data Frame using Spark/Spark SQL Tue, 22 Nov, 01:12
Michael Armbrust Re: How do I persist the data after I process the data with Structured streaming... Tue, 22 Nov, 22:40
Michael Armbrust Re: How do I persist the data after I process the data with Structured streaming... Tue, 22 Nov, 22:40
Michael Armbrust Re: How do I flatten JSON blobs into a Data Frame using Spark/Spark SQL Tue, 22 Nov, 22:42
Michael Armbrust Re: Any equivalent method lateral and explore Tue, 22 Nov, 22:58
Michael Armbrust Re: How do I flatten JSON blobs into a Data Frame using Spark/Spark SQL Tue, 29 Nov, 02:12
Michael David Pedersen Re: Efficient filtering on Spark SQL dataframes with ordered keys Tue, 01 Nov, 10:01
Michael David Pedersen Re: Efficient filtering on Spark SQL dataframes with ordered keys Tue, 01 Nov, 10:50
Michael David Pedersen Re: Efficient filtering on Spark SQL dataframes with ordered keys Wed, 02 Nov, 17:42
Michael Gummelt Re: sanboxing spark executors Fri, 04 Nov, 23:36
Michael Gummelt Re: Two questions about running spark on mesos Mon, 14 Nov, 18:40
Michael Gummelt Re: two spark-shells spark on mesos not working Tue, 22 Nov, 17:02
Michael Johnson Very long pause/hang at end of execution Sun, 06 Nov, 13:28
Michael Johnson Re: Very long pause/hang at end of execution Sun, 06 Nov, 14:19
Michael Johnson Re: Very long pause/hang at end of execution Mon, 07 Nov, 03:46
Michael Johnson Re: Very long pause/hang at end of execution Wed, 16 Nov, 02:04
Michael Johnson Re: Very long pause/hang at end of execution Thu, 17 Nov, 05:10
Michael Johnson Controlling data placement / locality Tue, 29 Nov, 22:47
Michael Segel Quirk in how Spark DF handles JSON input records? Wed, 02 Nov, 18:50
Michael Segel Re: Quirk in how Spark DF handles JSON input records? Wed, 02 Nov, 18:58
Michael Segel Re: Quirk in how Spark DF handles JSON input records? Wed, 02 Nov, 19:39
Michael Segel Re: Quirk in how Spark DF handles JSON input records? Thu, 03 Nov, 15:29
Michael Segel How sensitive is Spark to Swap? Mon, 07 Nov, 17:28
Michael Segel Re: Spark Streaming backpressure weird behavior/bug Mon, 07 Nov, 17:34
Michael Segel Re: sanboxing spark executors Tue, 08 Nov, 16:30
Michael Segel Re: Save a spark RDD to disk Wed, 09 Nov, 17:29
Michael Segel Re: importing data into hdfs/spark using Informatica ETL tool Wed, 09 Nov, 23:25
Miguel Morales Re: updateStateByKey -- when the key is multi-column (like a composite key ) Wed, 30 Nov, 20:33
Mo Tao Re: Cannot find Native Library in "cluster" deploy-mode Tue, 15 Nov, 05:26
Mo Tao Re: use case reading files split per id Tue, 15 Nov, 05:43
Mohamed Nadjib Mami SparkSQL: intra-SparkSQL-application table registration Mon, 14 Nov, 10:03
Mohammad Tariq Correct SparkLauncher usage Mon, 07 Nov, 23:29
Mohammad Tariq Re: Correct SparkLauncher usage Mon, 07 Nov, 23:42
Mohammad Tariq Re: Correct SparkLauncher usage Thu, 10 Nov, 22:43
Mohammad Tariq Re: Correct SparkLauncher usage Thu, 10 Nov, 22:57
Mohammad Tariq Re: Correct SparkLauncher usage Thu, 10 Nov, 23:00
Mohammad Tariq Re: Correct SparkLauncher usage Thu, 10 Nov, 23:07
Mohammad Tariq Re: Need guidelines in Spark Streaming and Kafka integration Wed, 16 Nov, 19:12
Mohit Durgapal Re: newbie question about RDD Tue, 22 Nov, 08:10
Mohit Durgapal getting error on spark streaming : java.lang.OutOfMemoryError: unable to create new native thread Tue, 22 Nov, 21:42
Mohit Jaggi Re: LinearRegressionWithSGD and Rank Features By Importance Thu, 03 Nov, 20:41
Mohit Jaggi SparkILoop doesn't run Wed, 16 Nov, 22:47
Mohit Jaggi Re: SparkILoop doesn't run Thu, 17 Nov, 19:16
Mohit Jaggi Re: SparkILoop doesn't run Mon, 28 Nov, 17:17
Mudit Kumar Spark Streaming backpressure weird behavior/bug Mon, 07 Nov, 09:41
Mudit Kumar Spark with Ranger Mon, 07 Nov, 15:23
Mudit Kumar RE: Possible DR solution Fri, 11 Nov, 16:43
Mukesh Jha Spark driver not reusing HConnection Fri, 18 Nov, 22:37
Mukesh Jha Re: Spark driver not reusing HConnection Mon, 21 Nov, 04:29
Mukesh Jha Re: Spark driver not reusing HConnection Wed, 23 Nov, 20:55
Mukesh Jha Re: Spark driver not reusing HConnection Wed, 23 Nov, 20:58
Muthu Jayakumar Re: DataFrame select non-existing column Sat, 19 Nov, 06:16
Nathan Lande Re: How do I convert json_encoded_blob_column into a data frame? (This may be a feature request) Thu, 17 Nov, 04:41
Nathan Lande Re: Long-running job OOMs driver process Fri, 18 Nov, 15:08
Nicholas Chammas Re: Strongly Connected Components Sun, 13 Nov, 16:26
Nicholas Sharkey Finding a Spark Equivalent for Pandas' get_dummies Fri, 11 Nov, 18:27
Nicholas Sharkey Re: Finding a Spark Equivalent for Pandas' get_dummies Fri, 11 Nov, 21:21
Nicholas Sharkey Re: Spark ML : One hot Encoding for multiple columns Mon, 14 Nov, 01:00
Nick Pentreath Re: Finding a Spark Equivalent for Pandas' get_dummies Fri, 11 Nov, 19:00
Nick Pentreath Re: Nearest neighbour search Mon, 14 Nov, 15:37
Nick Pentreath Re: scala.MatchError while doing BinaryClassificationMetrics Mon, 14 Nov, 18:44
Nick Pentreath Re: scala.MatchError while doing BinaryClassificationMetrics Mon, 14 Nov, 21:00
Nick Pentreath Re: how to print auc & prc for GBTClassifier, which is okay for RandomForestClassifier Mon, 28 Nov, 08:00
Ninad Shringarpure Unsubscribe Mon, 28 Nov, 15:12
Nirav Patel Is IDF model reusable Tue, 01 Nov, 10:10
Nirav Patel Spark ML - Is IDF model reusable Tue, 01 Nov, 10:15
Nirav Patel Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 11:18
Nirav Patel Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 11:54
Nirav Patel Spark ML - CrossValidation - How to get Evaluation metrics of best model Tue, 01 Nov, 12:10
Nirav Patel Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 18:48
Nirav Patel Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 23:04
Nirav Patel Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 23:29
Nirav Patel Re: Out Of Memory issue Wed, 02 Nov, 00:08
Nirav Patel Re: Spark ML - CrossValidation - How to get Evaluation metrics of best model Wed, 02 Nov, 17:59
Nirav Patel Spark ML - Is it rule of thumb that all Estimators should only be Fit on Training data Wed, 02 Nov, 18:05
Nirav Patel Spark ML - Naive Bayes - how to select Threshold values Mon, 07 Nov, 23:07
Nirav Patel spark ml - ngram - how to preserve single word (1-gram) Tue, 08 Nov, 22:41
Nirav Patel Spark SQL UDF - passing map as a UDF parameter Tue, 15 Nov, 00:33
Nirav Patel Re: Spark SQL UDF - passing map as a UDF parameter Tue, 15 Nov, 19:29
Noorul Islam K M Re: installing spark-jobserver on cdh 5.7 and yarn Wed, 09 Nov, 10:25
Oddo Da Re: A Spark long running program as web server Mon, 07 Nov, 00:17
Ofer Eliassaf Re: PySpark TaskContext Thu, 24 Nov, 10:03
Ofer Eliassaf Re: PySpark TaskContext Thu, 24 Nov, 11:15
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Box list
Oct 201993
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137