spark-user mailing list archives: November 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Pankaj Wahane Re: Duplicate rows in windowing functions Wed, 02 Nov, 08:43
Pankaj Wahane Re: Duplicate rows in windowing functions Wed, 02 Nov, 09:12
Pat Blachly Porting LIBSVM models to Spark Tue, 29 Nov, 18:18
Pat Blachly Porting LIBSVM models to Spark Tue, 29 Nov, 18:19
Pedro Tuero Kryo Exception: NegativeArraySizeException Thu, 24 Nov, 21:24
Perttu Ranta-aho UDF with column value comparison fails with PySpark Thu, 10 Nov, 19:14
Perttu Ranta-aho Re: UDF with column value comparison fails with PySpark Thu, 10 Nov, 19:47
Perttu Ranta-aho Nested UDFs Thu, 17 Nov, 07:14
Perttu Ranta-aho Re: Nested UDFs Thu, 17 Nov, 11:49
Phillip Henry Re: org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 0 Fri, 18 Nov, 08:20
Pietro Pugni Re: Very long pause/hang at end of execution Wed, 16 Nov, 09:40
Prasanna Santhanam Spark ignoring partition names without equals (=) separator Mon, 28 Nov, 04:18
Prasanna Santhanam Re: Spark ignoring partition names without equals (=) separator Tue, 29 Nov, 05:19
Praseetha HiveContext.getOrCreate not accessible Tue, 15 Nov, 07:17
Prashant Sharma Re: If we run sc.textfile(path,xxx) many times, will the elements be the same in each partition Thu, 10 Nov, 14:20
Prithish AVRO File size when caching in-memory Mon, 14 Nov, 09:05
Prithish Re: AVRO File size when caching in-memory Tue, 15 Nov, 05:15
Prithish Re: AVRO File size when caching in-memory Wed, 16 Nov, 04:44
Prithish Re: AVRO File size when caching in-memory Wed, 16 Nov, 08:26
Prithish Re: AVRO File size when caching in-memory Wed, 16 Nov, 08:47
R. Revert Unsubscribe Mon, 28 Nov, 21:28
Rabin Banerjee Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 11:53
Rabin Banerjee Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 13:59
Rabin Banerjee Will spark cache table once even if I call read/cache on the same table multiple times Fri, 18 Nov, 15:36
Rabin Banerjee Re: sort descending with multiple columns Fri, 18 Nov, 15:40
Rabin Banerjee Re: How to load only the data of the last partition Fri, 18 Nov, 15:48
Rabin Banerjee Re: Will spark cache table once even if I call read/cache on the same table multiple times Fri, 18 Nov, 19:16
Raghav Re: Newbie question - Best way to bootstrap with Spark Mon, 07 Nov, 06:20
Raghav Re: Newbie question - Best way to bootstrap with Spark Mon, 07 Nov, 19:17
Raghav Kafka Producer within a docker Instance Fri, 11 Nov, 16:19
Raghav newbie question about RDD Tue, 22 Nov, 05:45
Raghav Re: newbie question about RDD Tue, 22 Nov, 05:47
Raviteja Lokineni Aggregations on every column on dataframe causing StackOverflowError Wed, 09 Nov, 15:48
Raviteja Lokineni Re: Aggregations on every column on dataframe causing StackOverflowError Wed, 09 Nov, 18:06
Raviteja Lokineni Re: Aggregations on every column on dataframe causing StackOverflowError Wed, 09 Nov, 21:22
Reth RM Clustering Webpages using KMean and Spark Apis : GC limit exceed. Fri, 04 Nov, 18:13
Reth RM Re: Clustering Webpages using KMean and Spark Apis : GC limit exceed. Fri, 04 Nov, 19:18
Reth RM Mapping KMean trained-data to respective records Wed, 23 Nov, 20:22
Reynold Xin [ANNOUNCE] Announcing Apache Spark 1.6.3 Tue, 08 Nov, 06:07
Reynold Xin [ANNOUNCE] Apache Spark 2.0.2 Tue, 15 Nov, 05:14
Reynold Xin Re: How do I convert json_encoded_blob_column into a data frame? (This may be a feature request) Thu, 17 Nov, 20:44
Reynold Xin Re: Re: Multiple streaming aggregations in structured streaming Mon, 21 Nov, 07:56
Reynold Xin Re: Re: Re: Multiple streaming aggregations in structured streaming Wed, 23 Nov, 02:52
Reynold Xin Re: Third party library Fri, 25 Nov, 23:32
Reynold Xin Re: Third party library Sat, 26 Nov, 19:23
Reynold Xin Re: Bit-wise AND operation between integers Tue, 29 Nov, 05:42
Reynold Xin Re: Can't read tables written in Spark 2.1 in Spark 2.0 (and earlier) Wed, 30 Nov, 19:07
Reza zade Fwd: A Spark long running program as web server Sun, 06 Nov, 13:06
Reza zade installing spark-jobserver on cdh 5.7 and yarn Wed, 09 Nov, 09:59
Reza zade problem deploying spark-jobserver on CentOS Wed, 16 Nov, 13:09
Rich Bowen Save the date: ApacheCon Miami, May 15-19, 2017 Wed, 30 Nov, 19:24
Rishikesh Teke Re: Newbie question - Best way to bootstrap with Spark Mon, 14 Nov, 16:13
Rishikesh Teke Re: took more time to get data from spark dataset to driver program Mon, 14 Nov, 16:27
Robin East Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 10:49
Robin East Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 11:24
Robin East Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 12:37
Robin East Re: Confusion SparkSQL DataFrame OrderBy followed by GroupBY Thu, 03 Nov, 15:09
Robin East Re: LinearRegressionWithSGD and Rank Features By Importance Fri, 04 Nov, 09:19
Robin East Re: LinearRegressionWithSGD and Rank Features By Importance Mon, 07 Nov, 16:20
Robineast Re: mLIb solving linear regression with sparse inputs Thu, 03 Nov, 18:07
Robineast Re: mLIb solving linear regression with sparse inputs Sun, 06 Nov, 11:35
Robineast Re: GraphX Connected Components Tue, 08 Nov, 20:06
Robineast Re: Does SparkR or SparkMLib support nonlinear optimization with non linear constraints Fri, 25 Nov, 11:05
Rodrick Brown Re: Out of memory at 60GB free memory. Mon, 07 Nov, 17:14
Rodrick Brown How to propagate R_LIBS to sparkr executors Wed, 16 Nov, 21:00
Rodrick Brown Re: OS killing Executor due to high (possibly off heap) memory usage Thu, 24 Nov, 18:54
Rohit Karlupia Re: spark sql jobs heap memory Thu, 24 Nov, 18:47
Rohit Kumar Prusty RE: Out Of Memory issue Wed, 02 Nov, 05:50
Rohit Verma Optimized way to use spark as db to hdfs etl Sat, 05 Nov, 14:39
Rohit Verma Spark dataset cache vs tempview Sun, 06 Nov, 03:44
Rohit Verma Spark master shows 0 cores for executors Mon, 07 Nov, 14:26
Rohit Verma Spark joins using row id Sat, 12 Nov, 11:11
Rohit Verma Re: Spark joins using row id Sat, 12 Nov, 13:54
Rohit Verma Spark hash function Mon, 14 Nov, 11:21
Rohit Verma Re: Problem submitting a spark job using yarn-client as master Wed, 16 Nov, 02:27
Rohit Verma Re: Joining to a large, pre-sorted file Wed, 16 Nov, 02:36
Rohit Verma Re: Map and MapParitions with partition-local variable Fri, 18 Nov, 03:30
Rohit Verma Is selecting different datasets from same parquet file blocking. Fri, 18 Nov, 04:21
Rostyslav Sotnychenko [No Subject] Thu, 24 Nov, 20:06
Russell Jurney Spark ML DataFrame API - need cosine similarity, how to convert to RDD Vectors? Tue, 15 Nov, 18:06
Russell Jurney Re: Spark ML DataFrame API - need cosine similarity, how to convert to RDD Vectors? Wed, 16 Nov, 17:26
Russell Spitzer Re: How to use Spark SQL to connect to Cassandra from Spark-Shell? Fri, 11 Nov, 17:09
Sabarish Sasidharan Re: Optimized way to use spark as db to hdfs etl Sun, 06 Nov, 16:25
Saif.A.Ell...@wellsfargo.com Cluster deploy mode driver location Mon, 21 Nov, 19:04
Saisai Shao Re: dataframe data visualization Mon, 21 Nov, 02:47
Saisai Shao Re: spark.yarn.executor.memoryOverhead Thu, 24 Nov, 00:43
Saliya Ekanayake GraphX updating vertex property Tue, 15 Nov, 17:24
Saliya Ekanayake Pregel Question Tue, 22 Nov, 20:08
Saliya Ekanayake Re: Pregel Question Wed, 23 Nov, 06:03
Sam Goodwin Upgrading to Spark 2.0.1 broke array<string> in parquet DataFrame Sat, 05 Nov, 00:11
SamPenrose pyspark: accept unicode column names in DataFrame.corr and cov Sat, 12 Nov, 00:36
Sameer Choudhary Fwd: Yarn resource utilization with Spark pipe() Sun, 20 Nov, 22:02
Sameer Choudhary Yarn resource utilization with Spark pipe() Thu, 24 Nov, 06:38
Sameer Choudhary Re: Yarn resource utilization with Spark pipe() Thu, 24 Nov, 21:27
Sameer Choudhary Re: Yarn resource utilization with Spark pipe() Thu, 24 Nov, 21:40
Samy Dindane How to impersonate a user from a Spark program Wed, 09 Nov, 15:20
Samy Dindane How to load only the data of the last partition Thu, 17 Nov, 19:05
Samy Dindane Re: How to load only the data of the last partition Fri, 18 Nov, 09:11
Samy Dindane How to write a custom file system? Mon, 21 Nov, 17:26
Samy Dindane Re: How to write a custom file system? Mon, 21 Nov, 19:13
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Box list
Oct 201958
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137