spark-user mailing list archives: May 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
Mike Wheeler Schema Evolution for nested Dataset[T] Mon, 01 May, 04:12
Michael Armbrust   Re: Schema Evolution for nested Dataset[T] Mon, 01 May, 17:29
Michael Armbrust     Re: Schema Evolution for nested Dataset[T] Mon, 01 May, 17:31
Mike Wheeler       Re: Schema Evolution for nested Dataset[T] Tue, 02 May, 18:44
Michael Armbrust         Re: Schema Evolution for nested Dataset[T] Tue, 02 May, 19:29
Re: removing columns from file
Steve Loughran   Re: removing columns from file Mon, 01 May, 13:26
Saulo Ricci Reading table from sql database to apache spark dataframe/RDD Mon, 01 May, 14:50
vincent gromakowski   Re: Reading table from sql database to apache spark dataframe/RDD Mon, 01 May, 15:13
Re: Calculate mode separately for multiple columns in row
Everett Anderson   Re: Calculate mode separately for multiple columns in row Mon, 01 May, 16:47
Saulo Ricci Loading postgresql table to spark SyntaxError Mon, 01 May, 19:49
RE: Spark-SQL Query Optimization: overlapping ranges
Lavelle, Shawn   RE: Spark-SQL Query Optimization: overlapping ranges Mon, 01 May, 22:00
Re: RDD blocks on Spark Driver
Daniel Santana   Re: RDD blocks on Spark Driver Tue, 02 May, 00:33
Re: Initialize Gaussian Mixture Model using Spark ML dataframe API
Yanbo Liang   Re: Initialize Gaussian Mixture Model using Spark ML dataframe API Tue, 02 May, 04:01
Tim Smith     Re: Initialize Gaussian Mixture Model using Spark ML dataframe API Tue, 02 May, 18:48
Re: Could any one please tell me why this takes forever to finish?
颜发才(Yan Facai)   Re: Could any one please tell me why this takes forever to finish? Tue, 02 May, 05:34
TwUxTLi51Nus OutOfMemoryError Tue, 02 May, 07:07
Nan Zhu --jars does not take remote jar? Tue, 02 May, 15:43
Marcelo Vanzin   Re: --jars does not take remote jar? Tue, 02 May, 16:00
Nan Zhu     Re: --jars does not take remote jar? Tue, 02 May, 16:07
Marcelo Vanzin       Re: --jars does not take remote jar? Tue, 02 May, 16:12
Nan Zhu         Re: --jars does not take remote jar? Tue, 02 May, 16:14
kant kodali do we need to enable writeAheadLogs for DirectStream as well or is it only for indirect stream? Tue, 02 May, 16:32
Cody Koeninger   Re: do we need to enable writeAheadLogs for DirectStream as well or is it only for indirect stream? Tue, 02 May, 18:50
KhajaAsmath Mohammed Joins in Spark Tue, 02 May, 18:22
Angel Francisco Orta   Re: Joins in Spark Tue, 02 May, 18:27
KhajaAsmath Mohammed     Re: Joins in Spark Tue, 02 May, 18:29
Angel Francisco Orta       Re: Joins in Spark Tue, 02 May, 18:38
KhajaAsmath Mohammed         Re: Joins in Spark Tue, 02 May, 19:44
Angel Francisco Orta           Re: Joins in Spark Tue, 02 May, 19:59
Re: Driver spins hours in query plan optimization
Everett Anderson   Re: Driver spins hours in query plan optimization Tue, 02 May, 18:44
Nipun Arora [Spark Streaming] Dynamic Broadcast Variable Update Tue, 02 May, 18:56
Tim Smith   Re: [Spark Streaming] Dynamic Broadcast Variable Update Tue, 02 May, 19:14
Gene Pang   Re: [Spark Streaming] Dynamic Broadcast Variable Update Thu, 04 May, 16:18
Pierce Lamb     Re: [Spark Streaming] Dynamic Broadcast Variable Update Fri, 05 May, 17:04
Michael Armbrust [ANNOUNCE] Apache Spark 2.1.1 Tue, 02 May, 22:18
issues solution spark 1.6 .0 and gridsearchcv Wed, 03 May, 07:45
peay map/foreachRDD equivalent for pyspark Structured Streaming Wed, 03 May, 08:51
Tathagata Das   Re: map/foreachRDD equivalent for pyspark Structured Streaming Wed, 03 May, 10:05
peay     Re: map/foreachRDD equivalent for pyspark Structured Streaming Fri, 05 May, 06:36
pklemenkov Benchmark of XGBoost, Vowpal Wabbit and Spark ML on Criteo 1TB Dataset Wed, 03 May, 09:42
Miguel Figueiredo Redefining Spark native UDFs Wed, 03 May, 13:41
Re: parquet optimal file structure - flat vs nested
Steve Loughran   Re: parquet optimal file structure - flat vs nested Wed, 03 May, 13:55
JayeshLalwani Refreshing a persisted RDD Wed, 03 May, 14:30
Tathagata Das   Re: Refreshing a persisted RDD Wed, 03 May, 22:32
Lalwani, Jayesh     Re: Refreshing a persisted RDD Wed, 03 May, 23:13
Tathagata Das       Re: Refreshing a persisted RDD Wed, 03 May, 23:30
Sudhir Menon         Re: Refreshing a persisted RDD Fri, 19 May, 21:38
Sidney Feiner [Spark Streaming] - Killing application from within code Wed, 03 May, 15:44
Tathagata Das   Re: [Spark Streaming] - Killing application from within code Wed, 03 May, 19:25
Sidney Feiner     RE: [Spark Streaming] - Killing application from within code Thu, 04 May, 10:41
francis....@smartsheet.com Francis Lau has shared a document on Google Docs with you Wed, 03 May, 18:32
p..@occamsmachete.com Pat Ferrel has shared a document on Google Docs with you Wed, 03 May, 19:23
kant kodali What are Analysis Errors With respect to Spark Sql DataFrames and DataSets? Wed, 03 May, 20:38
Michael Armbrust   Re: What are Analysis Errors With respect to Spark Sql DataFrames and DataSets? Wed, 03 May, 21:25
kant kodali     Re: What are Analysis Errors With respect to Spark Sql DataFrames and DataSets? Wed, 03 May, 21:54
Michael Armbrust       Re: What are Analysis Errors With respect to Spark Sql DataFrames and DataSets? Wed, 03 May, 23:36
kant kodali         Re: What are Analysis Errors With respect to Spark Sql DataFrames and DataSets? Thu, 04 May, 07:34
Re: In-order processing using spark streaming
JayeshLalwani   Re: In-order processing using spark streaming Wed, 03 May, 22:18
Zeming Yu Spark books Wed, 03 May, 22:35
Tobi Bosede   Re: Spark books Wed, 03 May, 23:30
ayan guha     Re: Spark books Thu, 04 May, 00:07
Neelesh Salian       Re: Spark books Thu, 04 May, 00:16
Stephen Fletcher         Re: Spark books Thu, 04 May, 00:52
Jacek Laskowski           Re: Spark books Fri, 05 May, 17:25
Pushkar.Gujar         Re: Spark books Thu, 04 May, 01:33
Re: Spark-SQL collect function
JayeshLalwani   Re: Spark-SQL collect function Wed, 03 May, 22:37
Aakash Basu     Re: Spark-SQL collect function Fri, 19 May, 19:57
Re: Synonym handling replacement issue with UDF in Apache Spark
JayeshLalwani   Re: Synonym handling replacement issue with UDF in Apache Spark Wed, 03 May, 22:51
albertoandreotti   Re: Synonym handling replacement issue with UDF in Apache Spark Wed, 10 May, 17:39
Kun Liu What is the correct JSON parameter format used to to submit Spark2 apps with YARN REST API? Thu, 04 May, 00:17
Lohith Samaga M Spark 2.1.0 and Hive 2.1.1 Thu, 04 May, 05:04
Yanbo Liang [CFP] DataWorks Summit/Hadoop Summit Sydney - Call for abstracts Thu, 04 May, 05:15
Manohar753 any support to use Spark UDF in HIVE Thu, 04 May, 07:03
Re: Hive on Spark is not populating correct records
Vikash Pareek   Re: Hive on Spark is not populating correct records Thu, 04 May, 07:40
kant kodali unable to find how to integrate SparkSession with a Custom Receiver. Thu, 04 May, 07:43
Tathagata Das   Re: unable to find how to integrate SparkSession with a Custom Receiver. Thu, 04 May, 07:58
kant kodali     Re: unable to find how to integrate SparkSession with a Custom Receiver. Thu, 04 May, 14:31
issues solution Create multiple columns in pyspak with one shot Thu, 04 May, 07:55
Rick Moritz   Re: Create multiple columns in pyspak with one shot Thu, 04 May, 08:06
matd Kerberos impersonation of a Spark Context at runtime Thu, 04 May, 09:13
Saisai Shao   Re: Kerberos impersonation of a Spark Context at runtime Thu, 04 May, 13:01
Abel Rincón     Re: Kerberos impersonation of a Spark Context at runtime Thu, 04 May, 14:22
issues solution Normalize columns items for Onehotencoder Thu, 04 May, 12:29
scalastyle violation on mvn install but not on mvn package
yiskylee   scalastyle violation on mvn install but not on mvn package Thu, 04 May, 14:45
Mark Hamstra     Re: scalastyle violation on mvn install but not on mvn package Fri, 05 May, 00:11
Xiangyu Li       Re: scalastyle violation on mvn install but not on mvn package Tue, 23 May, 14:48
Mark Hamstra         Re: scalastyle violation on mvn install but not on mvn package Tue, 23 May, 15:19
Xiangyu Li           Re: scalastyle violation on mvn install but not on mvn package Wed, 24 May, 13:33
yiskylee   scalastyle violation on mvn install but not on mvn package Thu, 18 May, 00:47
Marcelo Vanzin     Re: scalastyle violation on mvn install but not on mvn package Thu, 18 May, 00:48
Xiangyu Li       Re: scalastyle violation on mvn install but not on mvn package Tue, 23 May, 14:45
Message list1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
Box list
Dec 201939
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137