spark-user mailing list archives: April 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5Thread · Author · Date
Devender Yadav How to maintain order of key-value in DataFrame same as JSON? Mon, 24 Apr, 12:45
Hemanth Gudela   Re: How to maintain order of key-value in DataFrame same as JSON? Mon, 24 Apr, 13:07
Devender Yadav   Re: How to maintain order of key-value in DataFrame same as JSON? Mon, 24 Apr, 13:19
Afshin, Bardia   Re: How to maintain order of key-value in DataFrame same as JSON? Mon, 24 Apr, 15:53
Selvam Raman how to create List<String> in pyspark Mon, 24 Apr, 16:27
Yanbo Liang   Re: how to create List<String> in pyspark Thu, 27 Apr, 14:34
Felix Cheung   Re: how to create List<String> in pyspark Fri, 28 Apr, 18:22
Afshin, Bardia removing columns from file Mon, 24 Apr, 16:48
Anubhav Agarwal   Re: removing columns from file Fri, 28 Apr, 15:10
Afshin, Bardia community feedback on RedShift with Spark Mon, 24 Apr, 17:07
Matt Deaver   Re: community feedback on RedShift with Spark Mon, 24 Apr, 17:30
Aakash Basu   Re: community feedback on RedShift with Spark Mon, 24 Apr, 17:42
Devender Yadav Arraylist is empty after JavaRDD<String>.foreach Mon, 24 Apr, 17:36
Jörn Franke   Re: Arraylist is empty after JavaRDD<String>.foreach Mon, 24 Apr, 17:45
Devender Yadav   Re: Arraylist is empty after JavaRDD<String>.foreach Mon, 24 Apr, 17:47
Michael Armbrust   Re: Arraylist is empty after JavaRDD<String>.foreach Mon, 24 Apr, 19:06
Devender Yadav How to convert DataFrame to JSON String in Java 7 Mon, 24 Apr, 17:44
Lavelle, Shawn Spark-SQL Query Optimization: overlapping ranges Mon, 24 Apr, 22:46
Jacek Laskowski   Re: Spark-SQL Query Optimization: overlapping ranges Wed, 26 Apr, 07:54
Lavelle, Shawn     RE: Spark-SQL Query Optimization: overlapping ranges Thu, 27 Apr, 13:22
Jacek Laskowski       Re: Spark-SQL Query Optimization: overlapping ranges Thu, 27 Apr, 13:38
Zeming Yu udf that handles null values Tue, 25 Apr, 00:22
cy h   Re: udf that handles null values Tue, 25 Apr, 01:03
Pushkar.Gujar   Re: udf that handles null values Tue, 25 Apr, 01:29
Zeming Yu     Re: udf that handles null values Tue, 25 Apr, 02:04
Zeming Yu pyspark vector Tue, 25 Apr, 00:36
Peyman Mohajerian   Re: pyspark vector Tue, 25 Apr, 02:06
Nick Pentreath     Re: pyspark vector Tue, 25 Apr, 09:29
Zeming Yu one hot encode a column of vector Tue, 25 Apr, 01:31
颜发才(Yan Facai)   Re: one hot encode a column of vector Tue, 25 Apr, 05:36
Zeming Yu how to find the nearest holiday Tue, 25 Apr, 07:39
Wen Pei Yu   Re: how to find the nearest holiday Tue, 25 Apr, 08:00
Zeming Yu     Re: how to find the nearest holiday Tue, 25 Apr, 12:20
Zeming Yu       Re: how to find the nearest holiday Tue, 25 Apr, 12:50
Pushkar.Gujar         Re: how to find the nearest holiday Tue, 25 Apr, 12:59
Zeming Yu           Re: how to find the nearest holiday Tue, 25 Apr, 13:20
vincent gromakowski spark streaming resiliency Tue, 25 Apr, 13:14
Dominik Safaric Spark Streaming 2.1 Kafka consumer - retrieving offset commits for each poll Tue, 25 Apr, 19:43
Cody Koeninger   Re: Spark Streaming 2.1 Kafka consumer - retrieving offset commits for each poll Wed, 26 Apr, 17:26
Dominik Safaric     Re: Spark Streaming 2.1 Kafka consumer - retrieving offset commits for each poll Wed, 26 Apr, 18:17
Cody Koeninger       Re: Spark Streaming 2.1 Kafka consumer - retrieving offset commits for each poll Wed, 26 Apr, 19:42
Dominik Safaric         Re: Spark Streaming 2.1 Kafka consumer - retrieving offset commits for each poll Thu, 27 Apr, 16:33
Cody Koeninger           Re: Spark Streaming 2.1 Kafka consumer - retrieving offset commits for each poll Thu, 27 Apr, 18:11
Dominik Safaric             Re: Spark Streaming 2.1 Kafka consumer - retrieving offset commits for each poll Thu, 27 Apr, 18:27
Cody Koeninger               Re: Spark Streaming 2.1 Kafka consumer - retrieving offset commits for each poll Thu, 27 Apr, 22:19
Afshin, Bardia weird error message Tue, 25 Apr, 23:57
Jacek Laskowski   Re: weird error message Wed, 26 Apr, 07:51
Afshin, Bardia     Re: weird error message Wed, 26 Apr, 16:47
Afshin, Bardia       Re: weird error message Wed, 26 Apr, 18:10
Jacek Laskowski         Re: weird error message Wed, 26 Apr, 20:26
Tim Hunter [ann] Release of TensorFrames 0.2.8 Wed, 26 Apr, 00:24
vaibhavrtk WrappedArray to row of relational Db Wed, 26 Apr, 06:29
Devender Yadav Create dataframe from RDBMS table using JDBC Wed, 26 Apr, 07:26
Subhash Sriram   Re: Create dataframe from RDBMS table using JDBC Wed, 26 Apr, 13:16
Rich Bowen Last chance: ApacheCon is just three weeks away Wed, 26 Apr, 13:46
Everett Anderson Calculate mode separately for multiple columns in row Wed, 26 Apr, 17:21
Everett Anderson   Re: Calculate mode separately for multiple columns in row Thu, 27 Apr, 16:40
Lanny Ripple stand-alone deployMode=cluster problems Wed, 26 Apr, 18:54
anna stax help/suggestions to setup spark cluster Wed, 26 Apr, 21:02
Sam Elamin   Re: help/suggestions to setup spark cluster Wed, 26 Apr, 21:22
anna stax     Re: help/suggestions to setup spark cluster Wed, 26 Apr, 21:53
Cody Koeninger       Re: help/suggestions to setup spark cluster Thu, 27 Apr, 02:46
anna stax         Re: help/suggestions to setup spark cluster Thu, 27 Apr, 03:28
vincent gromakowski           Re: help/suggestions to setup spark cluster Thu, 27 Apr, 06:07
Cody Koeninger             Re: help/suggestions to setup spark cluster Thu, 27 Apr, 15:04
kant kodali How to create SparkSession using SparkConf? Wed, 26 Apr, 22:22
kant kodali   Re: How to create SparkSession using SparkConf? Thu, 27 Apr, 01:21
Yanbo Liang     Re: How to create SparkSession using SparkConf? Thu, 27 Apr, 15:01
kant kodali       Re: How to create SparkSession using SparkConf? Thu, 27 Apr, 15:47
kant kodali         Re: How to create SparkSession using SparkConf? Thu, 27 Apr, 16:12
Yanbo Liang           Re: How to create SparkSession using SparkConf? Fri, 28 Apr, 06:10
madhu phatak             Re: How to create SparkSession using SparkConf? Fri, 28 Apr, 07:52
Jules Damji 10th Spark Summit 2017 at Moscone Center Thu, 27 Apr, 00:49
v.chesnokov [Spark Core] Why SetAccumulator is buried in org.apache.spark.sql.execution.debug? Thu, 27 Apr, 10:14
Synonym handling replacement issue with UDF in Apache Spark
Nishanth   Synonym handling replacement issue with UDF in Apache Spark Thu, 27 Apr, 13:58
Yanbo Liang     Re: Synonym handling replacement issue with UDF in Apache Spark Thu, 27 Apr, 14:46
Nishanth   Synonym handling replacement issue with UDF in Apache Spark Fri, 28 Apr, 06:13
Manohar753 javaRDD to collectasMap throuwa ava.lang.NegativeArraySizeException Thu, 27 Apr, 14:31
KhajaAsmath Mohammed Data Skew in Dataframe Groupby - Any suggestions? Thu, 27 Apr, 15:27
Sebastian Nagel [Pyspark, Python 2.7] Executor hangup caused by Unicode error while logging uncaught exception in worker Thu, 27 Apr, 16:03
Tim Smith Initialize Gaussian Mixture Model using Spark ML dataframe API Thu, 27 Apr, 17:46
Yuan Fang Why "Initial job has not accepted any resources"? Thu, 27 Apr, 21:51
Yuan Fang   Re: Why "Initial job has not accepted any resources"? Thu, 27 Apr, 21:53
Gaurav1809 Has anyone used CoreNLP from stanford for sentiment analysis in Spark? It does not work as desired for me. Fri, 28 Apr, 08:05
Alonso Isidoro Roman   Re: Has anyone used CoreNLP from stanford for sentiment analysis in Spark? It does not work as desired for me. Fri, 28 Apr, 10:24
U..@Moosheimer.com     Re: Has anyone used CoreNLP from stanford for sentiment analysis in Spark? It does not work as desired for me. Fri, 28 Apr, 11:40
rok "java.lang.IllegalStateException: There is no space for new record" in GraphFrames Fri, 28 Apr, 08:42
Felix Cheung   Re: "java.lang.IllegalStateException: There is no space for new record" in GraphFrames Fri, 28 Apr, 18:25
Shashi Vishwakarma Securing Spark Job on Cluster Fri, 28 Apr, 12:45
veera satya nv Dantuluri   Re: Securing Spark Job on Cluster Fri, 28 Apr, 14:24
Shashi Vishwakarma     Re: Securing Spark Job on Cluster Fri, 28 Apr, 14:31
Jörn Franke   Re: Securing Spark Job on Cluster Fri, 28 Apr, 14:54
Shashi Vishwakarma     Re: Securing Spark Job on Cluster Fri, 28 Apr, 14:57
Jörn Franke       Re: Securing Spark Job on Cluster Fri, 28 Apr, 15:34
Shashi Vishwakarma         Re: Securing Spark Job on Cluster Fri, 28 Apr, 15:51
Mark Hamstra           Re: Securing Spark Job on Cluster Fri, 28 Apr, 16:30
David Rosenstrauch Exactly-once semantics with kakfa CanCommitOffsets.commitAsync? Fri, 28 Apr, 15:29
Cody Koeninger   Re: Exactly-once semantics with kakfa CanCommitOffsets.commitAsync? Fri, 28 Apr, 15:34
David Rosenstrauch     Re: Exactly-once semantics with kakfa CanCommitOffsets.commitAsync? Fri, 28 Apr, 15:47
Cody Koeninger       Re: Exactly-once semantics with kakfa CanCommitOffsets.commitAsync? Fri, 28 Apr, 16:26
David Rosenstrauch Spark user list seems to be rejecting/ignoring my emails from other subscribed address Fri, 28 Apr, 15:33
Yuan Fang Could any one please tell me why this takes forever to finish? Fri, 28 Apr, 22:35
Muthu Jayakumar Spark repartition question... Sun, 30 Apr, 07:07
Zeming Yu parquet optimal file structure - flat vs nested Sun, 30 Apr, 08:19
Jörn Franke   Re: parquet optimal file structure - flat vs nested Sun, 30 Apr, 08:34
Zeming Yu     Re: parquet optimal file structure - flat vs nested Sun, 30 Apr, 08:45
Zeming Yu       Re: parquet optimal file structure - flat vs nested Sun, 30 Apr, 21:08
Jörn Franke         Re: parquet optimal file structure - flat vs nested Sun, 30 Apr, 21:45
Jörn Franke         Re: parquet optimal file structure - flat vs nested Sun, 30 Apr, 21:46
rakesh sharma Recommended cluster parameters Sun, 30 Apr, 08:26
yohann jardin   Re: Recommended cluster parameters Sun, 30 Apr, 08:57
Zeming Yu     Re: Recommended cluster parameters Sun, 30 Apr, 10:32
Zeming Yu examples of dealing with nested parquet/ dataframe file Sun, 30 Apr, 13:08
Message list« Previous · 1 · 2 · 3 · 4 · 5Thread · Author · Date
Box list
Oct 2020212
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137