spark-user mailing list archives: March 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
anup ahire apply UDFs to N columns dynamically in dataframe Wed, 15 Mar, 06:04
ayan guha Re: Spark 2.0 issue with left_outer join Sat, 04 Mar, 20:09
ayan guha Re: Spark 2.0 issue with left_outer join Sun, 05 Mar, 05:55
ayan guha Re: [RDDs and Dataframes] Equivalent expressions for RDD API Sun, 05 Mar, 10:17
ayan guha Re: Spark Beginner: Correct approach for use case Mon, 06 Mar, 02:11
ayan guha Re: finding Spark Master Tue, 07 Mar, 23:58
ayan guha Re: Failed to connect to master ... Wed, 08 Mar, 05:38
ayan guha Re: spark-sql use case beginner question Thu, 09 Mar, 03:22
ayan guha Re: Local spark context on an executor Tue, 21 Mar, 22:37
ayan guha Re: Local spark context on an executor Wed, 22 Mar, 00:29
ayan guha Re: calculate diff of value and median in a group Wed, 22 Mar, 23:23
ayan guha Re: calculate diff of value and median in a group Thu, 23 Mar, 01:09
ayan guha Re: Need help for RDD/DF transformation. Thu, 30 Mar, 06:56
ayan guha Re: Spark SQL 2.1 Complex SQL - Query Planning Issue Fri, 31 Mar, 02:30
bilsch spark 2 and kafka consumer with ssl/kerberos Thu, 30 Mar, 19:53
bryan.jeff...@gmail.com Re: [RDDs and Dataframes] Equivalent expressions for RDD API Sat, 04 Mar, 16:02
bsikander [Worker Crashing] OutOfMemoryError: GC overhead limit execeeded Fri, 24 Mar, 09:48
chris snow Collaborative Filtering - scaling of the regularization parameter Thu, 23 Mar, 07:03
chris snow Re: Collaborative Filtering - scaling of the regularization parameter Thu, 23 Mar, 13:55
chris snow Collaborative filtering steps in spark Sun, 26 Mar, 22:48
chris snow Re: Collaborative filtering steps in spark Wed, 29 Mar, 19:29
cht liu Re: Huge partitioning job takes longer to close after all tasks finished Wed, 08 Mar, 03:47
cht liu Re: Contributing to Spark Tue, 21 Mar, 02:52
churly lin The speed of Spark streaming reading data from kafka stays low Mon, 13 Mar, 07:20
darin Re: [SparkSQL] too many open files although ulimit set to 1048576 Tue, 14 Mar, 02:44
darin spark streaming exectors memory increasing and executor killed by yarn Fri, 17 Mar, 01:59
darin Re: spark streaming exectors memory increasing and executor killed by yarn Sat, 18 Mar, 02:32
darin Re: spark streaming exectors memory increasing and executor killed by yarn Tue, 21 Mar, 01:26
devjyoti patra Re: How do I deal with ever growing application log Mon, 06 Mar, 05:22
elevy [Spark SQL & Core]: RDD to Dataset 1500 columns data with createDataFrame() throw exception of grows beyond 64 KB Sat, 18 Mar, 08:13
enzo Question on Spark's graph libraries Thu, 09 Mar, 17:42
ffarozan Spark master IP on Kubernetes Sat, 18 Mar, 04:30
geoHeil Re: Case class with POJO - encoder issues Fri, 10 Mar, 08:09
hosur narahari Re: dataframe filter, unable to bind variable Fri, 31 Mar, 03:37
jasbir.s...@accenture.com RE: Check if dataframe is empty Tue, 07 Mar, 04:03
jasbir.s...@accenture.com RE: Fast write datastore... Thu, 16 Mar, 04:52
jeremycod Can't transform RDD for the second time Wed, 01 Mar, 04:17
jinhong lu ml package data types Fri, 10 Mar, 03:24
jinhong lu how to construct parameter for model.transform() from datafile Mon, 13 Mar, 08:31
jinhong lu Re: how to construct parameter for model.transform() from datafile Mon, 13 Mar, 11:38
jinhong lu Re: how to construct parameter for model.transform() from datafile Mon, 13 Mar, 11:59
jinhong lu how to retain part of the features in LogisticRegressionModel (spark2.0) Sun, 19 Mar, 10:12
jinhong lu Re: how to retain part of the features in LogisticRegressionModel (spark2.0) Sun, 19 Mar, 10:59
jinhong lu Re: how to retain part of the features in LogisticRegressionModel (spark2.0) Sun, 19 Mar, 11:32
jjayadeep [PySpark] - Binary File Partition Thu, 23 Mar, 15:36
kaniska unable to stream kafka messages Fri, 24 Mar, 17:49
kaniska Mandal Re: unable to stream kafka messages Fri, 24 Mar, 23:58
kaniska Mandal Re: unable to stream kafka messages Mon, 27 Mar, 20:20
kaniska Mandal Re: unable to stream kafka messages Mon, 27 Mar, 20:59
kant kodali Re: [ANNOUNCE] Apache Bahir 2.1.0 Released Sun, 05 Mar, 21:15
kant kodali How to unit test spark streaming? Tue, 07 Mar, 12:04
kant kodali Re: How to unit test spark streaming? Tue, 07 Mar, 22:20
kant kodali question on Write Ahead Log (Spark Streaming ) Wed, 08 Mar, 16:58
kant kodali Spark Jobs filling up the disk at SPARK_LOCAL_DIRS location Thu, 09 Mar, 16:25
kant kodali What CI tool does Databricks use? Sun, 26 Mar, 12:08
kant kodali question on DStreams Tue, 28 Mar, 10:28
khwunchai jaengsawang Re: [RDDs and Dataframes] Equivalent expressions for RDD API Sun, 05 Mar, 08:10
kpeng1 Setting Optimal Number of Spark Executor Instances Tue, 14 Mar, 22:30
lewis john mcgibbney [ANNOUNCE] Apache Gora 0.7 Release Thu, 23 Mar, 19:49
lk_spark how to call recommend method from ml.recommendation.ALS Thu, 16 Mar, 01:32
lk_spark Re: Re: how to call recommend method from ml.recommendation.ALS Thu, 16 Mar, 04:39
lk_spark Re: Re: Re: how to call recommend method from ml.recommendation.ALS Thu, 16 Mar, 05:27
matd Online learning of LDA model in Spark (update an existing model) Mon, 13 Mar, 22:47
mohini kalamkar Re: Setting Optimal Number of Spark Executor Instances Tue, 14 Mar, 22:37
muthu Fast write datastore... Wed, 15 Mar, 06:04
nancy henry made spark job to throw exception still going under finished succeeded status in yarn Wed, 08 Mar, 02:25
nancy henry spark-sql use case beginner question Thu, 09 Mar, 03:06
nancy henry Re: spark-sql use case beginner question Thu, 09 Mar, 03:09
nancy henry Re: spark-sql use case beginner question Thu, 09 Mar, 07:28
nancy henry keep or remove sc.stop() coz of RpcEnv already stopped error Mon, 13 Mar, 11:08
nayan sharma Persist RDD doubt Thu, 23 Mar, 09:16
nayan sharma Re: Persist RDD doubt Thu, 23 Mar, 11:11
nayan sharma skipping header in multiple files Fri, 24 Mar, 06:39
nguyen duc Tuan Kafka failover with multiple data centers Mon, 06 Mar, 02:51
nguyen duc Tuan Re: Kafka failover with multiple data centers Tue, 28 Mar, 00:01
rok Re: PySpark Serialization/Deserialization (Pickling) Overhead Wed, 08 Mar, 08:16
sagarcasual . Spark Streaming from Kafka, deal with initial heavy load. Sat, 18 Mar, 04:53
santlal56 Mismatch in data type comparision results full data in Spark Thu, 23 Mar, 06:19
sathyanarayanan mudhaliyar [No Subject] Thu, 09 Mar, 03:00
sathyanarayanan mudhaliyar [No Subject] Thu, 09 Mar, 06:57
sathyanarayanan mudhaliyar [No Subject] Thu, 09 Mar, 12:49
sathyanarayanan mudhaliyar spark-streaming stopping Mon, 13 Mar, 04:31
shyla deshpande spark streaming with kafka source, how many concurrent jobs? Fri, 10 Mar, 18:02
shyla deshpande Re: spark streaming with kafka source, how many concurrent jobs? Tue, 14 Mar, 21:29
shyla deshpande Re: spark streaming with kafka source, how many concurrent jobs? Tue, 21 Mar, 17:33
shyla deshpande Spark Streaming questions, just 2 Tue, 21 Mar, 22:57
shyla deshpande Converting dataframe to dataset question Thu, 23 Mar, 01:07
shyla deshpande Re: Converting dataframe to dataset question Thu, 23 Mar, 19:49
shyla deshpande Re: Converting dataframe to dataset question Thu, 23 Mar, 20:29
shyla deshpande Re: Converting dataframe to dataset question Thu, 23 Mar, 21:23
shyla deshpande Spark dataframe, UserDefinedAggregateFunction(UDAF) help!! Fri, 24 Mar, 00:18
shyla deshpande Re: Spark dataframe, UserDefinedAggregateFunction(UDAF) help!! Fri, 24 Mar, 03:04
shyla deshpande Re: Converting dataframe to dataset question Fri, 24 Mar, 05:23
shyla deshpande dataframe join questions? Tue, 28 Mar, 21:57
shyla deshpande Re: dataframe join questions. Appreciate your input. Wed, 29 Mar, 06:47
shyla deshpande Re: Spark SQL, dataframe join questions. Wed, 29 Mar, 16:33
shyla deshpande Will the setting for spark.default.parallelism be used for spark.sql.shuffle.output.partitions? Thu, 30 Mar, 16:58
shyla deshpande Re: Will the setting for spark.default.parallelism be used for spark.sql.shuffle.output.partitions? Fri, 31 Mar, 02:09
shyla deshpande dataframe filter, unable to bind variable Fri, 31 Mar, 02:15
shyla deshpande Re: dataframe filter, unable to bind variable Fri, 31 Mar, 06:01
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Box list
Oct 202180
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137