spark-user mailing list archives: March 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Behroz Sikander Re: [Worker Crashing] OutOfMemoryError: GC overhead limit execeeded Fri, 24 Mar, 13:15
Behroz Sikander Re: [Worker Crashing] OutOfMemoryError: GC overhead limit execeeded Fri, 24 Mar, 13:29
Bill Schwanitz question on transforms for spark 2.0 dataset Wed, 01 Mar, 16:21
Bill Schwanitz Re: question on transforms for spark 2.0 dataset Wed, 01 Mar, 18:28
Bill Schwanitz Re: spark streaming exectors memory increasing and executor killed by yarn Sat, 18 Mar, 17:08
Bill Schwanitz spark kafka consumer with kerberos Thu, 30 Mar, 17:58
Bill Schwanitz spark 2 and kafka consumer with ssl/kerberos Thu, 30 Mar, 19:24
Bill Schwanitz Re: spark kafka consumer with kerberos Fri, 31 Mar, 14:28
Bowden, Chris Structured Streaming - Kafka Tue, 07 Mar, 21:52
Bowden, Chris Re: Structured Streaming - Kafka Tue, 07 Mar, 22:18
Burak Yavuz Re: Spark 2.0.2 Dataset union() slowness vs RDD union? Fri, 17 Mar, 00:20
Charles O. Bajomo [Spark] Accumulators or count() Wed, 01 Mar, 12:26
Charles O. Bajomo [Spark Streamiing] Streaming job failing consistently after 1h Mon, 06 Mar, 02:37
Chetan Khatri Issues: Generate JSON with null values in Spark 2.0.x Tue, 07 Mar, 20:58
Chetan Khatri Re: Issues: Generate JSON with null values in Spark 2.0.x Mon, 20 Mar, 07:44
Cody Koeninger Re: [Spark Streaming+Kafka][How-to] Thu, 16 Mar, 15:10
Cody Koeninger Re: Streaming 2.1.0 - window vs. batch duration Fri, 17 Mar, 15:57
Cody Koeninger Re: Spark Streaming from Kafka, deal with initial heavy load. Mon, 20 Mar, 15:00
Cody Koeninger Re: [Spark Streaming+Kafka][How-to] Wed, 22 Mar, 14:48
Cody Koeninger Re: Spark streaming to kafka exactly once Wed, 22 Mar, 20:34
Craig Ching calculate diff of value and median in a group Wed, 22 Mar, 19:17
Craig Ching Re: calculate diff of value and median in a group Wed, 22 Mar, 22:58
Daniel Siegmann Re: [Spark] Accumulators or count() Wed, 01 Mar, 15:30
David Leifker [MLlib] Multiple estimators for cross validation Tue, 14 Mar, 13:07
Deepak Sharma Re: Check if dataframe is empty Tue, 07 Mar, 05:42
Deepak Sharma Re: Check if dataframe is empty Tue, 07 Mar, 09:19
Deepu Raj Re: How to load "kafka" as a data source Fri, 24 Mar, 03:49
Denny Lee Support Stored By Clause Mon, 27 Mar, 23:45
Devender Yadav How to insert nano seconds in the TimestampType in Spark Mon, 27 Mar, 12:29
Devender Yadav Partitioning in spark while reading from RDBMS via JDBC Fri, 31 Mar, 22:51
Dhanesh Padmanabhan Re: Differences between scikit-learn and Spark.ml for regression toy problem Mon, 13 Mar, 12:01
Dhanesh Padmanabhan Re: Differences between scikit-learn and Spark.ml for regression toy problem Mon, 13 Mar, 14:37
Dhanesh Padmanabhan Re: Differences between scikit-learn and Spark.ml for regression toy problem Mon, 13 Mar, 15:08
Dhanesh Padmanabhan Re: how to retain part of the features in LogisticRegressionModel (spark2.0) Sun, 19 Mar, 11:08
Dhanesh Padmanabhan Re: how to retain part of the features in LogisticRegressionModel (spark2.0) Sun, 19 Mar, 12:02
Dibyendu Bhattacharya Re: question on Write Ahead Log (Spark Streaming ) Sat, 11 Mar, 06:51
Didac Gil Re: kafka and spark integration Wed, 22 Mar, 11:27
Diego Fanesi worker connected to standalone cluster are continuously crashing Tue, 21 Mar, 02:55
Diego Fanesi Re: Having issues reading a csv file into a DataSet using Spark 2.1 Thu, 23 Mar, 01:43
Diego Fanesi Re: Having issues reading a csv file into a DataSet using Spark 2.1 Thu, 23 Mar, 02:09
Divya Gehlot Spark job stopping abrubptly Wed, 08 Mar, 01:47
Diwakar Dhanuskodi Foreachpartition in spark streaming Mon, 20 Mar, 06:20
Dominik Safaric Spark Streaming - java.lang.ClassNotFoundException Scala anonymous function Wed, 01 Mar, 13:19
Dominik Safaric Re: Spark Streaming - java.lang.ClassNotFoundException Scala anonymous function Wed, 01 Mar, 14:01
Dominik Safaric Streaming 2.1.0 - window vs. batch duration Thu, 16 Mar, 19:34
Dominik Safaric Re: Streaming 2.1.0 - window vs. batch duration Sat, 18 Mar, 08:35
Dominik Safaric Re: Streaming 2.1.0 - window vs. batch duration Sat, 18 Mar, 09:34
Dongjin Lee Re: Issues: Generate JSON with null values in Spark 2.0.x Sat, 11 Mar, 08:05
Dongjin Lee Re: Issues: Generate JSON with null values in Spark 2.0.x Tue, 21 Mar, 08:11
El-Hassan Wanas Spark JDBC reads Tue, 07 Mar, 11:04
El-Hassan Wanas Re: Spark JDBC reads Tue, 07 Mar, 11:37
El-Hassan Wanas Re: Spark JDBC reads Tue, 07 Mar, 18:41
Eli Super Re: FPGrowth Model is taking too long to generate frequent item sets Mon, 06 Mar, 11:29
Eli Super Re: FPGrowth Model is taking too long to generate frequent item sets Tue, 07 Mar, 08:30
Everett Anderson Best way to assign a unique IDs to row groups Wed, 01 Mar, 21:50
Everett Anderson Spark 2.0.2 Dataset union() slowness vs RDD union? Thu, 16 Mar, 21:55
Everett Anderson Re: Spark 2.0.2 Dataset union() slowness vs RDD union? Thu, 16 Mar, 23:14
Everett Anderson Re: Spark 2.0.2 Dataset union() slowness vs RDD union? Fri, 17 Mar, 01:03
Everett Anderson Re: Spark 2.0.2 Dataset union() slowness vs RDD union? Mon, 20 Mar, 17:18
Eyal Zituny Re: [Spark SQL & Core]: RDD to Dataset 1500 columns data with createDataFrame() throw exception of grows beyond 64 KB Sun, 19 Mar, 11:46
Frank Astier Differences between scikit-learn and Spark.ml for regression toy problem Mon, 13 Mar, 02:20
Gaurav Pandya Re: Which streaming platform is best? Kafka or Spark Streaming? Sat, 11 Mar, 18:31
Gaurav Pandya Re: Structured Streaming - Can I start using it? Tue, 14 Mar, 08:19
Gaurav Pandya Re: How best we can store streaming data on dashboards for real time user experience? Thu, 30 Mar, 05:14
Gaurav1809 Server Log Processing - Regex or ElasticSearch? Fri, 03 Mar, 08:27
Gaurav1809 Which streaming platform is best? Kafka or Spark Streaming? Thu, 09 Mar, 19:37
Gaurav1809 Structured Streaming - Can I start using it? Mon, 13 Mar, 18:21
Gaurav1809 How to load "kafka" as a data source Fri, 24 Mar, 03:47
Gaurav1809 Utilities for Twitter Analysis? Tue, 28 Mar, 07:50
Gaurav1809 How best we can store streaming data on dashboards for real time user experience? Thu, 30 Mar, 05:01
Georg Heiler Re: Spark dataframe, UserDefinedAggregateFunction(UDAF) help!! Fri, 24 Mar, 06:23
George Obama CSV empty columns handling in Spark 2.0.2 Thu, 16 Mar, 18:28
George Obama Getting 2.0.2 for the link http://d3kbcqa49mib13.cloudfront.net/spark-2.1.0-bin-hadoop2.7.tgz Fri, 17 Mar, 16:55
George Obama Returning DataFrame for text file Wed, 29 Mar, 18:58
Gourav Sengupta Re: Huge partitioning job takes longer to close after all tasks finished Thu, 09 Mar, 08:38
Gourav Sengupta Re: Best way to deal with skewed partition sizes Thu, 23 Mar, 09:20
Gourav Sengupta Re: Best way to deal with skewed partition sizes Thu, 23 Mar, 09:21
Gourav Sengupta Re: Multiple cores/executors in Pyspark standalone mode Tue, 28 Mar, 22:35
Hamza HACHANI problem reading binary source with apache streaming when using JavaStreaminContext.binaryRecordsStream() Tue, 28 Mar, 09:25
Han-Cheol Cho strange usage of tempfile.mkdtemp() in PySpark mllib.recommendation doctest Thu, 02 Mar, 08:30
Hanumath Rao Maduri Predicate not getting pusdhown to PrunedFilterScan Thu, 30 Mar, 23:30
Hanumath Rao Maduri Predicate not getting pusdhown to PrunedFilterScan Fri, 31 Mar, 05:12
Hanumath Rao Maduri Predicate not getting pusdhown to PrunedFilterScan Fri, 31 Mar, 06:13
Hanumath Rao Maduri Re: How to PushDown ParquetFilter Spark 2.0.1 dataframe Fri, 31 Mar, 06:39
Hongdi Ren Re: apply UDFs to N columns dynamically in dataframe Wed, 15 Mar, 07:09
Howard Chen unsubscribe Sun, 05 Mar, 13:40
Hyukjin Kwon Re: DataFrameWriter - Where to find list of Options applicable to particular format(datasource) Tue, 14 Mar, 02:23
Hyukjin Kwon Re: [Spark CSV]: Use Custom TextInputFormat to Prevent Exceptions Thu, 16 Mar, 05:53
Hyukjin Kwon Re: CSV empty columns handling in Spark 2.0.2 Thu, 16 Mar, 20:27
Hyukjin Kwon Re: Why selectExpr changes schema (to include id column)? Mon, 27 Mar, 12:43
Hyukjin Kwon Re: Why selectExpr changes schema (to include id column)? Tue, 28 Mar, 00:07
Jacek Laskowski Why selectExpr changes schema (to include id column)? Mon, 27 Mar, 08:58
Jacek Laskowski Re: Why selectExpr changes schema (to include id column)? Mon, 27 Mar, 20:02
Jakub Dubovsky Number of partitions in Dataset aggregations Wed, 01 Mar, 09:28
Jean Georges Perrin Custom Spark data source in Java Wed, 22 Mar, 19:27
Jean Georges Perrin Re: Custom Spark data source in Java Wed, 22 Mar, 20:35
Jonathan Coveney Re: can spark take advantage of ordered data? Fri, 10 Mar, 15:42
Jonhy Stack (python) Spark .textFile(s3://…) access denied 403 with valid credentials Tue, 07 Mar, 15:21
Jonhy Stack Spark is inventing its own AWS secret key Wed, 08 Mar, 11:14
Joseph Bradley Re: LDA in Spark Fri, 24 Mar, 01:14
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Box list
Sep 202181
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137