spark-user mailing list archives: September 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · Next »Thread · Author · Date
Atul Kulkarni Re: Spark based Kafka Producer Sat, 12 Sep, 00:26
Ted Yu Re: countApproxDistinctByKey in python Sat, 12 Sep, 01:19
Alexis Gillain Re: Multilabel classification support Sat, 12 Sep, 02:10
liam Implement "LIKE" in SparkSQL Sat, 12 Sep, 02:26
Rachana Srivastava Multithreaded vs Spark Executor Sat, 12 Sep, 03:07
Richard Eggert Re: Implement "LIKE" in SparkSQL Sat, 12 Sep, 05:49
Richard Eggert Re: Multithreaded vs Spark Executor Sat, 12 Sep, 06:00
Angel Angel change the spark version Sat, 12 Sep, 06:16
ashensw Spark K means number of Iterations? Sat, 12 Sep, 07:26
Jörn Franke Re: SIGTERM 15 Issue : Spark Streaming for ingesting huge text files using custom Receiver Sat, 12 Sep, 07:32
Robineast Re: Spark K means number of Iterations? Sat, 12 Sep, 07:46
Sean Owen Re: change the spark version Sat, 12 Sep, 08:14
周千昊 Re: about mr-style merge sort Sat, 12 Sep, 08:46
liam Re: Implement "LIKE" in SparkSQL Sat, 12 Sep, 09:45
Luca Re: Help with collect() in Spark Streaming Sat, 12 Sep, 09:51
unk1102 How to create broadcast variable from Java String array? Sat, 12 Sep, 09:55
Rory Waite RE: Training the MultilayerPerceptronClassifier Sat, 12 Sep, 11:58
unk1102 How do debug YARN client OOM issue? Sat, 12 Sep, 13:19
Cazen Lee [Question] ORC - EMRFS Problem Sat, 12 Sep, 15:15
Cazen Lee [Question] ORC - EMRFS Problem Sat, 12 Sep, 15:44
ashensw Re: Spark K means number of Iterations? Sat, 12 Sep, 15:57
Priya Ch Spark Streaming..Exception Sat, 12 Sep, 17:34
Rex X What is the best way to migrate existing scikit-learn code to PySpark? Sat, 12 Sep, 18:17
jussipekkap UDAF and UDT with SparkSQL 1.5.0 Sat, 12 Sep, 18:19
Jörn Franke Re: What is the best way to migrate existing scikit-learn code to PySpark? Sat, 12 Sep, 19:00
Nick Pentreath Re: What is the best way to migrate existing scikit-learn code to PySpark? Sat, 12 Sep, 19:05
unk1102 Why my Spark job is slow and it throws OOM which leads YARN killing executors? Sat, 12 Sep, 19:52
Richard W. Eggert II Re: Why my Spark job is slow and it throws OOM which leads YARN killing executors? Sat, 12 Sep, 20:39
Rex X Re: What is the best way to migrate existing scikit-learn code to PySpark? Sat, 12 Sep, 20:52
Umesh Kacha Re: Why my Spark job is slow and it throws OOM which leads YARN killing executors? Sat, 12 Sep, 20:54
Utkarsh Sengar RDD transformation and action running out of memory Sat, 12 Sep, 21:18
Richard Eggert Re: RDD transformation and action running out of memory Sat, 12 Sep, 22:15
Cazen [Question] ORC - EMRFS Problem Sat, 12 Sep, 22:54
Jagat Singh Re: Spark 1.5.0 java.lang.OutOfMemoryError: PermGen space Sun, 13 Sep, 00:48
Jagat Singh Re: Spark 1.5.0 java.lang.OutOfMemoryError: PermGen space Sun, 13 Sep, 00:50
Hemminger Jeff What happens when cache is full? Sun, 13 Sep, 03:14
Matthew Denny Cogrouping data in dataframes - PairRDD cogroup vs. join - best practices Sun, 13 Sep, 04:32
Philip Weaver Limiting number of cores per job in multi-threaded driver. Sun, 13 Sep, 05:40
Owen O'Malley Re: [Question] ORC - EMRFS Problem Sun, 13 Sep, 06:00
Cazen Re: [Question] ORC - EMRFS Problem Sun, 13 Sep, 07:46
Cazen Lee Re: [Question] ORC - EMRFS Problem Sun, 13 Sep, 07:53
Tathagata Das Re: Data lost in spark streaming Sun, 13 Sep, 08:05
Ophir Cohen Stopping SparkContext and HiveContext Sun, 13 Sep, 08:48
Mailinglisten Re: What happens when cache is full? Sun, 13 Sep, 08:49
Nick Pentreath Re: What is the best way to migrate existing scikit-learn code to PySpark? Sun, 13 Sep, 09:13
unk1102 How to Hive UDF in Spark DataFrame? Sun, 13 Sep, 09:37
jussipekkap Re: UDAF and UDT with SparkSQL 1.5.0 Sun, 13 Sep, 09:44
Evert Lammerts Re: selecting columns with the same name in a join Sun, 13 Sep, 10:01
Bin Wang Re: Data lost in spark streaming Sun, 13 Sep, 10:28
Steve Loughran Re: change the spark version Sun, 13 Sep, 11:41
Ted Yu Re: Data lost in spark streaming Sun, 13 Sep, 16:27
Ted Yu Re: Stopping SparkContext and HiveContext Sun, 13 Sep, 16:49
sonal sharma Parquet partitioning performance issue Sun, 13 Sep, 17:54
Dean Wampler Re: Parquet partitioning performance issue Sun, 13 Sep, 18:29
Utkarsh Sengar Re: RDD transformation and action running out of memory Sun, 13 Sep, 20:19
hbogert Re: CREATE TABLE ignores database when using PARQUET option Sun, 13 Sep, 20:50
unk1102 Best way to merge final output part files created by Spark job Sun, 13 Sep, 21:25
Ted Yu Re: Stopping SparkContext and HiveContext Sun, 13 Sep, 21:43
Otis Gospodnetić Replacing Esper with Spark Streaming? Sun, 13 Sep, 23:49
Zoran Jeremic Re: Problem to persist Hibernate entity from Spark job Mon, 14 Sep, 00:58
guoqing0...@yahoo.com.hk Re: Re: java.util.NoSuchElementException: key not found Mon, 14 Sep, 01:39
Todd Re:Re: RE: Re:Re:RE: Re:RE: spark 1.5 SQL slows down dramatically by 50%+ compared with spark 1.4.1 SQL Mon, 14 Sep, 02:07
Feynman Liang Re: Training the MultilayerPerceptronClassifier Mon, 14 Sep, 03:15
vivek bhaskar Re: Is there any Spark SQL reference manual? Mon, 14 Sep, 06:44
Bin Wang How to clear Kafka offset in Spark streaming? Mon, 14 Sep, 06:46
bg_spark Interacting with Different Versions of Hive Metastore, how to config? Mon, 14 Sep, 07:01
Gaspar Muñoz Re: Best way to merge final output part files created by Spark job Mon, 14 Sep, 07:10
Marko Asplund Re: MLlib LDA implementation questions Mon, 14 Sep, 07:46
Bin Wang Re: How to clear Kafka offset in Spark streaming? Mon, 14 Sep, 08:04
Priya Ch Re: Spark Streaming..Exception Mon, 14 Sep, 08:58
petranidis DAG Scheduler deadlock when two RDDs reference each other, force Stages manually? Mon, 14 Sep, 09:42
Sean Owen Re: DAG Scheduler deadlock when two RDDs reference each other, force Stages manually? Mon, 14 Sep, 09:45
defstat Spark Streaming Topology Mon, 14 Sep, 09:52
Petros Nyfantis Re: DAG Scheduler deadlock when two RDDs reference each other, force Stages manually? Mon, 14 Sep, 10:13
Akhil Das Re: Problems with Local Checkpoints Mon, 14 Sep, 10:46
Bryan RE: Problems with Local Checkpoints Mon, 14 Sep, 10:58
Akhil Das Re: SparkR - Support for Other Models Mon, 14 Sep, 11:07
Jorge Sánchez Re: Implement "LIKE" in SparkSQL Mon, 14 Sep, 11:12
Akhil Das Re: Spark task hangs infinitely when accessing S3 Mon, 14 Sep, 11:12
Akhil Das Re: connecting to remote spark and reading files on HDFS or s3 in sparkR Mon, 14 Sep, 11:15
Akhil Das Re: java.lang.NullPointerException with Twitter API Mon, 14 Sep, 11:18
defstat Spark Streaming Topology Mon, 14 Sep, 11:19
Akhil Das Re: Spark Streaming..Exception Mon, 14 Sep, 11:30
Todd Nist Re: Replacing Esper with Spark Streaming? Mon, 14 Sep, 12:31
周千昊 application failed on large dataset Mon, 14 Sep, 13:07
Renu Yadav Fwd: Spark job failed Mon, 14 Sep, 13:09
Sadaf Twitter Streming using Twitter Public Streaming API and Apache Spark Mon, 14 Sep, 13:24
Adrian Bridgett hdfs-ha on mesos - odd bug Mon, 14 Sep, 13:55
Ted Yu Re: Spark job failed Mon, 14 Sep, 14:01
defstat Mailing List - This post has NOT been accepted by the mailing list yet. Mon, 14 Sep, 14:07
Vajra L Approach validation - building merged datasets - Spark SQL Mon, 14 Sep, 15:33
Saif.A.Ell...@wellsfargo.com Where can I learn how to write udf? Mon, 14 Sep, 16:39
Silvio Fiorito Re: Where can I learn how to write udf? Mon, 14 Sep, 16:54
Rachana Srivastava JavaRDD using Reflection Mon, 14 Sep, 16:54
Vipul Rai Creating fat jar with all resources.(Spark-Java-Maven) Mon, 14 Sep, 16:55
vipulrai Creating fat jar with all resources.(Spark-Java-Maven) Mon, 14 Sep, 17:04
Dmitry Goldenberg A way to timeout and terminate a laggard 'Stage' ? Mon, 14 Sep, 17:10
Ankur Srivastava Re: JavaRDD using Reflection Mon, 14 Sep, 17:21
matthes Parse tab seperated file inc json efficent Mon, 14 Sep, 17:56
Philip Weaver Trouble using dynamic allocation and shuffle service. Mon, 14 Sep, 18:36
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · Next »Thread · Author · Date
Box list
Jun 2021148
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137