spark-user mailing list archives: March 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
jinhong lu ml package data types Fri, 10 Mar, 03:24
Re: Case class with POJO - encoder issues
geoHeil   Re: Case class with POJO - encoder issues Fri, 10 Mar, 08:09
Mars Xu How can an RDD make its every elements to a new RDD ? Fri, 10 Mar, 09:57
Re: How to gracefully handle Kafka OffsetOutOfRangeException
Ramkumar Venkataraman   Re: How to gracefully handle Kafka OffsetOutOfRangeException Fri, 10 Mar, 10:21
Michael Armbrust   Re: How to gracefully handle Kafka OffsetOutOfRangeException Fri, 10 Mar, 15:34
Justin Miller     Re: How to gracefully handle Kafka OffsetOutOfRangeException Fri, 10 Mar, 15:46
Michael Armbrust       Re: How to gracefully handle Kafka OffsetOutOfRangeException Fri, 10 Mar, 20:14
Justin Miller         Re: How to gracefully handle Kafka OffsetOutOfRangeException Fri, 10 Mar, 20:16
Ramkumar Venkataraman [Spark Streaming][Spark SQL] Design suggestions needed for sessionization Fri, 10 Mar, 10:44
Re: can spark take advantage of ordered data?
sourabh chaki   Re: can spark take advantage of ordered data? Fri, 10 Mar, 14:03
Koert Kuipers     Re: can spark take advantage of ordered data? Fri, 10 Mar, 14:45
Jonathan Coveney       Re: can spark take advantage of ordered data? Fri, 10 Mar, 15:42
Yong Zhang   Re: can spark take advantage of ordered data? Fri, 10 Mar, 15:45
shyla deshpande spark streaming with kafka source, how many concurrent jobs? Fri, 10 Mar, 18:02
Tathagata Das   Re: spark streaming with kafka source, how many concurrent jobs? Sat, 11 Mar, 02:24
shyla deshpande     Re: spark streaming with kafka source, how many concurrent jobs? Tue, 14 Mar, 21:29
Tathagata Das       Re: spark streaming with kafka source, how many concurrent jobs? Tue, 14 Mar, 23:37
shyla deshpande         Re: spark streaming with kafka source, how many concurrent jobs? Tue, 21 Mar, 17:33
Parsian, Mahmoud How to improve performance of saveAsTextFile() Sat, 11 Mar, 06:33
颜发才(Yan Facai)   Re: How to improve performance of saveAsTextFile() Sat, 11 Mar, 11:53
萝卜丝炒饭 Re: java.io.NotSerializableException: org.apache.spark.streaming.StreamingContext Sat, 11 Mar, 08:10
Lysiane Bouchard   Re: java.io.NotSerializableException: org.apache.spark.streaming.StreamingContext Sun, 12 Mar, 16:01
Re: Pyspark 2.1.0 weird behavior with repartition
Olivier Girardot   Re: Pyspark 2.1.0 weird behavior with repartition Sat, 11 Mar, 22:35
李斌松 Spark thriff server hiveStatement.getQueryLog return empty Sun, 12 Mar, 14:37
Frank Astier Differences between scikit-learn and Spark.ml for regression toy problem Mon, 13 Mar, 02:20
Dhanesh Padmanabhan   Re: Differences between scikit-learn and Spark.ml for regression toy problem Mon, 13 Mar, 12:01
Dhanesh Padmanabhan     Re: Differences between scikit-learn and Spark.ml for regression toy problem Mon, 13 Mar, 14:37
Dhanesh Padmanabhan       Re: Differences between scikit-learn and Spark.ml for regression toy problem Mon, 13 Mar, 15:08
sathyanarayanan mudhaliyar spark-streaming stopping Mon, 13 Mar, 04:31
churly lin The speed of Spark streaming reading data from kafka stays low Mon, 13 Mar, 07:20
Lysiane Bouchard   Re: The speed of Spark streaming reading data from kafka stays low Mon, 13 Mar, 13:38
jinhong lu how to construct parameter for model.transform() from datafile Mon, 13 Mar, 08:31
jinhong lu   Re: how to construct parameter for model.transform() from datafile Mon, 13 Mar, 11:38
jinhong lu     Re: how to construct parameter for model.transform() from datafile Mon, 13 Mar, 11:59
Yuhao Yang       Re: how to construct parameter for model.transform() from datafile Wed, 15 Mar, 01:05
Sam Elamin Spark and continuous integration Mon, 13 Mar, 09:55
Jörn Franke   Re: Spark and continuous integration Mon, 13 Mar, 13:18
Sam Elamin     Re: Spark and continuous integration Mon, 13 Mar, 13:24
Steve Loughran       Re: Spark and continuous integration Tue, 14 Mar, 11:44
Jörn Franke         Re: Spark and continuous integration Tue, 14 Mar, 11:56
Sam Elamin           Re: Spark and continuous integration Tue, 14 Mar, 12:42
nancy henry keep or remove sc.stop() coz of RpcEnv already stopped error Mon, 13 Mar, 11:08
Yong Zhang   Re: keep or remove sc.stop() coz of RpcEnv already stopped error Mon, 13 Mar, 13:31
Alex     Re: keep or remove sc.stop() coz of RpcEnv already stopped error Mon, 13 Mar, 14:53
AssafMendelson Adding metrics to spark datasource Mon, 13 Mar, 12:59
Kristoffer Sjögren Sorted partition ranges without overlap Mon, 13 Mar, 13:34
Yong Zhang   Re: Sorted partition ranges without overlap Mon, 13 Mar, 15:00
Sourav Mazumder Monitoring ongoing Spark Job when run in Yarn Cluster mode Mon, 13 Mar, 13:53
Nirav Patel   Re: Monitoring ongoing Spark Job when run in Yarn Cluster mode Tue, 14 Mar, 00:14
Marcelo Vanzin   Re: Monitoring ongoing Spark Job when run in Yarn Cluster mode Tue, 14 Mar, 00:22
Olivier Girardot Graphframes PageRank ends up on 1 partition Mon, 13 Mar, 18:15
Gaurav1809 Structured Streaming - Can I start using it? Mon, 13 Mar, 18:21
Michael Armbrust   Re: Structured Streaming - Can I start using it? Mon, 13 Mar, 19:45
Ofir Manor     Re: Structured Streaming - Can I start using it? Tue, 14 Mar, 07:35
Gaurav Pandya       Re: Structured Streaming - Can I start using it? Tue, 14 Mar, 08:19
Adline Dsilva   Re: Structured Streaming - Can I start using it? Tue, 14 Mar, 10:26
Mina Aslani Java.lang.IllegalArgumentException: requirement failed: Can only call getServletHandlers on a running MetricsSystem Mon, 13 Mar, 21:45
Mina Aslani Java Examples @ Spark github Mon, 13 Mar, 21:55
matd Online learning of LDA model in Spark (update an existing model) Mon, 13 Mar, 22:47
Nirav Patel DataFrameWriter - Where to find list of Options applicable to particular format(datasource) Tue, 14 Mar, 00:20
Hyukjin Kwon   Re: DataFrameWriter - Where to find list of Options applicable to particular format(datasource) Tue, 14 Mar, 02:23
Nirav Patel     Re: DataFrameWriter - Where to find list of Options applicable to particular format(datasource) Tue, 14 Mar, 14:03
Re: [SparkSQL] too many open files although ulimit set to 1048576
darin   Re: [SparkSQL] too many open files although ulimit set to 1048576 Tue, 14 Mar, 02:44
Julian Keppel [MLlib] kmeans random initialization, same seed every time Tue, 14 Mar, 12:44
Julian Keppel   Re: [MLlib] kmeans random initialization, same seed every time Tue, 14 Mar, 12:46
Yuhao Yang     Re: [MLlib] kmeans random initialization, same seed every time Wed, 15 Mar, 06:42
David Leifker [MLlib] Multiple estimators for cross validation Tue, 14 Mar, 13:07
Mohammad Kargar OffsetOutOfRangeException Tue, 14 Mar, 19:58
kpeng1 Setting Optimal Number of Spark Executor Instances Tue, 14 Mar, 22:30
mohini kalamkar   Re: Setting Optimal Number of Spark Executor Instances Tue, 14 Mar, 22:37
Kevin Peng     Re: Setting Optimal Number of Spark Executor Instances Wed, 15 Mar, 17:35
Yong Zhang       Re: Setting Optimal Number of Spark Executor Instances Thu, 16 Mar, 01:53
Rohit Karlupia         Re: Setting Optimal Number of Spark Executor Instances Thu, 16 Mar, 05:26
Pranav Shukla Scaling Kafka Direct Streming application Wed, 15 Mar, 00:47
vincent gromakowski   Re: Scaling Kafka Direct Streming application Wed, 15 Mar, 07:49
muthu Fast write datastore... Wed, 15 Mar, 06:04
vincent gromakowski   Re: Fast write datastore... Wed, 15 Mar, 07:44
Richard Siebeling     Re: Fast write datastore... Wed, 15 Mar, 11:53
Muthu Jayakumar       Re: Fast write datastore... Wed, 15 Mar, 14:28
Shiva Ramagopal         Re: Fast write datastore... Wed, 15 Mar, 14:50
Muthu Jayakumar           Re: Fast write datastore... Wed, 15 Mar, 18:02
Vova Shelgunov             Re: Fast write datastore... Wed, 15 Mar, 18:20
jasbir.s...@accenture.com               RE: Fast write datastore... Thu, 16 Mar, 04:52
vvshvv                 Re:RE: Fast write datastore... Thu, 16 Mar, 06:17
Shiva Ramagopal                   Re:RE: Fast write datastore... Thu, 16 Mar, 06:57
Rick Moritz                     Re: RE: Fast write datastore... Thu, 16 Mar, 09:37
yohann jardin                       RE: RE: Fast write datastore... Thu, 16 Mar, 09:43
Mal Edwin                         RE: RE: Fast write datastore... Thu, 16 Mar, 11:18
Sudhir Menon                         Re: RE: Fast write datastore... Thu, 16 Mar, 13:01
Shiva Ramagopal             Re: Fast write datastore... Thu, 16 Mar, 02:25
Muthu Jayakumar               Re: Fast write datastore... Thu, 16 Mar, 03:14
Koert Kuipers   Re: Fast write datastore... Thu, 16 Mar, 02:24
anup ahire apply UDFs to N columns dynamically in dataframe Wed, 15 Mar, 06:04
Hongdi Ren   Re: apply UDFs to N columns dynamically in dataframe Wed, 15 Mar, 07:09
Yong Zhang   Re: apply UDFs to N columns dynamically in dataframe Thu, 16 Mar, 02:09
Spark SQL Skip and Log bad records
Aviral Agarwal   Spark SQL Skip and Log bad records Wed, 15 Mar, 07:01
Saurav Sinha Setting spark.yarn.stagingDir in 1.6 Wed, 15 Mar, 10:36
Vikash Pareek   Re: Setting spark.yarn.stagingDir in 1.6 Wed, 15 Mar, 15:12
Sebastian Piu Thrift Server as JDBC endpoint Wed, 15 Mar, 12:37
Nathan Case [Spark CSV]: Use Custom TextInputFormat to Prevent Exceptions Wed, 15 Mar, 15:56
Jörn Franke   Re: [Spark CSV]: Use Custom TextInputFormat to Prevent Exceptions Wed, 15 Mar, 17:11
Hyukjin Kwon     Re: [Spark CSV]: Use Custom TextInputFormat to Prevent Exceptions Thu, 16 Mar, 05:53
lk_spark how to call recommend method from ml.recommendation.ALS Thu, 16 Mar, 01:32
任弘迪   Re: how to call recommend method from ml.recommendation.ALS Thu, 16 Mar, 02:46
lk_spark     Re: Re: how to call recommend method from ml.recommendation.ALS Thu, 16 Mar, 04:39
Yuhao Yang       Re: Re: how to call recommend method from ml.recommendation.ALS Thu, 16 Mar, 05:05
lk_spark         Re: Re: Re: how to call recommend method from ml.recommendation.ALS Thu, 16 Mar, 05:27
OUASSAIDI, Sami [Spark Streaming+Kafka][How-to] Thu, 16 Mar, 12:16
Cody Koeninger   Re: [Spark Streaming+Kafka][How-to] Thu, 16 Mar, 15:10
Michael Armbrust     Re: [Spark Streaming+Kafka][How-to] Thu, 16 Mar, 18:52
Michael Armbrust       Re: [Spark Streaming+Kafka][How-to] Fri, 17 Mar, 08:14
OUASSAIDI, Sami         Re: [Spark Streaming+Kafka][How-to] Fri, 17 Mar, 14:35
Michael Armbrust           Re: [Spark Streaming+Kafka][How-to] Fri, 17 Mar, 19:03
OUASSAIDI, Sami             Re: [Spark Streaming+Kafka][How-to] Wed, 22 Mar, 00:35
Cody Koeninger               Re: [Spark Streaming+Kafka][How-to] Wed, 22 Mar, 14:48
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
Box list
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137