spark-user mailing list archives: September 2015

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · Next »Thread · Author · Date
canan chen Re: Where is the doc about the spark rest api ? Tue, 01 Sep, 00:11
Suman Somasundar Connection closed error while running Terasort Tue, 01 Sep, 00:13
gtinside Group by specific key and save as parquet Tue, 01 Sep, 00:27
Brian Parker Re: [MLlib] DIMSUM row similarity? Tue, 01 Sep, 00:52
Timothy Sum Hon Mun Re: Spark Effects of Driver Memory, Executor Memory, Driver Memory Overhead and Executor Memory Overhead on success of job runs Tue, 01 Sep, 02:23
Eric Walker Re: bulk upload to Elasticsearch and shuffle behavior Tue, 01 Sep, 03:05
timothy22000 Re: Spark Effects of Driver Memory, Executor Memory, Driver Memory Overhead and Executor Memory Overhead on success of job runs Tue, 01 Sep, 03:10
Pranay Tonpay Re: spark-submit issue Tue, 01 Sep, 05:14
Madawa Soysa Submitted applications does not run. Tue, 01 Sep, 06:17
Jeff Zhang Re: Submitted applications does not run. Tue, 01 Sep, 06:35
Madawa Soysa Re: Submitted applications does not run. Tue, 01 Sep, 06:44
Jeff Zhang Re: Submitted applications does not run. Tue, 01 Sep, 06:48
Madawa Soysa Re: Submitted applications does not run. Tue, 01 Sep, 06:54
Madawa Soysa Re: Submitted applications does not run. Tue, 01 Sep, 06:55
Jeff Zhang Re: Submitted applications does not run. Tue, 01 Sep, 07:30
Madawa Soysa Re: Submitted applications does not run. Tue, 01 Sep, 08:01
patcharee spark 1.5 sort slow Tue, 01 Sep, 08:06
Jeff Zhang Re: Submitted applications does not run. Tue, 01 Sep, 08:11
Madawa Soysa Re: Submitted applications does not run. Tue, 01 Sep, 08:31
ponkin Re: Spark executor OOM issue on YARN Tue, 01 Sep, 08:36
Jeff Zhang Re: Submitted applications does not run. Tue, 01 Sep, 08:42
Igor Berman Re: bulk upload to Elasticsearch and shuffle behavior Tue, 01 Sep, 08:50
ponkin Re: Spark shell and StackOverFlowError Tue, 01 Sep, 09:06
shahid qadri Re: How to effieciently write sorted neighborhood in pyspark Tue, 01 Sep, 09:13
shahid qadri Custom Partitioner Tue, 01 Sep, 09:14
Romi Kuntsman How to determine the value for spark.sql.shuffle.partitions? Tue, 01 Sep, 09:17
Yanbo Liang Re: How to compute the probability of each class in Naive Bayes Tue, 01 Sep, 09:48
Jem Tucker Re: Custom Partitioner Tue, 01 Sep, 09:52
Sean Owen Re: How to compute the probability of each class in Naive Bayes Tue, 01 Sep, 09:57
sreeramvenkat HiveThriftServer not registering with Zookeeper Tue, 01 Sep, 10:10
shahid ashraf Re: Custom Partitioner Tue, 01 Sep, 10:13
Jem Tucker Re: Custom Partitioner Tue, 01 Sep, 10:27
shahid ashraf Re: Custom Partitioner Tue, 01 Sep, 10:38
Akhil Das Re: Is it possible to create spark cluster in different network? Tue, 01 Sep, 10:47
Jem Tucker Re: Custom Partitioner Tue, 01 Sep, 10:48
rakesh sharma How mature is spark sql Tue, 01 Sep, 11:07
Hafiz Mujadid Schema From parquet file Tue, 01 Sep, 11:07
cgalan Error using spark.driver.userClassPathFirst=true Tue, 01 Sep, 11:28
Hafiz Mujadid reading multiple parquet file using spark sql Tue, 01 Sep, 11:31
Silvio Bernardinello Spark job killed Tue, 01 Sep, 12:26
Akhil Das Re: Spark job killed Tue, 01 Sep, 12:42
nasokan Re: Potential NPE while exiting spark-shell Tue, 01 Sep, 12:52
Shushant Arora spark streaming 1.3 with kafka Tue, 01 Sep, 13:02
Cody Koeninger Re: spark streaming 1.3 with kafka Tue, 01 Sep, 13:39
Aurélien Bellet Re: Memory-efficient successive calls to repartition() Tue, 01 Sep, 14:48
Anders Arpteg Re: Problems with Tungsten in Spark 1.5.0-rc2 Tue, 01 Sep, 15:03
Shushant Arora Re: spark streaming 1.3 with kafka Tue, 01 Sep, 15:04
Cody Koeninger Re: spark streaming 1.3 with kafka Tue, 01 Sep, 15:12
Shushant Arora Re: spark streaming 1.3 with kafka Tue, 01 Sep, 15:16
Sunil Rathee Web UI is not showing up Tue, 01 Sep, 15:26
Cody Koeninger Re: spark streaming 1.3 with kafka Tue, 01 Sep, 15:27
Sonal Goyal Re: Web UI is not showing up Tue, 01 Sep, 15:34
Sunil Rathee Re: Web UI is not showing up Tue, 01 Sep, 15:36
Bertrand Question about Google Books Ngrams with pyspark (1.4.1) Tue, 01 Sep, 15:39
Max Huang Re: Is it possible to create spark cluster in different network? Tue, 01 Sep, 15:59
Sonal Goyal Re: Web UI is not showing up Tue, 01 Sep, 16:00
unk1102 What should be the optimal value for spark.sql.shuffle.partition? Tue, 01 Sep, 16:11
Shushant Arora Re: spark streaming 1.3 with kafka Tue, 01 Sep, 16:19
Cody Koeninger Re: spark streaming 1.3 with kafka Tue, 01 Sep, 16:32
Eric Walker cached data between jobs Tue, 01 Sep, 16:53
Madawa Soysa Error when creating an ALS model in spark Tue, 01 Sep, 16:55
Madawa Soysa Re: Submitted applications does not run. Tue, 01 Sep, 16:56
Robineast Re: Question about Google Books Ngrams with pyspark (1.4.1) Tue, 01 Sep, 16:59
Jörn Franke Re: How mature is spark sql Tue, 01 Sep, 17:03
Davies Liu Re: Problems with Tungsten in Spark 1.5.0-rc2 Tue, 01 Sep, 17:07
Davies Liu Re: Custom Partitioner Tue, 01 Sep, 17:12
Shushant Arora Re: spark streaming 1.3 with kafka Tue, 01 Sep, 17:15
Krishna Sangeeth KS Re: Spark Effects of Driver Memory, Executor Memory, Driver Memory Overhead and Executor Memory Overhead on success of job runs Tue, 01 Sep, 17:17
Michael Siler Intermittent performance degradation in Spark Streaming Tue, 01 Sep, 17:26
anshu shukla Resource allocation in SPARK streaming Tue, 01 Sep, 17:55
Thomas Dudziak Re: How to avoid shuffle errors for a large join ? Tue, 01 Sep, 18:13
Bertrand Re: Question about Google Books Ngrams with pyspark (1.4.1) Tue, 01 Sep, 18:17
Saif.A.Ell...@wellsfargo.com What is the current status of ML ? Tue, 01 Sep, 18:23
Priya Ch Executor lost failure Tue, 01 Sep, 18:28
Sean Owen Re: What is the current status of ML ? Tue, 01 Sep, 18:30
Saif.A.Ell...@wellsfargo.com RE: What is the current status of ML ? Tue, 01 Sep, 18:34
Darin McBeath Re: Reading xml in java using spark Tue, 01 Sep, 18:58
Bertrand Re: Question about Google Books Ngrams with pyspark (1.4.1) Tue, 01 Sep, 19:10
Andrew Duffy Re: Executor lost failure Tue, 01 Sep, 19:13
steve_ash Conditionally do things different on the first minibatch vs subsequent minibatches in a dstream Tue, 01 Sep, 19:36
hai Re: Hung spark executors don't count toward worker memory limit Tue, 01 Sep, 21:00
Ted Yu Re: Conditionally do things different on the first minibatch vs subsequent minibatches in a dstream Tue, 01 Sep, 21:59
Matt K extracting file path using dataframes Tue, 01 Sep, 23:00
Alexander Pivovarov spark 1.4.1 saveAsTextFile is slow on emr-4.0.0 Tue, 01 Sep, 23:01
Matt K Re: extracting file path using dataframes Tue, 01 Sep, 23:03
Jonathan Coveney Re: extracting file path using dataframes Tue, 01 Sep, 23:27
Cheng Lian Re: reading multiple parquet file using spark sql Wed, 02 Sep, 02:05
Cheng Lian Re: Schema From parquet file Wed, 02 Sep, 02:12
Cheng Lian Re: Group by specific key and save as parquet Wed, 02 Sep, 02:15
Alexander Pivovarov Re: spark 1.4.1 saveAsTextFile is slow on emr-4.0.0 Wed, 02 Sep, 02:33
Jeff Zhang Re: cached data between jobs Wed, 02 Sep, 02:54
Alexander Pivovarov Re: spark 1.4.1 saveAsTextFile is slow on emr-4.0.0 Wed, 02 Sep, 04:02
Harish Butani Spark + Druid Wed, 02 Sep, 04:04
ankit tyagi OOM in spark driver Wed, 02 Sep, 06:04
Paolo Platter R: Spark + Druid Wed, 02 Sep, 06:46
shahid ashraf Re: Custom Partitioner Wed, 02 Sep, 07:02
Neil Jonkers Re: spark 1.4.1 saveAsTextFile is slow on emr-4.0.0 Wed, 02 Sep, 07:54
Hafiz Mujadid Save dataframe into hbase Wed, 02 Sep, 08:04
Steve Loughran Re: Too many open files issue Wed, 02 Sep, 08:33
Jem Tucker Re: Custom Partitioner Wed, 02 Sep, 09:15
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · Next »Thread · Author · Date
Box list
Sep 2019103
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137