spark-user mailing list archives: September 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · Next »Thread · Author · Date
swetha Spark streaming job filling a lot of data in local spark nodes Mon, 28 Sep, 17:04
Priya Ch Re: CassandraSQLContext throwing NullPointer Exception Mon, 28 Sep, 17:07
Jon Chase Re: About memory leak in spark 1.4.1 Mon, 28 Sep, 17:34
Ted Yu Re: CassandraSQLContext throwing NullPointer Exception Mon, 28 Sep, 17:56
Kartik Mathur Re: Strange shuffle behaviour difference between Zeppelin and Spark-shell Mon, 28 Sep, 18:24
Augustus Hong Adding / Removing worker nodes for Spark Streaming Mon, 28 Sep, 18:27
Elango Cheran Re: how to handle OOMError from groupByKey Mon, 28 Sep, 18:28
Aaron Re: Python script runs fine in local mode, errors in other modes Mon, 28 Sep, 18:37
Cody Koeninger Re: Adding / Removing worker nodes for Spark Streaming Mon, 28 Sep, 18:37
Rick Moritz Re: Strange shuffle behaviour difference between Zeppelin and Spark-shell Mon, 28 Sep, 18:38
Augustus Hong Re: Adding / Removing worker nodes for Spark Streaming Mon, 28 Sep, 18:43
Kartik Mathur Re: Strange shuffle behaviour difference between Zeppelin and Spark-shell Mon, 28 Sep, 18:47
Krishna Sankar Re: HDP 2.3 support for Spark 1.5.x Mon, 28 Sep, 19:13
Robert Grandl SQL queries in Spark / YARN Mon, 28 Sep, 19:46
Mark Hamstra Re: SQL queries in Spark / YARN Mon, 28 Sep, 19:47
Robert Grandl Re: SQL queries in Spark / YARN Mon, 28 Sep, 20:03
Kartik Mathur Re: SQL queries in Spark / YARN Mon, 28 Sep, 20:07
Stephen Hankinson UnknownHostException with Mesos and custom Jar Mon, 28 Sep, 20:15
jwthomas Performance when iterating over many parquet files Mon, 28 Sep, 20:35
amitra123 java.lang.ClassCastException (org.apache.spark.scheduler.ResultTask cannot be cast to org.apache.spark.scheduler.Task) Mon, 28 Sep, 20:45
Chengi Liu Reading kafka stream and writing to hdfs Mon, 28 Sep, 20:45
Michael Armbrust Re: Performance when iterating over many parquet files Mon, 28 Sep, 21:00
Michael Armbrust Re: Performance when iterating over many parquet files Mon, 28 Sep, 21:01
Ted Yu Re: java.lang.ClassCastException (org.apache.spark.scheduler.ResultTask cannot be cast to org.apache.spark.scheduler.Task) Mon, 28 Sep, 21:11
Utkarsh Sengar Re: spark.mesos.coarse impacts memory performance on mesos Mon, 28 Sep, 21:24
Sourabh Chandak Re: Adding / Removing worker nodes for Spark Streaming Mon, 28 Sep, 21:34
Cody Koeninger Re: Adding / Removing worker nodes for Spark Streaming Mon, 28 Sep, 21:49
Jörn Franke Re: HDFS small file generation problem Mon, 28 Sep, 21:53
Alexander Pivovarov Does YARN start new executor in place of the failed one? Mon, 28 Sep, 22:38
jordan.tho...@accenture.com RE: Performance when iterating over many parquet files Mon, 28 Sep, 22:45
Cheng Lian Re: Performance when iterating over many parquet files Mon, 28 Sep, 22:54
Cheng Lian Re: Performance when iterating over many parquet files Mon, 28 Sep, 22:56
jordan.tho...@accenture.com RE: Performance when iterating over many parquet files Mon, 28 Sep, 23:03
markluk Get variable into Spark's foreachRDD function Mon, 28 Sep, 23:06
Cheng Lian Re: Performance when iterating over many parquet files Mon, 28 Sep, 23:14
jordan.tho...@accenture.com RE: Performance when iterating over many parquet files Mon, 28 Sep, 23:29
Amit Yadav RE: java.lang.ClassCastException (org.apache.spark.scheduler.ResultTask cannot be cast to org.apache.spark.scheduler.Task) Mon, 28 Sep, 23:36
tridib nested collection object query Mon, 28 Sep, 23:37
Cheng Lian Re: Performance when iterating over many parquet files Mon, 28 Sep, 23:45
jordan.tho...@accenture.com RE: Performance when iterating over many parquet files Mon, 28 Sep, 23:48
Siva Monitoring tools for spark streaming Mon, 28 Sep, 23:52
TEST ONE Merging two avro RDD/DataFrames Tue, 29 Sep, 00:00
James Pirz Setting executors per worker - Standalone Tue, 29 Sep, 00:24
Ankur Srivastava Re: Get variable into Spark's foreachRDD function Tue, 29 Sep, 00:26
java8964 RE: nested collection object query Tue, 29 Sep, 00:42
Cheng Lian Re: Performance when iterating over many parquet files Tue, 29 Sep, 01:51
Cheng Lian Re: Performance when iterating over many parquet files Tue, 29 Sep, 01:51
Shixiong Zhu Re: Monitoring tools for spark streaming Tue, 29 Sep, 01:55
Cheng Lian Re: Performance when iterating over many parquet files Tue, 29 Sep, 01:57
Rachana Srivastava spark-submit classloader issue... Tue, 29 Sep, 02:01
Shixiong Zhu Re: Spark streaming job filling a lot of data in local spark nodes Tue, 29 Sep, 02:02
Justin Pihony Is MLBase dead? Tue, 29 Sep, 02:19
Hari Shreedharan Re: Monitoring tools for spark streaming Tue, 29 Sep, 02:27
Shixiong Zhu Re: spark.streaming.concurrentJobs Tue, 29 Sep, 02:30
이기석 Is there any tool provides per-task monitoring to figure out task skew in Spark streaming? Tue, 29 Sep, 02:59
YiZhi Liu SparkContext._active_spark_context returns None Tue, 29 Sep, 03:08
Jerry Lam Spark SQL: Implementing Custom Data Source Tue, 29 Sep, 03:22
Ted Yu Re: SparkContext._active_spark_context returns None Tue, 29 Sep, 03:26
Tathagata Das Re: Is there any tool provides per-task monitoring to figure out task skew in Spark streaming? Tue, 29 Sep, 03:31
Jeff Zhang Re: Setting executors per worker - Standalone Tue, 29 Sep, 03:46
James Pirz Re: Setting executors per worker - Standalone Tue, 29 Sep, 03:47
Justin Pihony Re: Is MLBase dead? Tue, 29 Sep, 03:50
Ted Yu Re: Spark SQL: Implementing Custom Data Source Tue, 29 Sep, 04:00
Aniket Bhatnagar Re: spark-submit classloader issue... Tue, 29 Sep, 04:04
Blarvomere A non-canonical use of the Spark computation model Tue, 29 Sep, 04:52
jeff saremi flatmap() and spark performance Tue, 29 Sep, 05:21
Tridib Samanta RE: nested collection object query Tue, 29 Sep, 05:26
YiZhi Liu Re: SparkContext._active_spark_context returns None Tue, 29 Sep, 05:31
Hemant Bhanawat Re: flatmap() and spark performance Tue, 29 Sep, 05:35
Fernando Paladini Fwd: "Method json([class java.util.HashMap]) does not exist" when reading JSON on PySpark Tue, 29 Sep, 05:37
Tridib Samanta RE: nested collection object query Tue, 29 Sep, 06:02
Rachana Srivastava Where are logs for Spark Kafka Yarn on Cloudera Tue, 29 Sep, 06:37
sukesh kumar unsubscribe Tue, 29 Sep, 06:39
Jan Algermissen Sharding vs. Per-Timeframe Tables Tue, 29 Sep, 07:01
varun sharma OOM error in Spark worker Tue, 29 Sep, 07:05
ramibatal Checkpointing not removing shuffle files from local disk Tue, 29 Sep, 08:18
Rick Moritz Re: Strange shuffle behaviour difference between Zeppelin and Spark-shell Tue, 29 Sep, 08:44
Robineast Re: How to find how much data will be train in mllib or how much the spark job is completed ? Tue, 29 Sep, 10:47
Yanbo Liang Re: Stopping criteria for gradient descent Tue, 29 Sep, 10:55
Renu Yadav Change Orc split size Tue, 29 Sep, 11:10
satish chandra j Fetching Date value from spark.sql.row in Spark 1.2.2 Tue, 29 Sep, 11:11
Adrian Tanase Re: Spark Streaming Log4j Inside Eclipse Tue, 29 Sep, 11:23
Arttii Spark Streaming many subscriptions vs many jobs Tue, 29 Sep, 11:42
Adrian Tanase Re: Adding / Removing worker nodes for Spark Streaming Tue, 29 Sep, 11:54
Adrian Tanase Re: Does YARN start new executor in place of the failed one? Tue, 29 Sep, 11:56
Cody Koeninger Re: Spark Streaming many subscriptions vs many jobs Tue, 29 Sep, 12:10
Jason White PySpark Checkpoints with Broadcast Variables Tue, 29 Sep, 12:14
Jason White PySpark Checkpoints with Broadcast Variables Tue, 29 Sep, 12:16
Cody Koeninger Re: Spark-Kafka Connector issue Tue, 29 Sep, 12:19
Ophir Cohen Hive alter table is failing Tue, 29 Sep, 12:20
Dmitry Goldenberg Kafka error "partitions don't have a leader" / LeaderNotAvailableException Tue, 29 Sep, 12:26
satish chandra j Re: Fetching Date value from spark.sql.row in Spark 1.2.2 Tue, 29 Sep, 12:27
Ted Yu Re: Hive alter table is failing Tue, 29 Sep, 12:30
Adrian Tanase Re: Kafka error "partitions don't have a leader" / LeaderNotAvailableException Tue, 29 Sep, 12:31
Adrian Tanase Re: Monitoring tools for spark streaming Tue, 29 Sep, 12:33
Adrian Tanase Re: Merging two avro RDD/DataFrames Tue, 29 Sep, 12:35
Dmitry Goldenberg Re: Kafka error "partitions don't have a leader" / LeaderNotAvailableException Tue, 29 Sep, 12:37
Adrian Tanase Re: Kafka error "partitions don't have a leader" / LeaderNotAvailableException Tue, 29 Sep, 12:47
Dmitry Goldenberg Re: Kafka error "partitions don't have a leader" / LeaderNotAvailableException Tue, 29 Sep, 13:05
java8964 RE: Setting executors per worker - Standalone Tue, 29 Sep, 13:17
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · Next »Thread · Author · Date
Box list
Aug 202110
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137