spark-user mailing list archives: November 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Anthony May Re: Starting a new Spark codebase, Python or Scala / Java? Mon, 21 Nov, 19:09
Anton Bubna-Litic Creating external tables in Spark 2.0.0 Thu, 03 Nov, 04:39
Anton Okolnychyi Fwd: Tue, 15 Nov, 11:26
Anton Okolnychyi Re: Dataframe broadcast join hint not working Sat, 26 Nov, 21:05
Aravindh Spark streaming uses lesser number of executors Tue, 08 Nov, 13:59
Arijit Spark Streaming Data loss on failure to write BlockAdditionEvent failure to WAL Mon, 07 Nov, 22:04
Arijit Re: Spark Streaming Data loss on failure to write BlockAdditionEvent failure to WAL Tue, 08 Nov, 16:47
Arijit Spark streaming data loss due to timeout in writing BlockAdditionEvent to WAL by the driver Mon, 14 Nov, 18:24
Arijit Re: Spark Streaming Data loss on failure to write BlockAdditionEvent failure to WAL Thu, 17 Nov, 16:48
Arthur Țițeică Re: confirm subscribe to user@spark.apache.org Sun, 27 Nov, 07:13
Arun Patel Spark XML ignore namespaces Thu, 03 Nov, 21:37
Arun Patel Spark-xml - OutOfMemoryError: Requested array size exceeds VM limit Wed, 16 Nov, 00:12
Arun Patel Re: Spark-xml - OutOfMemoryError: Requested array size exceeds VM limit Wed, 16 Nov, 01:44
Arun Patel Re: Spark-xml - OutOfMemoryError: Requested array size exceeds VM limit Wed, 16 Nov, 17:26
Aseem Bansal Is Spark launcher's listener API considered production ready? Thu, 03 Nov, 07:22
Aseem Bansal Re: Is Spark launcher's listener API considered production ready? Fri, 04 Nov, 09:46
Asher Krim Re: example LDA code ClassCastException Fri, 04 Nov, 02:53
Asher Krim Re: Spark ML DataFrame API - need cosine similarity, how to convert to RDD Vectors? Tue, 15 Nov, 19:25
Ashic Mahtab Straming - Stop when there's no more data Tue, 15 Nov, 11:29
Ashic Mahtab Re: How does predicate push down really help? Thu, 17 Nov, 07:56
Ashutosh Kumar Running Google Dataflow on Spark Wed, 02 Nov, 11:48
Asmeet Re: Issue in application deployment on spark cluster Fri, 18 Nov, 15:55
Benjamin Kim Re: Deep learning libraries for scala Tue, 01 Nov, 17:14
Benyi Wang Does DeserializeToObject mean that a Row is deserialized to Java objects? Mon, 07 Nov, 22:24
Benyi Wang Re: Dataframe broadcast join hint not working Sat, 26 Nov, 19:32
Benyi Wang Re: Dataframe broadcast join hint not working Sat, 26 Nov, 20:55
Bhaarat Sharma scala.MatchError while doing BinaryClassificationMetrics Mon, 14 Nov, 18:30
Bhaarat Sharma Re: scala.MatchError while doing BinaryClassificationMetrics Mon, 14 Nov, 19:02
Bhaarat Sharma Re: scala.MatchError while doing BinaryClassificationMetrics Tue, 15 Nov, 13:25
Bhaarat Sharma Exclude certain data from Training Data - Mlib Tue, 15 Nov, 13:28
Bharath Bhushan Re: Spark ignoring partition names without equals (=) separator Mon, 28 Nov, 07:06
Bibudh Lahiri Unsubscribe Thu, 03 Nov, 15:49
Bibudh Lahiri unsubscribe Sun, 13 Nov, 05:46
Bibudh Lahiri Unsubscribe Wed, 30 Nov, 04:03
Brandon White Starting a new Spark codebase, Python or Scala / Java? Mon, 21 Nov, 18:51
Bruno Faria Best approach to schedule Spark jobs Tue, 29 Nov, 22:00
Calvin Jia Re: sanboxing spark executors Fri, 04 Nov, 21:51
Carlo.Allocca LinearRegressionWithSGD and Rank Features By Importance Thu, 03 Nov, 10:35
Carlo.Allocca Re: LinearRegressionWithSGD and Rank Features By Importance Fri, 04 Nov, 07:38
Carlo.Allocca Re: LinearRegressionWithSGD and Rank Features By Importance Fri, 04 Nov, 09:57
Carlo.Allocca Re: LinearRegressionWithSGD and Rank Features By Importance Mon, 07 Nov, 15:47
Carlo.Allocca Re: LinearRegressionWithSGD and Rank Features By Importance Mon, 07 Nov, 17:12
Carlo.Allocca Re: LinearRegressionWithSGD and Rank Features By Importance Mon, 07 Nov, 17:14
Carlo.Allocca Re: LinearRegressionWithSGD and Rank Features By Importance Tue, 08 Nov, 16:01
Carlo.Allocca Re: LinearRegressionWithSGD and Rank Features By Importance Wed, 09 Nov, 11:07
Cassa L Custom receiver for WebSocket in Spark not working Wed, 02 Nov, 17:23
Cesar does column order matter in dataframe.repartition? Thu, 17 Nov, 19:41
Charles Allen Re: Unsubscribe Mon, 28 Nov, 21:41
Chin Wei Low Re: Spark app write too many small parquet files Mon, 28 Nov, 14:01
Cody Koeninger Re: Does Data pipeline using kafka and structured streaming work? Wed, 02 Nov, 01:18
Cody Koeninger Re: Does Data pipeline using kafka and structured streaming work? Wed, 02 Nov, 01:52
Cody Koeninger Re: Spark Streaming backpressure weird behavior/bug Wed, 02 Nov, 15:43
Cody Koeninger Re: Spark Streaming backpressure weird behavior/bug Thu, 03 Nov, 21:45
Cody Koeninger Re: Spark Streaming backpressure weird behavior/bug Fri, 04 Nov, 00:51
Cody Koeninger Re: expected behavior of Kafka dynamic topic subscription Fri, 04 Nov, 14:35
Cody Koeninger Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 04 Nov, 17:28
Cody Koeninger Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 04 Nov, 20:24
Cody Koeninger Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 04 Nov, 20:48
Cody Koeninger Re: expected behavior of Kafka dynamic topic subscription Mon, 07 Nov, 15:35
Cody Koeninger Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Mon, 07 Nov, 19:16
Cody Koeninger Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Mon, 07 Nov, 19:55
Cody Koeninger Re: Using Apache Spark Streaming - how to handle changing data format within stream Mon, 07 Nov, 23:15
Cody Koeninger Re: Kafka stream offset management question Tue, 08 Nov, 14:42
Cody Koeninger Re: Akka Stream as the source for Spark Streaming. Please advice... Thu, 10 Nov, 13:47
Cody Koeninger Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Fri, 11 Nov, 20:12
Cody Koeninger Re: Spark Streaming- ReduceByKey not removing Duplicates for the same key in a Batch Sat, 12 Nov, 16:25
Cody Koeninger Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Sat, 12 Nov, 21:25
Cody Koeninger Re: Spark Streaming- ReduceByKey not removing Duplicates for the same key in a Batch Sat, 12 Nov, 21:28
Cody Koeninger Re: Instability issues with Spark 2.0.1 and Kafka 0.10 Sun, 13 Nov, 22:21
Cody Koeninger Re: Kafka segmentation Thu, 17 Nov, 00:22
Cody Koeninger Re: Kafka segmentation Thu, 17 Nov, 01:32
Cody Koeninger Re: Kafka segmentation Thu, 17 Nov, 18:17
Cody Koeninger Re: Kafka segmentation Thu, 17 Nov, 18:50
Cody Koeninger Re: Kafka segmentation Sat, 19 Nov, 16:17
Cody Koeninger Re: kafka 0.10 with Spark 2.02 auto.offset.reset=earliest will only read from a single partition on a multi partition topic Sat, 19 Nov, 16:53
Cody Koeninger Re: Kafka direct approach,App UI shows wrong input rate Sat, 19 Nov, 17:06
Cody Koeninger Re: using StreamingKMeans Sat, 19 Nov, 17:22
Cody Koeninger Re: Mac vs cluster Re: kafka 0.10 with Spark 2.02 auto.offset.reset=earliest will only read from a single partition on a multi partition topic Sat, 19 Nov, 17:27
Cyanny LIANG Will different receivers run on different worker? Mon, 21 Nov, 08:12
Dale Wang Re: GraphX Pregel not update vertex state properly, cause messages loss Thu, 24 Nov, 03:10
Daniel Darabos Re: Strongly Connected Components Sat, 12 Nov, 00:58
Daniel Haviv error: Unable to find encoder for type stored in a Dataset. when trying to map through a DataFrame Wed, 02 Nov, 16:57
Daniel Haviv Re: Stream compressed data from KafkaUtils.createDirectStream Thu, 03 Nov, 19:27
Daniel Haviv Re: Stream compressed data from KafkaUtils.createDirectStream Thu, 03 Nov, 19:40
Daniel Haviv mapWithState and DataFrames Sun, 06 Nov, 10:53
Daniel Haviv mapWithState with a big initial RDD gets OOM'ed Mon, 07 Nov, 08:30
Daniel Haviv mapWithState with Datasets Tue, 08 Nov, 17:46
Daniel Haviv Re: mapWithState with Datasets Tue, 08 Nov, 18:19
Daniel Haviv Re: mapWithState with Datasets Tue, 08 Nov, 18:22
Daniel Haviv mapWithState job slows down & exceeds yarn's memory limits Tue, 15 Nov, 06:44
Daniel Haviv Using mapWithState without a checkpoint Thu, 17 Nov, 17:45
Daniel Haviv Re: How to load only the data of the last partition Thu, 17 Nov, 19:47
Daniel Schulz Swift question regarding in-memory snapshots of compact table data Thu, 10 Nov, 07:50
Daniel Siegmann Re: Quirk in how Spark DF handles JSON input records? Wed, 02 Nov, 19:22
Daniel Siegmann Re: CSV to parquet preserving partitioning Tue, 15 Nov, 17:57
Daniel van der Ende Re: Out of memory at 60GB free memory. Mon, 07 Nov, 07:02
Daniel van der Ende Re: Unable to lauch Python Web Application on Spark Cluster Thu, 10 Nov, 08:24
Daniel van der Ende Re: Do I have to wrap akka around spark streaming app? Mon, 28 Nov, 17:51
Dave Jaffe Anomalous Spark RDD persistence behavior Mon, 07 Nov, 22:07
Dave Jaffe Re: Anomalous Spark RDD persistence behavior Tue, 08 Nov, 19:39
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Box list
Oct 201993
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137