spark-user mailing list archives: October 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · Next »Thread · Author · Date
Hien Luu Re: Spark job workflow engine recommendations Wed, 07 Oct, 16:56
Holden Karau SF Spark Office Hours Experiment - Friday Afternoon Tue, 20 Oct, 22:55
Holden Karau Re: Spark-Testing-Base Q/A Wed, 21 Oct, 10:42
Holden Karau Re: SF Spark Office Hours Experiment - Friday Afternoon Wed, 21 Oct, 19:09
Holden Karau Re: Spark-Testing-Base Q/A Wed, 21 Oct, 23:16
Holden Karau Re: Spark with business rules Mon, 26 Oct, 22:32
Holden Karau Re: SF Spark Office Hours Experiment - Friday Afternoon Tue, 27 Oct, 18:43
Holden Karau Re: Spark-Testing-Base Q/A Wed, 28 Oct, 07:40
Hossein Re: SparkR Error in sparkR.init(master=“local”) in RStudio Tue, 06 Oct, 16:45
Hster Geguri expected Kinesis checkpoint behavior when driver restarts Tue, 27 Oct, 23:09
Hurshal Patel driver ClassNotFoundException when MySQL JDBC exceptions are thrown on executor Sat, 17 Oct, 01:03
Hyukjin Kwon Fixed writer version as version1 for Parquet as wring a Parquet file. Fri, 09 Oct, 06:04
Hyukjin Kwon Filter applied on merged Parquet shemsa with new column fails. Wed, 28 Oct, 02:11
Igor Berman Re: Getting spark application driver ID programmatically Fri, 02 Oct, 11:06
Igor Berman Re: RDD of ImmutableList Mon, 05 Oct, 18:10
Igor Berman Re: Issue with the class generated from avro schema Fri, 09 Oct, 18:19
Igor Berman Re: Issue with the class generated from avro schema Fri, 09 Oct, 20:36
Igor Berman Re: Question about GraphX connected-components Sat, 10 Oct, 18:06
Igor Berman Re: our spark gotchas report while creating batch pipeline Sun, 18 Oct, 20:29
Igor Berman Re: In-memory computing and cache() in Spark Mon, 19 Oct, 06:32
Igor Berman Re: spark straggle task Tue, 20 Oct, 13:47
Igor Berman Re: Storing Compressed data in HDFS into Spark Thu, 22 Oct, 12:15
Igor Berman Re: Spark 1.5.1+Hadoop2.6 .. unable to write to S3 (HADOOP-12420) Thu, 22 Oct, 15:11
Ilya Ganelin Re: Spark Streaming Latency in practice Tue, 13 Oct, 17:13
Isabelle Phan How to distinguish columns when joining DataFrames with shared parent? Wed, 21 Oct, 00:23
Isabelle Phan Re: How to distinguish columns when joining DataFrames with shared parent? Wed, 21 Oct, 20:49
Isabelle Phan Re: How to distinguish columns when joining DataFrames with shared parent? Wed, 21 Oct, 23:33
Isabelle Phan How to catch error during Spark job? Wed, 28 Oct, 01:40
Jacek Laskowski How does FAIR job scheduler work in Standalone cluster mode? Fri, 02 Oct, 21:22
Jacek Laskowski Re: How does FAIR job scheduler work in Standalone cluster mode? Sat, 03 Oct, 00:29
Jacek Laskowski WARN NettyRpcEndpointRef: Error sending message [message = Heartbeat(driver,... Sat, 03 Oct, 18:27
Jacek Laskowski Re: WARN NettyRpcEndpointRef: Error sending message [message = Heartbeat(driver,... Sun, 04 Oct, 03:21
Jacek Laskowski preferredNodeLocationData, SPARK-8949, and SparkContext - a leftover? Sun, 04 Oct, 03:36
Jacek Laskowski Re: preferredNodeLocationData, SPARK-8949, and SparkContext - a leftover? Sun, 04 Oct, 14:53
Jacek Laskowski How StorageLevel, CacheManager and checkpointing influence computing RDD partitions? Sat, 10 Oct, 14:37
Jacek Laskowski Re: SF Spark Office Hours Experiment - Friday Afternoon Wed, 21 Oct, 18:54
Jacek Laskowski Re: Using spark in cluster mode Wed, 21 Oct, 18:58
Jacinto Arias Re: saveAsTextFile creates an empty folder in HDFS Sat, 03 Oct, 16:20
Jack Yang RE: No space left on device when running graphx job Mon, 05 Oct, 22:43
Jagat Singh Re: HDFS small file generation problem Sat, 03 Oct, 09:03
Jagat Singh Re: Spark thrift service and Hive impersonation. Mon, 05 Oct, 21:51
Jags Ramnarayanan Re: can I use Spark as alternative for gem fire cache ? Wed, 21 Oct, 18:44
Jags Ramnarayanan Re: Broadcast table Mon, 26 Oct, 20:43
Jakob Odersky Building with SBT and Scala 2.11 Wed, 14 Oct, 00:53
Jakob Odersky Re: Building with SBT and Scala 2.11 Wed, 14 Oct, 16:41
Jakob Odersky Re: Turn off logs in spark-sql shell Fri, 16 Oct, 18:32
Jakub Dubovsky RDD of ImmutableList Mon, 05 Oct, 18:04
Jakub Dubovsky Re: RDD of ImmutableList Mon, 05 Oct, 18:42
Jakub Dubovsky Re: RDD of ImmutableList Wed, 07 Oct, 10:56
Jaonary Rabarisoa ml.Pipeline without train step Sun, 04 Oct, 09:34
Jason White PySpark + Streaming + DataFrames Fri, 16 Oct, 18:03
Jason White Re: PySpark + Streaming + DataFrames Fri, 16 Oct, 19:07
Jason White Re: PySpark + Streaming + DataFrames Mon, 19 Oct, 22:08
Jeetendra Gangele automatic start of streaming job on failure on YARN Thu, 01 Oct, 13:30
Jeetendra Gangele Re: Deploying spark-streaming application on production Thu, 01 Oct, 14:49
Jeetendra Gangele Re: automatic start of streaming job on failure on YARN Sat, 03 Oct, 11:01
Jeff Jones How can I disable logging when running local[*]? Tue, 06 Oct, 03:19
Jeff Jones Re: How can I disable logging when running local[*]? Tue, 06 Oct, 16:48
Jeff Jones Re: How can I disable logging when running local[*]? Tue, 06 Oct, 18:19
Jeff Nadler Streaming Performance w/ UpdateStateByKey Mon, 05 Oct, 21:28
Jeff Nadler Re: API to run spark Jobs Tue, 06 Oct, 16:55
Jeff Nadler Re: API to run spark Jobs Tue, 06 Oct, 17:18
Jeff Nadler Re: Weird performance pattern of Spark Streaming (1.4.1) + direct Kafka Tue, 06 Oct, 19:06
Jeff Nadler Re: Storing object in spark streaming Mon, 12 Oct, 21:27
Jeff Sadowski mailing list subscription Tue, 20 Oct, 16:22
Jeff Sadowski multiple pyspark instances simultaneously (same time) Tue, 20 Oct, 16:46
Jeff Sadowski Fwd: multiple pyspark instances simultaneously (same time) Thu, 22 Oct, 16:59
Jeff Thompson performance difference between Thrift server and SparkSQL? Sat, 03 Oct, 18:08
Jeff Thompson Re: performance difference between Thrift server and SparkSQL? Mon, 05 Oct, 06:21
Jeff Thompson error in sparkSQL 1.5 using count(1) in nested queries Fri, 09 Oct, 03:47
Jeff Zhang Re: pyspark groupbykey throwing error: unpack requires a string argument of length 4 Mon, 19 Oct, 06:17
Jeff Zhang Re: Location preferences in pyspark? Wed, 21 Oct, 01:40
Jeff Zhang Re: Reading JSON in Pyspark throws scala.MatchError Wed, 21 Oct, 04:59
Jeff Zhang Re: Reading JSON in Pyspark throws scala.MatchError Wed, 21 Oct, 05:18
Jeff Zhang How to use And Operator in filter (PySpark) Wed, 21 Oct, 10:11
Jeffrey Richley Mapping to multiple groups in Apache Spark Wed, 21 Oct, 18:23
Jem Tucker Re: java.lang.NegativeArraySizeException? as iterating a big RDD Fri, 23 Oct, 10:48
Jens Rantil Best practises to clean up RDDs for old applications Thu, 08 Oct, 10:43
Jerry Lam spark-submit --packages using different resolver Fri, 02 Oct, 03:58
Jerry Lam Re: Limiting number of cores per job in multi-threaded driver. Sun, 04 Oct, 17:57
Jerry Lam Re: spark-submit --packages using different resolver Tue, 06 Oct, 15:33
Jerry Lam Re: spark-submit --packages using different resolver Tue, 06 Oct, 18:33
Jerry Lam Re: Dataframes - sole data structure for parallel computations? Thu, 08 Oct, 18:08
Jerry Lam Re: Indexing Support Sun, 18 Oct, 22:26
Jerry Lam Re: Spark executor on Mesos - how to set effective user id? Mon, 19 Oct, 13:05
Jerry Lam Spark SQL: Preserving Dataframe Schema Tue, 20 Oct, 15:24
Jerry Lam Spark SQL: Issues with using DirectParquetOutputCommitter with APPEND mode and OVERWRITE mode Thu, 22 Oct, 16:00
Jerry Lam [Spark SQL]: Spark Job Hangs on the refresh method when saving over 1 million files Sun, 25 Oct, 01:35
Jerry Lam Re: [Spark SQL]: Spark Job Hangs on the refresh method when saving over 1 million files Mon, 26 Oct, 00:39
Jerry Lam Re: [Spark SQL]: Spark Job Hangs on the refresh method when saving over 1 million files Mon, 26 Oct, 00:50
Jerry Lam Re: [Spark SQL]: Spark Job Hangs on the refresh method when saving over 1 million files Mon, 26 Oct, 02:25
Jerry Lam Re: [Spark SQL]: Spark Job Hangs on the refresh method when saving over 1 million files Mon, 26 Oct, 02:58
Jerry Lam Re: [Spark SQL]: Spark Job Hangs on the refresh method when saving over 1 million files Mon, 26 Oct, 13:56
Jerry Lam [Spark-SQL]: Unable to propagate hadoop configuration after SparkContext is initialized Tue, 27 Oct, 17:43
Jerry Lam Re: [Spark-SQL]: Unable to propagate hadoop configuration after SparkContext is initialized Tue, 27 Oct, 18:22
Jerry Lam Re: [Spark-SQL]: Unable to propagate hadoop configuration after SparkContext is initialized Tue, 27 Oct, 19:13
Jerry Lam Re: Spark -- Writing to Partitioned Persistent Table Wed, 28 Oct, 22:29
Jerry Lam Re: Spark -- Writing to Partitioned Persistent Table Thu, 29 Oct, 00:31
Jerry Wong Exception in thread "main" java.lang.IllegalArgumentException: Positive number of slices required Thu, 29 Oct, 18:45
Jey Kottalam Re: SparkLauncher is blocked until mail process is killed. Fri, 30 Oct, 02:00
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · Next »Thread · Author · Date
Box list
Nov 201973
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137