spark-user mailing list archives: June 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
ZIGEN How to use Window Operations with kafka Direct-API? Fri, 12 Jun, 08:10
Saisai Shao   Re: How to use Window Operations with kafka Direct-API? Fri, 12 Jun, 08:18
zigen     Re: How to use Window Operations with kafka Direct-API? Fri, 12 Jun, 10:03
Cody Koeninger       Re: How to use Window Operations with kafka Direct-API? Fri, 12 Jun, 14:18
Cannot start master with Spark 1.4.0
Alexis Seigneurin   Cannot start master with Spark 1.4.0 Fri, 12 Jun, 08:34
Alexis Seigneurin   Cannot start master with Spark 1.4.0 Mon, 15 Jun, 08:09
gaurav sharma     Re: Cannot start master with Spark 1.4.0 Mon, 15 Jun, 08:40
Alexis Seigneurin       Re: Cannot start master with Spark 1.4.0 Mon, 15 Jun, 11:18
Marcelo Vanzin     Re: Cannot start master with Spark 1.4.0 Mon, 15 Jun, 16:40
Alexis Seigneurin       Re: Cannot start master with Spark 1.4.0 Wed, 17 Jun, 22:49
Haopu Wang If not stop StreamingContext gracefully, will checkpoint data be consistent? Fri, 12 Jun, 08:57
Haopu Wang   RE: If not stop StreamingContext gracefully, will checkpoint data be consistent? Mon, 15 Jun, 01:24
Akhil Das     Re: If not stop StreamingContext gracefully, will checkpoint data be consistent? Mon, 15 Jun, 07:48
Haopu Wang       RE: If not stop StreamingContext gracefully, will checkpoint data be consistent? Mon, 15 Jun, 09:19
Akhil Das         Re: If not stop StreamingContext gracefully, will checkpoint data be consistent? Tue, 16 Jun, 07:25
Haopu Wang           RE: If not stop StreamingContext gracefully, will checkpoint data be consistent? Fri, 19 Jun, 00:18
Akhil Das             Re: If not stop StreamingContext gracefully, will checkpoint data be consistent? Fri, 19 Jun, 07:03
ayan guha Spark 1.4 release date Fri, 12 Jun, 09:41
Todd Nist   Re: Spark 1.4 release date Fri, 12 Jun, 09:46
ayan guha     Re: Spark 1.4 release date Fri, 12 Jun, 12:08
Guru Medasani       Re: Spark 1.4 release date Fri, 12 Jun, 12:12
ayan guha         Re: Spark 1.4 release date Fri, 12 Jun, 13:32
Giovanni Paolo Gibilisco           Re: Spark 1.4 release date Sat, 13 Jun, 11:13
Eric Eijkelenboom Upgrade to parquet 1.6.0 Fri, 12 Jun, 10:16
Cheng Lian   Re: Upgrade to parquet 1.6.0 Fri, 12 Jun, 10:41
Eric Eijkelenboom     Re: Upgrade to parquet 1.6.0 Fri, 12 Jun, 11:03
Brian Candler Scheduling and node affinity Fri, 12 Jun, 10:53
Yasemin Kaya Broadcast value Fri, 12 Jun, 13:27
Vamshi Krishna Writing data to hbase using Sparkstreaming Fri, 12 Jun, 13:40
Fwd: Spark/PySpark errors on mysterious missing /tmp file
John Berryman   Fwd: Spark/PySpark errors on mysterious missing /tmp file Fri, 12 Jun, 13:50
gaurav sharma Spark Streaming - Can i BIND Spark Executor to Kafka Partition Leader Fri, 12 Jun, 14:59
Chris Freeman Issues with `when` in Column class Fri, 12 Jun, 15:05
Yin Huai   Re: Issues with `when` in Column class Fri, 12 Jun, 15:31
Chris Freeman     Re: Issues with `when` in Column class Fri, 12 Jun, 15:37
algermissen1971 Spark Streaming, updateStateByKey and mapPartitions() - and lazy "DatabaseConnection" Fri, 12 Jun, 15:07
Cody Koeninger   Re: Spark Streaming, updateStateByKey and mapPartitions() - and lazy "DatabaseConnection" Fri, 12 Jun, 15:26
algermissen1971     Re: Spark Streaming, updateStateByKey and mapPartitions() - and lazy "DatabaseConnection" Fri, 12 Jun, 20:55
Cody Koeninger       Re: Spark Streaming, updateStateByKey and mapPartitions() - and lazy "DatabaseConnection" Fri, 12 Jun, 20:59
algermissen1971         Re: Spark Streaming, updateStateByKey and mapPartitions() - and lazy "DatabaseConnection" Fri, 12 Jun, 21:11
Cody Koeninger           Re: Spark Streaming, updateStateByKey and mapPartitions() - and lazy "DatabaseConnection" Fri, 12 Jun, 21:19
algermissen1971             Re: Spark Streaming, updateStateByKey and mapPartitions() - and lazy "DatabaseConnection" Fri, 12 Jun, 21:36
Earthson [Spark-1.4.0]jackson-databind conflict? Fri, 12 Jun, 15:20
Sean Owen   Re: [Spark-1.4.0]jackson-databind conflict? Fri, 12 Jun, 15:24
Earthson Lu     Re: [Spark-1.4.0]jackson-databind conflict? Mon, 15 Jun, 01:39
Vitalii Duk Apache Spark architecture Fri, 12 Jun, 15:40
Tao Li [Spark-1.4.0] NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer Fri, 12 Jun, 15:40
Tao Li   Re: [Spark-1.4.0] NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer Fri, 12 Jun, 18:46
Elkhan Dadashov Spark Java API and minimum set of 3rd party dependencies Fri, 12 Jun, 18:14
Sean Owen   Re: Spark Java API and minimum set of 3rd party dependencies Fri, 12 Jun, 18:17
Elkhan Dadashov     Re: Spark Java API and minimum set of 3rd party dependencies Fri, 12 Jun, 18:32
Peng Cheng [Spark 1.4.0]How to set driver's system property using spark-submit options? Fri, 12 Jun, 18:17
Andrew Or   Re: [Spark 1.4.0]How to set driver's system property using spark-submit options? Fri, 12 Jun, 18:20
Peng Cheng     Re: [Spark 1.4.0]How to set driver's system property using spark-submit options? Fri, 12 Jun, 23:34
Ted Yu       Re: [Spark 1.4.0]How to set driver's system property using spark-submit options? Fri, 12 Jun, 23:39
Peng Cheng         Re: [Spark 1.4.0]How to set driver's system property using spark-submit options? Fri, 12 Jun, 23:58
Re: Exception when using CLUSTER BY or ORDER BY
Reynold Xin   Re: Exception when using CLUSTER BY or ORDER BY Fri, 12 Jun, 18:23
lomax0...@gmail.com log4j configuration ignored for some classes only Fri, 12 Jun, 18:28
Rex X How to use spark for map-reduce flow to filter N columns, top M rows of all csv files under a folder? Fri, 12 Jun, 18:46
Akhil Das   Re: How to use spark for map-reduce flow to filter N columns, top M rows of all csv files under a folder? Mon, 15 Jun, 09:16
Akhil Das     Re: How to use spark for map-reduce flow to filter N columns, top M rows of all csv files under a folder? Tue, 16 Jun, 07:27
Peter Haumer [Spark 1.4.0] java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation Fri, 12 Jun, 18:58
Steve Loughran   Re: [Spark 1.4.0] java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation Sat, 13 Jun, 08:26
Jonathan Coveney --jars not working? Fri, 12 Jun, 19:13
Akhil Das   Re: --jars not working? Fri, 12 Jun, 19:45
Alex Nakos     Re: --jars not working? Sat, 13 Jun, 06:49
Xin Liu Parquet Multiple Output Fri, 12 Jun, 21:31
Cheng Lian   Re: Parquet Multiple Output Fri, 12 Jun, 23:59
Minnow Noir Extracting k-means cluster values along with centers? Fri, 12 Jun, 22:44
Robin East   Re: Extracting k-means cluster values along with centers? Sat, 13 Jun, 14:25
Patrick Woody Dynamic allocator requests -1 executors Fri, 12 Jun, 23:42
Sandy Ryza   Re: Dynamic allocator requests -1 executors Sat, 13 Jun, 15:38
Patrick Woody     Re: Dynamic allocator requests -1 executors Sat, 13 Jun, 19:01
Andrew Or       Re: Dynamic allocator requests -1 executors Sat, 13 Jun, 23:30
Jim Green Resource allocation configurations for Spark on Yarn Fri, 12 Jun, 23:42
Jon Walton Spark SQL and Skewed Joins Sat, 13 Jun, 00:15
Michael Armbrust   Re: Spark SQL and Skewed Joins Sat, 13 Jun, 04:43
Jon Walton     Re: Spark SQL and Skewed Joins Tue, 16 Jun, 15:28
Koert Kuipers       Re: Spark SQL and Skewed Joins Tue, 16 Jun, 15:38
Michael Armbrust         Re: Spark SQL and Skewed Joins Tue, 16 Jun, 23:37
Koert Kuipers           Re: Spark SQL and Skewed Joins Wed, 17 Jun, 16:53
Yin Huai             Re: Spark SQL and Skewed Joins Wed, 17 Jun, 17:56
Reliable SQS Receiver for Spark Streaming
Michal Čizmazia   Reliable SQS Receiver for Spark Streaming Sat, 13 Jun, 00:44
Akhil Das     Re: Reliable SQS Receiver for Spark Streaming Sat, 13 Jun, 10:46
Michal Čizmazia       Re: Reliable SQS Receiver for Spark Streaming Sat, 13 Jun, 11:33
cizmazia   Reliable SQS Receiver for Spark Streaming Sat, 13 Jun, 10:23
Rex X [Spark] What is the most efficient way to do such a join and column manipulation? Sat, 13 Jun, 01:46
Don Drake   Re: [Spark] What is the most efficient way to do such a join and column manipulation? Sat, 13 Jun, 17:13
Rex X     Re: [Spark] What is the most efficient way to do such a join and column manipulation? Sun, 14 Jun, 00:25
Michael Armbrust       Re: [Spark] What is the most efficient way to do such a join and column manipulation? Sun, 14 Jun, 00:49
YaoPau Are there ways to restrict what parameters users can set for a Spark job? Sat, 13 Jun, 05:26
Akhil Das   Re: Are there ways to restrict what parameters users can set for a Spark job? Sat, 13 Jun, 11:00
Re: Building scaladoc using "build/sbt unidoc" failure
Reynold Xin   Re: Building scaladoc using "build/sbt unidoc" failure Sat, 13 Jun, 06:17
masoom alam Not albe to run FP-growth Example Sat, 13 Jun, 09:10
masoom alam   Re: Not albe to run FP-growth Example Sat, 13 Jun, 11:26
masoom alam     Re: Not albe to run FP-growth Example Sun, 14 Jun, 06:56
masoom alam       Re: Not albe to run FP-growth Example Sun, 14 Jun, 07:02
masoom alam         Re: Not albe to run FP-growth Example Mon, 15 Jun, 03:20
masoom alam           Re: Not albe to run FP-growth Example Mon, 15 Jun, 06:39
Xiangrui Meng             Re: Not albe to run FP-growth Example Wed, 17 Jun, 23:56
Hao Wang How to split log data into different files according to severity Sat, 13 Jun, 09:41
Akhil Das   Re: How to split log data into different files according to severity Sat, 13 Jun, 10:48
Hao Wang     Re: How to split log data into different files according to severity Sat, 13 Jun, 16:32
Will Briggs   Re: How to split log data into different files according to severity Sat, 13 Jun, 16:38
Hao Wang     Re: How to split log data into different files according to severity Sun, 14 Jun, 23:32
Chris Freeman How to silence Parquet logging? Sat, 13 Jun, 16:29
Cheng Lian   Re: How to silence Parquet logging? Sat, 13 Jun, 23:56
Chris Freeman   RE: How to silence Parquet logging? Sun, 14 Jun, 14:53
Don Drake --packages & Failed to load class for data source v1.4 Sat, 13 Jun, 16:46
Don Drake   Re: --packages & Failed to load class for data source v1.4 Sun, 14 Jun, 21:40
Burak Yavuz     Re: --packages & Failed to load class for data source v1.4 Mon, 15 Jun, 00:18
Don Drake       Re: --packages & Failed to load class for data source v1.4 Wed, 17 Jun, 18:49
Shing Hing Man How to read avro in SparkR Sat, 13 Jun, 16:54
Burak Yavuz   Re: How to read avro in SparkR Sun, 14 Jun, 01:13
Shivaram Venkataraman     Re: How to read avro in SparkR Sun, 14 Jun, 02:06
Shing Hing Man       Re: How to read avro in SparkR Sun, 14 Jun, 07:56
What is most efficient to do a large union and remove duplicates?
Gavin Yue   What is most efficient to do a large union and remove duplicates? Sat, 13 Jun, 17:49
Josh Rosen     Re: What is most efficient to do a large union and remove duplicates? Sun, 14 Jun, 16:27
Gavin Yue   What is most efficient to do a large union and remove duplicates? Sun, 14 Jun, 03:58
ayan guha     Re: What is most efficient to do a large union and remove duplicates? Sun, 14 Jun, 09:10
Gavin Yue       Re: What is most efficient to do a large union and remove duplicates? Sun, 14 Jun, 16:50
pth001 Dataframe Write : Tables created with SQLContext must be TEMPORARY. Use a HiveContext instead. Sat, 13 Jun, 19:36
Will Briggs   Re: Dataframe Write : Tables created with SQLContext must be TEMPORARY. Use a HiveContext instead. Sat, 13 Jun, 21:00
pth001     Re: Dataframe Write : Tables created with SQLContext must be TEMPORARY. Use a HiveContext instead. Sat, 13 Jun, 23:22
Cheng Lian   Re: Dataframe Write : Tables created with SQLContext must be TEMPORARY. Use a HiveContext instead. Sat, 13 Jun, 23:45
Keith Freeman spark javadocs don't work in eclipse/java? Sat, 13 Jun, 23:42
Mike Frampton spark stream twitter question .. Sun, 14 Jun, 00:08
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
Box list
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137