spark-dev mailing list archives: March 2016

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Jeff Zhang Support virtualenv in PySpark Tue, 01 Mar, 05:07
Jeff Zhang   Re: Support virtualenv in PySpark Tue, 01 Mar, 08:29
yasincelik Spark performance comparison for research Tue, 01 Mar, 05:25
Reynold Xin   Re: Spark performance comparison for research Tue, 01 Mar, 05:34
Jörn Franke   Re: Spark performance comparison for research Tue, 01 Mar, 06:41
Re: What should be spark.local.dir in spark on yarn?
Alexander Pivovarov   Re: What should be spark.local.dir in spark on yarn? Tue, 01 Mar, 08:57
Jeff Zhang     Re: What should be spark.local.dir in spark on yarn? Tue, 01 Mar, 09:39
Re: Is spark.driver.maxResultSize used correctly ?
Reynold Xin   Re: Is spark.driver.maxResultSize used correctly ? Tue, 01 Mar, 09:00
Jeff Zhang     Re: Is spark.driver.maxResultSize used correctly ? Tue, 01 Mar, 09:24
Jerry Lam SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Tue, 01 Mar, 14:16
Herman van Hövell tot Westerflier   Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Tue, 01 Mar, 14:39
Jerry Lam     Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Tue, 01 Mar, 16:19
Henri Dubois-Ferriere       Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Tue, 01 Mar, 16:34
Jerry Lam         Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Tue, 01 Mar, 16:48
Alex Kozlov         Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Tue, 01 Mar, 16:58
Jerry Lam           Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Tue, 01 Mar, 17:07
Alex Kozlov             Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Tue, 01 Mar, 17:35
Reynold Xin               Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Tue, 01 Mar, 21:44
Jerry Lam                 Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Tue, 01 Mar, 22:25
Steve Loughran                   Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Wed, 02 Mar, 15:03
Jerry Lam                     Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Wed, 02 Mar, 18:10
Reynold Xin                       Re: SPARK-SQL: Pattern Detection on Live Event or Archived Event Data Thu, 03 Mar, 02:42
Re: [Proposal] Enabling time series analysis on spark metrics
Karan Kumar   Re: [Proposal] Enabling time series analysis on spark metrics Tue, 01 Mar, 16:17
Reynold Xin     Re: [Proposal] Enabling time series analysis on spark metrics Tue, 01 Mar, 22:06
Karan Kumar       Re: [Proposal] Enabling time series analysis on spark metrics Thu, 03 Mar, 17:52
Teng Liao Dataframe Partitioning Tue, 01 Mar, 23:19
Michael Armbrust   Re: Dataframe Partitioning Tue, 01 Mar, 23:43
Mark Hamstra     Re: Dataframe Partitioning Wed, 02 Mar, 00:15
yash datta       Re: Dataframe Partitioning Wed, 02 Mar, 04:30
Matt Cheah HashedRelation Memory Pressure on Broadcast Joins Wed, 02 Mar, 01:17
Davies Liu   Re: HashedRelation Memory Pressure on Broadcast Joins Wed, 02 Mar, 18:15
Matt Cheah     Re: HashedRelation Memory Pressure on Broadcast Joins Wed, 02 Mar, 18:45
Davies Liu       Re: HashedRelation Memory Pressure on Broadcast Joins Wed, 02 Mar, 22:29
Rishi Mishra         Re: HashedRelation Memory Pressure on Broadcast Joins Fri, 04 Mar, 05:11
Davies Liu           Re: HashedRelation Memory Pressure on Broadcast Joins Mon, 07 Mar, 20:26
Ewan Leith Selecting column in dataframe created with incompatible schema causes AnalysisException Wed, 02 Mar, 09:44
Michael Armbrust   Re: Selecting column in dataframe created with incompatible schema causes AnalysisException Wed, 02 Mar, 18:07
Re: Upgrading to Kafka 0.9.x
Cody Koeninger   Re: Upgrading to Kafka 0.9.x Wed, 02 Mar, 19:17
Michael Armbrust [VOTE] Release Apache Spark 1.6.1 (RC1) Wed, 02 Mar, 22:45
Mark Hamstra   Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Thu, 03 Mar, 05:39
Tim Preece   Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Thu, 03 Mar, 11:00
Tim Preece     Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Thu, 03 Mar, 12:48
Yin Yang   Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Thu, 03 Mar, 16:55
Sean Owen     Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Thu, 03 Mar, 19:16
Tim Preece       Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Thu, 03 Mar, 19:43
Sean Owen         Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Thu, 03 Mar, 19:47
Yin Yang     Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Thu, 03 Mar, 20:09
Egor Pahomov       Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Sun, 06 Mar, 20:08
Reynold Xin         Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Mon, 07 Mar, 20:39
Yin Huai           Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Tue, 08 Mar, 18:59
Andrew Or             Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Tue, 08 Mar, 18:59
Burak Yavuz               Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Tue, 08 Mar, 19:28
Kousuke Saruta                 Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Wed, 09 Mar, 15:04
Michael Armbrust                   Re: [VOTE] Release Apache Spark 1.6.1 (RC1) Wed, 09 Mar, 23:29
Sea About the exception "Received LaunchTask command but executor was null" Thu, 03 Mar, 02:44
Cody Koeninger getting a list of executors for use in getPreferredLocations Thu, 03 Mar, 23:08
Reynold Xin   Re: getting a list of executors for use in getPreferredLocations Thu, 03 Mar, 23:10
Shixiong(Ryan) Zhu     Re: getting a list of executors for use in getPreferredLocations Thu, 03 Mar, 23:15
Cody Koeninger       Re: getting a list of executors for use in getPreferredLocations Fri, 04 Mar, 01:51
Fwd: spark master ui to proxy app and worker ui
Gurvinder Singh   Fwd: spark master ui to proxy app and worker ui Fri, 04 Mar, 08:25
Gurvinder Singh     Re: Fwd: spark master ui to proxy app and worker ui Sun, 06 Mar, 14:19
Sean Owen Set up a Coverity scan for Spark Fri, 04 Mar, 10:34
Ted Yu   Re: Set up a Coverity scan for Spark Fri, 04 Mar, 12:18
Sean Owen     Re: Set up a Coverity scan for Spark Fri, 04 Mar, 12:35
Ted Yu       Re: Set up a Coverity scan for Spark Fri, 04 Mar, 14:52
Sean Owen         Re: Set up a Coverity scan for Spark Fri, 04 Mar, 15:06
Ted Yu           Re: Set up a Coverity scan for Spark Fri, 04 Mar, 15:36
Sean Owen             Re: Set up a Coverity scan for Spark Fri, 04 Mar, 15:41
Re: Mapper side join with DataFrames API
Deepak Gopalakrishnan   Re: Mapper side join with DataFrames API Fri, 04 Mar, 12:02
Deepak Gopalakrishnan     Re: Mapper side join with DataFrames API Sat, 05 Mar, 14:12
Khaled Ammar GraphX optimizations Fri, 04 Mar, 17:53
Takeshi Yamamuro   Re: GraphX optimizations Mon, 07 Mar, 03:42
Cody Koeninger Use cases for kafka direct stream messageHandler Fri, 04 Mar, 21:39
Cody Koeninger   Re: Use cases for kafka direct stream messageHandler Tue, 08 Mar, 14:49
Alan Braithwaite     Re: Use cases for kafka direct stream messageHandler Wed, 09 Mar, 19:19
Cody Koeninger       Re: Use cases for kafka direct stream messageHandler Wed, 09 Mar, 19:38
Fwd: Spark SQL drops the HIVE table in "overwrite" mode while writing into table
Dhaval Modi   Fwd: Spark SQL drops the HIVE table in "overwrite" mode while writing into table Sat, 05 Mar, 15:02
Ted Yu     Re: Spark SQL drops the HIVE table in "overwrite" mode while writing into table Sat, 05 Mar, 15:17
Dhaval Modi       Re: Spark SQL drops the HIVE table in "overwrite" mode while writing into table Sat, 05 Mar, 17:31
Eugene Morozov Typo in community databricks cloud docs Sun, 06 Mar, 00:23
Reynold Xin   Re: Typo in community databricks cloud docs Mon, 07 Mar, 20:48
Prabhu Joseph Spark Custom Partitioner not picked Sun, 06 Mar, 20:48
Hyukjin Kwon PySpark, spill-related (possibly psutil) issue, throwing an exception '_fill_function() takes exactly 4 arguments (5 given)' Mon, 07 Mar, 02:19
Hyukjin Kwon   Re: PySpark, spill-related (possibly psutil) issue, throwing an exception '_fill_function() takes exactly 4 arguments (5 given)' Mon, 07 Mar, 02:24
Shixiong(Ryan) Zhu     Re: PySpark, spill-related (possibly psutil) issue, throwing an exception '_fill_function() takes exactly 4 arguments (5 given)' Mon, 07 Mar, 06:46
Franklyn D'souza Nulls getting converted to 0 with spark 2.0 SNAPSHOT Mon, 07 Mar, 19:30
Michael Armbrust   Re: Nulls getting converted to 0 with spark 2.0 SNAPSHOT Mon, 07 Mar, 19:50
Suniti Singh Adding hive context gives error Tue, 08 Mar, 00:15
Suniti Singh   Re: Adding hive context gives error Tue, 08 Mar, 01:11
Eugene Morozov Dynamic allocation availability on standalone mode. Misleading doc. Tue, 08 Mar, 00:25
Mark Hamstra   Re: Dynamic allocation availability on standalone mode. Misleading doc. Tue, 08 Mar, 01:07
Saisai Shao     Re: Dynamic allocation availability on standalone mode. Misleading doc. Tue, 08 Mar, 01:40
Reynold Xin       Re: Dynamic allocation availability on standalone mode. Misleading doc. Tue, 08 Mar, 01:56
Josh Rosen Does anyone implement org.apache.spark.serializer.Serializer in their own code? Tue, 08 Mar, 02:57
Koert Kuipers   Re: Does anyone implement org.apache.spark.serializer.Serializer in their own code? Tue, 08 Mar, 03:22
Ted Yu   Re: Does anyone implement org.apache.spark.serializer.Serializer in their own code? Tue, 08 Mar, 04:02
Maciej Szymkiewicz ML ALS API Tue, 08 Mar, 06:20
Nick Pentreath   Re: ML ALS API Tue, 08 Mar, 09:07
Re: More Robust DataSource Parameters
Reynold Xin   Re: More Robust DataSource Parameters Tue, 08 Mar, 06:51
Jacek Laskowski BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 07:38
Reynold Xin   Re: BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 07:39
Shixiong(Ryan) Zhu     Re: BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 07:41
Jacek Laskowski       Re: BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 07:42
Jacek Laskowski         Re: BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 07:46
Dongjoon Hyun           Re: BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 07:48
Dongjoon Hyun             Re: BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 07:54
Jacek Laskowski             Re: BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 07:55
Jacek Laskowski               Re: BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 07:56
Jacek Laskowski   Re: BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 07:40
Dongjoon Hyun     Re: BUILD FAILURE due to...Unable to find configuration file at location dev/scalastyle-config.xml Tue, 08 Mar, 08:24
Praveen Devarao Spark structured streaming Tue, 08 Mar, 09:38
Jacek Laskowski   Re: Spark structured streaming Tue, 08 Mar, 10:44
Praveen Devarao     Re: Spark structured streaming Tue, 08 Mar, 11:32
Jacek Laskowski     Re: Spark structured streaming Tue, 08 Mar, 15:38
Michael Armbrust       Re: Spark structured streaming Tue, 08 Mar, 18:44
Reynold Xin Spark 2.0 high level API doc Tue, 08 Mar, 23:06
Prabhu Joseph Spark Scheduler creating Straggler Node Wed, 09 Mar, 04:17
Reynold Xin   Re: Spark Scheduler creating Straggler Node Wed, 09 Mar, 04:20
Prabhu Joseph     Re: Spark Scheduler creating Straggler Node Wed, 09 Mar, 05:52
Ioannis.Deligian...@nomura.com       RE: Spark Scheduler creating Straggler Node Wed, 09 Mar, 10:47
Ioannis.Deligian...@nomura.com     RE: Spark Scheduler creating Straggler Node Wed, 09 Mar, 10:43
Hyukjin Kwon Inconsistent file extensions and omitting file extensions written by CSV, TEXT and JSON data sources. Wed, 09 Mar, 05:49
Reynold Xin   Re: Inconsistent file extensions and omitting file extensions written by CSV, TEXT and JSON data sources. Wed, 09 Mar, 05:49
Sean Owen   Re: Inconsistent file extensions and omitting file extensions written by CSV, TEXT and JSON data sources. Wed, 09 Mar, 09:30
Hyukjin Kwon     Re: Inconsistent file extensions and omitting file extensions written by CSV, TEXT and JSON data sources. Wed, 09 Mar, 10:34
Sachin Aggarwal submissionTime vs batchTime, DirectKafka Wed, 09 Mar, 17:09
Cody Koeninger   Re: submissionTime vs batchTime, DirectKafka Wed, 09 Mar, 17:16
Sachin Aggarwal     Re: submissionTime vs batchTime, DirectKafka Wed, 09 Mar, 18:43
Cody Koeninger       Re: submissionTime vs batchTime, DirectKafka Wed, 09 Mar, 18:52
Sachin Aggarwal         Re: submissionTime vs batchTime, DirectKafka Thu, 10 Mar, 04:59
Mario Ds Briggs           Re: submissionTime vs batchTime, DirectKafka Thu, 10 Mar, 05:21
Sachin Aggarwal             Re: submissionTime vs batchTime, DirectKafka Thu, 10 Mar, 17:26
Mohammed Guller Request to add a new book to the Books section on Spark's website Wed, 09 Mar, 19:45
Sean Owen   Re: Request to add a new book to the Books section on Spark's website Wed, 09 Mar, 19:46
Michael Armbrust [RESULT] [VOTE] Release Apache Spark 1.6.1 (RC1) Thu, 10 Mar, 00:07
FangFang Chen dataframe.groupby.agg vs sql("select from groupby)") Thu, 10 Mar, 08:19
Reynold Xin   Re: dataframe.groupby.agg vs sql("select from groupby)") Thu, 10 Mar, 08:20
Renyi Xiong DynamicPartitionKafkaRDD - 1:n mapping between kafka and RDD partition Thu, 10 Mar, 19:59
Cody Koeninger   Re: DynamicPartitionKafkaRDD - 1:n mapping between kafka and RDD partition Thu, 10 Mar, 20:12
Renyi Xiong     Re: DynamicPartitionKafkaRDD - 1:n mapping between kafka and RDD partition Mon, 14 Mar, 23:16
Cody Koeninger       Re: DynamicPartitionKafkaRDD - 1:n mapping between kafka and RDD partition Tue, 15 Mar, 15:35
Michael Armbrust [ANNOUNCE] Announcing Spark 1.6.1 Thu, 10 Mar, 21:08
Matt Cheah Understanding fault tolerance in shuffle operations Thu, 10 Mar, 23:26
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
May 201999
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333