spark-user mailing list archives: March 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Apache Spark Structured Streaming - How to keep executor alive.
M Singh   Apache Spark Structured Streaming - How to keep executor alive. Fri, 23 Mar, 16:19
Re:Re: how to use lit() in spark-java
崔苗   Re:Re: how to use lit() in spark-java Mon, 26 Mar, 02:32
崔苗   Re:Re: how to use lit() in spark-java Mon, 26 Mar, 02:32
the issue about the + in column,can we support the string please?
1427357...@qq.com   the issue about the + in column,can we support the string please? Mon, 26 Mar, 03:36
Shmuel Blitz   Re: the issue about the + in column,can we support the string please? Mon, 26 Mar, 07:31
Shmuel Blitz     Re: Re: the issue about the + in column,can we support the string please? Mon, 26 Mar, 09:17
1427357...@qq.com   Re: Re: the issue about the + in column,can we support the string please? Mon, 26 Mar, 07:57
KMeans Clustering result differs for 2 datasets with identical 'features'
Amlan Jyoti   KMeans Clustering result differs for 2 datasets with identical 'features' Mon, 26 Mar, 07:14
Amlan Jyoti   KMeans Clustering result differs for 2 datasets with identical 'features' Mon, 26 Mar, 12:30
李斌松 spark 2.3 dataframe join bug Mon, 26 Mar, 13:18
kant kodali What do I need to set to see the number of records and processing time for each batch in SPARK UI? Mon, 26 Mar, 14:10
kant kodali   Re: What do I need to set to see the number of records and processing time for each batch in SPARK UI? Tue, 27 Mar, 06:26
Fawze Abujaber Spark logs compression Mon, 26 Mar, 16:17
Marcelo Vanzin   Re: Spark logs compression Mon, 26 Mar, 16:53
Fawze Abujaber     Re: Spark logs compression Mon, 26 Mar, 17:02
Marcelo Vanzin       Re: Spark logs compression Mon, 26 Mar, 17:05
Fawze Abujaber         Re: Spark logs compression Mon, 26 Mar, 17:10
Marcelo Vanzin           Re: Spark logs compression Mon, 26 Mar, 17:12
Fawze Abujaber             Re: Spark logs compression Mon, 26 Mar, 17:48
Marcelo Vanzin               Re: Spark logs compression Mon, 26 Mar, 17:56
Fawze Abujaber                 Re: Spark logs compression Mon, 26 Mar, 18:01
Marcelo Vanzin                   Re: Spark logs compression Mon, 26 Mar, 18:04
Gauthier Feuillen Local dirs Mon, 26 Mar, 20:08
Marcelo Vanzin   Re: Local dirs Mon, 26 Mar, 20:09
Gauthier Feuillen     Re: Local dirs Mon, 26 Mar, 20:10
Nikhil Goyal Class cast exception while using Data Frames Mon, 26 Mar, 20:39
Gauthier Feuillen   Re: Class cast exception while using Data Frames Mon, 26 Mar, 20:41
Nikhil Goyal     Re: Class cast exception while using Data Frames Mon, 26 Mar, 21:55
Shmuel Blitz       Re: Class cast exception while using Data Frames Tue, 27 Mar, 06:51
Nikhil Goyal         Re: Class cast exception while using Data Frames Tue, 27 Mar, 17:31
Josh Goldsborough [Spark R]: Linear Mixed-Effects Models in Spark R Mon, 26 Mar, 20:46
Jörn Franke   Re: [Spark R]: Linear Mixed-Effects Models in Spark R Mon, 26 Mar, 21:23
Nisha Muktewar   Re: [Spark R]: Linear Mixed-Effects Models in Spark R Mon, 26 Mar, 21:27
Felix Cheung   Re: [Spark R]: Linear Mixed-Effects Models in Spark R Tue, 27 Mar, 04:18
Shuxin Yang how to kill application Tue, 27 Mar, 05:17
unsubscribe
Mikhail Ibraheem   unsubscribe Tue, 27 Mar, 06:41
Nicholas Sharkey   unsubscribe Tue, 27 Mar, 19:15
Romero, Saul     Re: unsubscribe Tue, 27 Mar, 19:22
Andrei Balici   unsubscribe Tue, 27 Mar, 21:20
purna pradeep   unsubscribe Thu, 29 Mar, 01:31
Junfeng Chen Queries with streaming sources must be executed with writeStream.start();; Tue, 27 Mar, 07:37
崔苗 java spark udf error Tue, 27 Mar, 09:10
Jeremy Liu [Spark R] Proposal: Exposing RBackend in RRunner Tue, 27 Mar, 17:04
Jenna Hoole Spark on K8s resource staging server timeout Tue, 27 Mar, 17:48
Jenna Hoole   Re: Spark on K8s resource staging server timeout Thu, 29 Mar, 17:36
Matt Cheah     Re: Spark on K8s resource staging server timeout Thu, 29 Mar, 20:26
Jenna Hoole       Re: Spark on K8s resource staging server timeout Thu, 29 Mar, 20:44
Ramaswamy, Muthuraman PySpark Structured Streaming : Writing to DB in Python and Foreach Sink. Tue, 27 Mar, 20:12
Gourav Sengupta closure issues: wholeTextFiles Tue, 27 Mar, 22:58
Dongjoon Hyun Re: ORC native in Spark 2.3, with zlib, gives java.nio.BufferUnderflowException during read Wed, 28 Mar, 01:00
Eirik Thorsnes   ORC native in Spark 2.3, with zlib, gives java.nio.BufferUnderflowException during read Fri, 23 Mar, 15:03
Xiao Li     Re: ORC native in Spark 2.3, with zlib, gives java.nio.BufferUnderflowException during read Tue, 27 Mar, 23:13
Dongjoon Hyun     Re: ORC native in Spark 2.3, with zlib, gives java.nio.BufferUnderflowException during read Wed, 28 Mar, 01:26
Mina Aslani java.lang.UnsupportedOperationException: CSV data source does not support struct/ERROR RetryingBlockFetcher Wed, 28 Mar, 02:46
naresh Goud   Re: java.lang.UnsupportedOperationException: CSV data source does not support struct/ERROR RetryingBlockFetcher Wed, 28 Mar, 02:51
Mina Aslani     Re: java.lang.UnsupportedOperationException: CSV data source does not support struct/ERROR RetryingBlockFetcher Wed, 28 Mar, 04:22
Yong Zhang       Re: java.lang.UnsupportedOperationException: CSV data source does not support struct/ERROR RetryingBlockFetcher Wed, 28 Mar, 12:14
Jiří Syrový         Re: java.lang.UnsupportedOperationException: CSV data source does not support struct/ERROR RetryingBlockFetcher Wed, 28 Mar, 12:20
Junfeng Chen [Spark Java] Add new column in DataSet based on existed column Wed, 28 Mar, 07:16
Divya Gehlot   Re: [Spark Java] Add new column in DataSet based on existed column Wed, 28 Mar, 07:24
Guillermo Ortiz Testing with spark-base-test Wed, 28 Mar, 11:08
Jone Zhang SparkStraming job break with shuffle file not found Wed, 28 Mar, 12:21
Lucas Kacher   Re: SparkStraming job break with shuffle file not found Wed, 28 Mar, 13:24
Apache Spark - Structured Streaming StreamExecution Stats Description
M Singh   Apache Spark - Structured Streaming StreamExecution Stats Description Wed, 28 Mar, 17:10
Sergey Zhemzhitsky DataFrames :: Corrupted Data Wed, 28 Mar, 18:25
Jörn Franke   Re: DataFrames :: Corrupted Data Wed, 28 Mar, 19:31
Sergey Zhemzhitsky     Re: DataFrames :: Corrupted Data Wed, 28 Mar, 21:04
Colin Williams spark-sql importing schemas from catalogString or schema.toString() Wed, 28 Mar, 21:32
Colin Williams   Re: spark-sql importing schemas from catalogString or schema.toString() Wed, 28 Mar, 22:25
Colin Williams     Re: spark-sql importing schemas from catalogString or schema.toString() Thu, 29 Mar, 00:10
Colin Williams       Re: spark-sql importing schemas from catalogString or schema.toString() Thu, 29 Mar, 00:11
Apache Spark - Structured Streaming State Management With Watermark
M Singh   Apache Spark - Structured Streaming State Management With Watermark Wed, 28 Mar, 22:15
purna pradeep Unsubscribe Wed, 28 Mar, 23:53
Tin Vu [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Thu, 29 Mar, 00:03
Jörn Franke   Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Thu, 29 Mar, 05:33
Tin Vu     Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Thu, 29 Mar, 05:38
Lalwani, Jayesh   Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Thu, 29 Mar, 14:44
Tin Vu     Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Thu, 29 Mar, 14:46
Lalwani, Jayesh       Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Thu, 29 Mar, 15:02
Gourav Sengupta   Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Sat, 31 Mar, 18:41
Tin Vu     Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Sat, 31 Mar, 18:47
Sunitha Chennareddy Unable to get results of intermediate dataset Thu, 29 Mar, 03:05
Lalwani, Jayesh [Structured Streaming] Kafka Sink in Spark 2.3 Thu, 29 Mar, 11:01
Aakash Basu [Query] Columnar transformation without Structured Streaming Thu, 29 Mar, 12:41
Vitaliy Pisarev Why doesn't spark use broadcast join? Thu, 29 Mar, 12:41
Lalwani, Jayesh   Re: Why doesn't spark use broadcast join? Thu, 29 Mar, 14:54
Vitaliy Pisarev Best practices for optimizing the structure of parquet schema Thu, 29 Mar, 12:54
Sidney Feiner Stopping StreamingContext Thu, 29 Mar, 14:27
Kevin Peng spark jdbc postgres query results don't match those of postgres query Thu, 29 Mar, 15:04
Shuporno Choudhury Multiple columns using 'isin' command in pyspark Thu, 29 Mar, 15:52
karthikjay Writing record once after the watermarking interval in Spark Structured Streaming Fri, 30 Mar, 00:10
Bowden, Chris   Re: Writing record once after the watermarking interval in Spark Structured Streaming Fri, 30 Mar, 01:17
Young Why fetchSize should be bigger than 0 in JDBCOptions.scala? Fri, 30 Mar, 07:43
ahmed alobaidi [Structured Streaming] HDFSBackedStateStoreProvider OutOfMemoryError Fri, 30 Mar, 15:59
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Nov 2021148
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137