spark-user mailing list archives: August 2018

Site index · List index
Message list« Previous · 1 · 2 · 3Thread · Author · Date
Re: Structured Streaming on Kubernetes
puneetloya   Re: Structured Streaming on Kubernetes Tue, 21 Aug, 18:33
dimitris plakas Insert a pyspark dataframe in postgresql Tue, 21 Aug, 21:50
rajat mishra CBO not predicting cardinality on partition columns for Parquet tables Wed, 22 Aug, 04:15
Polisetti, Venkata Siva Rama Gopala Krishna : Failed to create file system watcher service: User limit of inotify instances reached or too many open files Wed, 22 Aug, 08:24
msbreuer How to merge multiple rows Wed, 22 Aug, 20:04
Jean Georges Perrin   Re: How to merge multiple rows Wed, 22 Aug, 20:12
Patrick McCarthy     Re: How to merge multiple rows Wed, 22 Aug, 20:32
z..@zjdex.com About the question of Spark Structured Streaming window output Thu, 23 Aug, 02:30
JF Chen How to deal with context dependent computing? Thu, 23 Aug, 02:52
Sonal Goyal   Re: How to deal with context dependent computing? Thu, 23 Aug, 10:14
JF Chen     Re: How to deal with context dependent computing? Mon, 27 Aug, 01:38
devjyoti patra       Re: How to deal with context dependent computing? Mon, 27 Aug, 10:14
Guillermo Ortiz Caching small Rdd's take really long time and Spark seems frozen Thu, 23 Aug, 13:08
Sonal Goyal   Re: Caching small Rdd's take really long time and Spark seems frozen Thu, 23 Aug, 13:28
Guillermo Ortiz     Re: Caching small Rdd's take really long time and Spark seems frozen Thu, 23 Aug, 20:43
Guillermo Ortiz       Re: Caching small Rdd's take really long time and Spark seems frozen Fri, 24 Aug, 09:56
Sonal Goyal         Re: Caching small Rdd's take really long time and Spark seems frozen Fri, 24 Aug, 10:42
Rosbrook, Andrew J Slow Query Plan Generation Fri, 24 Aug, 10:37
Kazuaki Ishizaki   Re: Slow Query Plan Generation Fri, 24 Aug, 17:11
Rosbrook, Andrew J     RE: Slow Query Plan Generation Tue, 28 Aug, 11:44
rajat mishra CBO not working for Parquet Files Fri, 24 Aug, 15:11
Great Info Handling Very Large volume(500TB) data using spark Sat, 25 Aug, 02:54
崔苗 Fw:multiple group by action Sat, 25 Aug, 02:55
Reynold Xin   Re: Fw:multiple group by action Sat, 25 Aug, 03:15
sherif98 Spark Structured Streaming using S3 as data source Sun, 26 Aug, 09:22
Burak Yavuz   Re: Spark Structured Streaming using S3 as data source Sun, 26 Aug, 22:11
Sherif Hamdy     Re: Spark Structured Streaming using S3 as data source Mon, 27 Aug, 06:19
Re: About the question of Spark Structured Streaming window output
Gerard Maas   Re: About the question of Spark Structured Streaming window output Sun, 26 Aug, 21:00
Jungtaek Lim     Re: Re: About the question of Spark Structured Streaming window output Mon, 27 Aug, 03:01
Gerard Maas       Re: Re: About the question of Spark Structured Streaming window output Mon, 27 Aug, 09:26
z..@zjdex.com   Re: Re: About the question of Spark Structured Streaming window output Mon, 27 Aug, 02:55
z..@zjdex.com   Re: Re: About the question of Spark Structured Streaming window output Mon, 27 Aug, 03:36
z..@zjdex.com   Re: Re: About the question of Spark Structured Streaming window output Mon, 27 Aug, 10:32
zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn Mon, 27 Aug, 03:19
Bang Xiao How to use 'insert overwrite [local] directory' correctly? Mon, 27 Aug, 07:33
Bang Xiao   Re: How to use 'insert overwrite [local] directory' correctly? Mon, 27 Aug, 08:10
Bang Xiao   Re: How to use 'insert overwrite [local] directory' correctly? Mon, 27 Aug, 09:46
Xiao Li     Re: How to use 'insert overwrite [local] directory' correctly? Mon, 27 Aug, 15:43
Patrick McCarthy Pitfalls of partitioning by host? Mon, 27 Aug, 17:22
Michael Artz   Re: Pitfalls of partitioning by host? Tue, 28 Aug, 02:11
Patrick McCarthy     Re: Pitfalls of partitioning by host? Tue, 28 Aug, 14:28
Patrick McCarthy       Re: Pitfalls of partitioning by host? Tue, 28 Aug, 14:29
Patrick McCarthy     Re: Pitfalls of partitioning by host? Tue, 28 Aug, 14:31
Patrick McCarthy     Re: Pitfalls of partitioning by host? Tue, 28 Aug, 14:56
Patrick McCarthy     Re: Pitfalls of partitioning by host? Tue, 28 Aug, 14:59
Patrick McCarthy     Re: Pitfalls of partitioning by host? Tue, 28 Aug, 14:59
Sonal Goyal       Re: Pitfalls of partitioning by host? Tue, 28 Aug, 17:03
Patrick McCarthy         Re: Pitfalls of partitioning by host? Tue, 28 Aug, 18:06
Patrick McCarthy           Re: Pitfalls of partitioning by host? Tue, 28 Aug, 18:09
Jayesh Lalwani   Re: [External Sender] Pitfalls of partitioning by host? Tue, 28 Aug, 17:22
kant kodali How do I generate current UTC timestamp in raw spark sql? Tue, 28 Aug, 09:03
Nikita Goyal   Re: How do I generate current UTC timestamp in raw spark sql? Tue, 28 Aug, 09:53
Aakash Basu RDD Collect Issue Tue, 28 Aug, 12:08
Aakash Basu Which Py4J version goes with Spark 2.3.1? Wed, 29 Aug, 06:59
Gourav Sengupta   Re: Which Py4J version goes with Spark 2.3.1? Wed, 29 Aug, 13:02
Guillermo Ortiz Fernández Spark Streaming - Kafka. java.lang.IllegalStateException: This consumer has already been closed. Wed, 29 Aug, 07:10
Cody Koeninger   Re: Spark Streaming - Kafka. java.lang.IllegalStateException: This consumer has already been closed. Wed, 29 Aug, 20:28
Guillermo Ortiz Fernández     Re: Spark Streaming - Kafka. java.lang.IllegalStateException: This consumer has already been closed. Wed, 29 Aug, 20:40
Cody Koeninger       Re: Spark Streaming - Kafka. java.lang.IllegalStateException: This consumer has already been closed. Thu, 30 Aug, 19:00
Guillermo Ortiz Fernández java.lang.OutOfMemoryError: Java heap space - Spark driver. Wed, 29 Aug, 08:38
Swapnil Chougule Spark udf from external jar without enabling Hive Wed, 29 Aug, 10:42
jeevan.ks Parallelism: behavioural difference in version 1.2 and 2.1!? Wed, 29 Aug, 13:55
Apostolos N. Papadopoulos   Re: Parallelism: behavioural difference in version 1.2 and 2.1!? Wed, 29 Aug, 14:06
Jeevan K. Srivatsa     Re: Parallelism: behavioural difference in version 1.2 and 2.1!? Wed, 29 Aug, 14:40
ryanda...@gmail.com Spark code to write to MySQL and Hive Wed, 29 Aug, 14:49
ryanda...@gmail.com   RE: Spark code to write to MySQL and Hive Wed, 29 Aug, 14:59
Jacek Laskowski     Re: Spark code to write to MySQL and Hive Wed, 29 Aug, 15:26
ryanda...@gmail.com       RE: Spark code to write to MySQL and Hive Wed, 29 Aug, 17:42
Sonal Goyal         Re: Spark code to write to MySQL and Hive Thu, 30 Aug, 06:25
yxchen Is there a plan for official spark-avro/spark-orc read/write library using Data Source V2 Wed, 29 Aug, 20:59
N B DStream reduceByKeyAndWindow not using checkpointed data for inverse reducing old data Wed, 29 Aug, 23:16
monohusche Long term arbitrary stateful processing - best practices Thu, 30 Aug, 02:37
sherif98 Spark Structured Streaming checkpointing with S3 data source Thu, 30 Aug, 11:32
Evelyn Bayes Default Java Opts Standalone Thu, 30 Aug, 11:42
Sonal Goyal   Re: Default Java Opts Standalone Thu, 30 Aug, 17:23
Lian Jiang spark structured streaming jobs working in HDP2.6 fail in HDP3.0 Thu, 30 Aug, 15:59
Lian Jiang   Re: spark structured streaming jobs working in HDP2.6 fail in HDP3.0 Thu, 30 Aug, 17:18
Lian Jiang     Re: spark structured streaming jobs working in HDP2.6 fail in HDP3.0 Thu, 30 Aug, 20:32
Bryan Jeffrey ConcurrentModificationExceptions with CachedKafkaConsumers Thu, 30 Aug, 17:27
Cody Koeninger   Re: ConcurrentModificationExceptions with CachedKafkaConsumers Thu, 30 Aug, 18:56
Bryan Jeffrey     Re: ConcurrentModificationExceptions with CachedKafkaConsumers Fri, 31 Aug, 13:55
Cody Koeninger       Re: ConcurrentModificationExceptions with CachedKafkaConsumers Fri, 31 Aug, 15:56
Bryan Jeffrey         Re: ConcurrentModificationExceptions with CachedKafkaConsumers Fri, 31 Aug, 16:56
Guillermo Ortiz Local mode vs client mode with one executor Thu, 30 Aug, 21:00
Nirav Patel CSV parser - how to parse column containing json data Thu, 30 Aug, 23:19
Brandon Geise   Re: CSV parser - how to parse column containing json data Fri, 31 Aug, 00:29
Ramaswamy, Muthuraman Structured Streaming : Custom Source and Sink Development and PySpark. Fri, 31 Aug, 01:23
Russell Spitzer   Re: Structured Streaming : Custom Source and Sink Development and PySpark. Fri, 31 Aug, 03:23
崔苗 is spark TempView thread safe Fri, 31 Aug, 06:50
Swapnil Chougule Type change support in spark parquet read-write Fri, 31 Aug, 09:32
Ricky read snappy compressed files in spark Fri, 31 Aug, 10:35
Message list« Previous · 1 · 2 · 3Thread · Author · Date
Box list
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137