spark-user mailing list archives: August 2019

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
大啊 Re:unresolved operator union in Spark 1.6 Tue, 20 Aug, 11:18
马阳阳 unresolved operator union in Spark 1.6 Tue, 20 Aug, 11:16
☼ R Nair Re: JDK11 Support in Apache Spark Sat, 24 Aug, 17:57
霍战锋 Sreate temp table or view by using location Tue, 13 Aug, 12:00
霍战锋 Re: Sreate temp table or view by using location Tue, 13 Aug, 12:03
霍战锋 Re: Sreate temp table or view by using location Wed, 14 Aug, 02:17
马阳阳 Unresolved operator Union in Spark 1.6 Tue, 20 Aug, 10:06
刘 勇 Re: spark stream kafka wait for all data process done Fri, 02 Aug, 02:37
Jörn Franke Re: Hive external table not working in sparkSQL when subdirectories are present Wed, 07 Aug, 07:13
Jörn Franke Re: Spark scala/Hive scenario Wed, 07 Aug, 19:32
Jörn Franke Re: Any advice how to do this usecase in spark sql ? Wed, 14 Aug, 05:08
Jörn Franke Re: Will this use-case can be handled with spark-sql streaming and cassandra? Thu, 29 Aug, 20:14
Aayush Ranaut Re: Will this use-case can be handled with spark-sql streaming and cassandra? Thu, 29 Aug, 11:33
Aayush Ranaut Re: Will this use-case can be handled with spark-sql streaming and cassandra? Thu, 29 Aug, 20:04
Alex Landa Spark Standalone - Failing to pass extra java options to the driver in cluster mode Mon, 19 Aug, 18:42
Alex Landa Re: Spark Standalone - Failing to pass extra java options to the driver in cluster mode Tue, 20 Aug, 05:28
Alex Landa Re: How to combine all rows into a single row in DataFrame Tue, 20 Aug, 05:41
Alexander Czech GraphFrames cluster staling with a large dataset and pyspark Mon, 26 Aug, 10:23
Alexander Czech How to Load a Graphx Graph from a parquet file? Thu, 29 Aug, 08:44
Amit Sharma spark job getting hang Mon, 05 Aug, 20:16
Amit Sharma Spark Streaming concurrent calls Tue, 13 Aug, 14:53
Amit Sharma Re: Memory Limits error Fri, 16 Aug, 11:16
Andrew Leverentz Custom aggregations: modular and lightweight solutions? Tue, 13 Aug, 00:31
Andrew Leverentz Re: Custom aggregations: modular and lightweight solutions? Tue, 13 Aug, 19:59
Antoine DUBOIS Spark and ZStandard Mon, 19 Aug, 15:38
Artem Kozhevnikov question about pyarrow.Table to pyspark.DataFrame conversion Wed, 28 Aug, 02:55
Arwin Tio Creating custom Spark-Native catalyst/codegen functions Thu, 22 Aug, 02:27
Arwin Tio Re: Creating custom Spark-Native catalyst/codegen functions Thu, 22 Aug, 07:50
Arwin Tio In Catalyst expressions, when is it appropriate to use codegen Thu, 29 Aug, 09:07
Aziret Satybaldiev Re: Questions for platform to choose Wed, 21 Aug, 08:44
Bryan Jeffrey Driver - Stops Scheduling Streaming Jobs Tue, 27 Aug, 17:43
Chetan Khatri Control Sqoop job from Spark job Thu, 29 Aug, 20:01
Chetan Khatri Re: Control Sqoop job from Spark job Thu, 29 Aug, 20:02
Chris Teoh Re: Reading configuration file in Spark Scala throws error Sun, 04 Aug, 00:55
Chris Teoh Re: [pyspark 2.4.3] small input csv ~3.4GB gets 40K tasks created Sat, 31 Aug, 02:33
Chris Teoh Re: Control Sqoop job from Spark job Sat, 31 Aug, 02:36
Cressy, Taylor Blue-Green Deployment of Structured Streaming Tue, 27 Aug, 15:52
DB Tsai Re: Release Apache Spark 2.4.4 Tue, 13 Aug, 23:24
DB Tsai Re: JDK11 Support in Apache Spark Sat, 24 Aug, 17:39
Daniel Zhang EMR Spark 2.4.3 executor hang Fri, 30 Aug, 14:14
Darshan Pandya Re: Stream is corrupted in ShuffleBlockFetcherIterator Wed, 28 Aug, 00:44
Debabrata Ghosh Unable to write data from Spark into a Hive Managed table Fri, 09 Aug, 11:04
Deepak Sharma Re: PGP Encrypt using spark Scala Mon, 26 Aug, 15:41
Dennis Suhari Re: Spark and Oozie Mon, 05 Aug, 16:03
Dennis Suhari Memory Limits error Thu, 15 Aug, 15:21
Dongjoon Hyun Release Apache Spark 2.4.4 Tue, 13 Aug, 23:16
Dongjoon Hyun Re: Release Apache Spark 2.4.4 Wed, 14 Aug, 21:36
Dongjoon Hyun JDK11 Support in Apache Spark Sat, 24 Aug, 15:11
Dongjoon Hyun [VOTE][RESULT] Spark 2.4.4 (RC3) Sat, 31 Aug, 00:14
ERIC JOEL BLANCO-HERMIDA SANZ Unsubscribe Tue, 20 Aug, 11:19
Eliza Questions for platform to choose Wed, 21 Aug, 06:35
Eliza Re: Questions for platform to choose Wed, 21 Aug, 08:53
Eliza Re: Questions for platform to choose Wed, 21 Aug, 09:10
Felix Cheung Re: JDK11 Support in Apache Spark Sat, 24 Aug, 19:17
Femi Anthony Re: [External Sender] Execute Spark model without Spark Thu, 22 Aug, 17:56
Georg Heiler Re: Creating custom Spark-Native catalyst/codegen functions Thu, 22 Aug, 06:18
Georg Heiler Re: Creating custom Spark-Native catalyst/codegen functions Thu, 22 Aug, 12:51
Girish bhat m Re: How to get logging right for Spark applications in the YARN ecosystem Fri, 02 Aug, 10:17
Gourav Sengupta Re: [Pyspark 2.4] not able to partition the data frame by dates Thu, 01 Aug, 02:58
Gourav Sengupta Re: Announcing Delta Lake 0.3.0 Fri, 02 Aug, 16:42
Gourav Sengupta Re: How to programmatically pause and resume Spark/Kafka structured streaming? Tue, 06 Aug, 05:53
Gourav Sengupta Re: How to programmatically pause and resume Spark/Kafka structured streaming? Wed, 07 Aug, 05:32
Gourav Sengupta Re: Spark SQL reads all leaf directories on a partitioned Hive table Thu, 08 Aug, 11:23
Gourav Sengupta Re: Spark streaming dataframe extract message to new columns Mon, 12 Aug, 12:51
HARSH TAKKAR Re: Unable to write data from Spark into a Hive Managed table Tue, 20 Aug, 11:00
Hao Ren Spark SQL reads all leaf directories on a partitioned Hive table Wed, 07 Aug, 14:27
Hao Ren Fwd: Spark SQL reads all leaf directories on a partitioned Hive table Thu, 08 Aug, 14:16
Hao Ren Re: Spark SQL reads all leaf directories on a partitioned Hive table Fri, 09 Aug, 10:48
Hao Ren Re: Spark SQL reads all leaf directories on a partitioned Hive table Wed, 14 Aug, 10:07
Hichame El Khalfi Re: JDK11 Support in Apache Spark Mon, 26 Aug, 04:01
Holden Karau Re: Release Apache Spark 2.4.4 Wed, 14 Aug, 04:51
Holden Karau Re: Release Apache Spark 2.4.4 Wed, 14 Aug, 16:13
Hyukjin Kwon Re: Release Apache Spark 2.4.4 Wed, 14 Aug, 00:20
Hyukjin Kwon Re: Continuous processing mode and python udf Wed, 14 Aug, 05:00
Hyukjin Kwon Re: Release Apache Spark 2.4.4 Wed, 14 Aug, 06:58
Imran Rashid CVE-2019-10099: Apache Spark unencrypted data on local disk Tue, 06 Aug, 15:17
Information Technologies unsubscribe Tue, 06 Aug, 20:59
Information Technologies unsubscribe Tue, 06 Aug, 22:20
Isabelle Phan Read ORC file with subset of schema Fri, 30 Aug, 19:02
Jerry Yan Low cache hit ratio when running Spark on Alluxio Wed, 28 Aug, 08:48
Julien Laurenceau Re: error while connecting to azure blob storage Fri, 23 Aug, 15:05
Jungtaek Lim Re: Spark Standalone - Failing to pass extra java options to the driver in cluster mode Mon, 19 Aug, 19:01
Kazuaki Ishizaki RE: Release Apache Spark 2.4.4 Wed, 14 Aug, 03:47
Kazuaki Ishizaki Release Spark 2.3.4 Fri, 16 Aug, 14:48
Kazuaki Ishizaki RE: Release Spark 2.3.4 Thu, 22 Aug, 16:52
Krishna Chandran Nair RE: error while connecting to azure blob storage Fri, 23 Aug, 06:33
Krishna Chandran Nair RE: [External]Re: error while connecting to azure blob storage Fri, 23 Aug, 08:08
Krishna Chandran Nair RE: [External]Re: error while connecting to azure blob storage Fri, 23 Aug, 19:09
Kushagra Deep Cogrouping in Streaming Datasets/DataFrames is not supported ? Fri, 23 Aug, 08:04
Liam Clarke-Hutchinson Re: Questions for platform to choose Thu, 22 Aug, 23:06
Magnus Nilsson Re: Questions for platform to choose Wed, 21 Aug, 09:46
Marcelo Valle help understanding physical plan Tue, 13 Aug, 14:45
Marcelo Valle Re: help understanding physical plan Fri, 16 Aug, 09:16
Marcin Tustin Re: How to combine all rows into a single row in DataFrame Mon, 19 Aug, 20:35
Mark Zhao What is directory "/path/_spark_metadata" for? Wed, 28 Aug, 08:59
Mayank Agarwal test Fri, 23 Aug, 07:34
Mich Talebzadeh Reading configuration file in Spark Scala throws error Sat, 03 Aug, 19:28
Mich Talebzadeh Re: Reading configuration file in Spark Scala throws error Sun, 04 Aug, 21:32
Mich Talebzadeh Re: Reading configuration file in Spark Scala throws error Mon, 05 Aug, 00:01
Mich Talebzadeh Re: Hive external table not working in sparkSQL when subdirectories are present Tue, 06 Aug, 07:33
Message list1 · 2 · Next »Thread · Author · Date
Box list
Oct 201959
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137