spark-user mailing list archives: December 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · Next »Thread · Author · Date
Andrew Old Dataset experimental interfaces Tue, 18 Dec, 20:54
Priya Matpadi Re: How to update structured streaming apps gracefully Tue, 18 Dec, 21:18
vincent gromakowski Re: How to update structured streaming apps gracefully Wed, 19 Dec, 00:09
Yuta Morisawa Re: How to update structured streaming apps gracefully Wed, 19 Dec, 01:00
jiaan.geng Re: Read Time from a remote data source Wed, 19 Dec, 03:27
Sam Elamin Re: Spark Scala reading from Google Cloud BigQuery table throws error Wed, 19 Dec, 08:36
Jean Georges Perrin Multiple sessions in one application? Wed, 19 Dec, 11:12
Jiaan Geng Re: Spark 2.2.1 - Operation not allowed: alter table replace columns Wed, 19 Dec, 11:15
Rishabh Pugalia Spark Kafka Streaming with Offset Gaps Wed, 19 Dec, 11:40
Rishabh Pugalia Spark Kafka Streaming with Offset Gaps Wed, 19 Dec, 11:46
Kamil Krzysztof Krynicki [Spark Core] Support for parquet column indexes Wed, 19 Dec, 13:09
Daniel O' Shaughnessy [No Subject] Wed, 19 Dec, 13:59
swastik mittal Re: Read Time from a remote data source Wed, 19 Dec, 15:39
Mich Talebzadeh Re: Spark Scala reading from Google Cloud BigQuery table throws error Wed, 19 Dec, 17:08
Xiangrui Meng Re: question about barrier execution mode in Spark 2.4.0 Wed, 19 Dec, 17:21
Pola Yao Fwd: Train multiple machine learning models in parallel Wed, 19 Dec, 23:55
李斌松 [Spark SQL]use zstd, No enum constant parquet.hadoop.metadata.CompressionCodecName.ZSTD Thu, 20 Dec, 03:38
Jiaan Geng Re: Read Time from a remote data source Thu, 20 Dec, 03:49
Abhijeet Kumar Spark not working with Hadoop 4mc compression Thu, 20 Dec, 06:03
l...@china-inv.cn [SPARK SQL] Difference between 'Hive on spark' and Spark SQL Thu, 20 Dec, 07:17
Jörn Franke Re: [SPARK SQL] Difference between 'Hive on spark' and Spark SQL Thu, 20 Dec, 08:34
Mich Talebzadeh Re: Spark job on dataproc failing with Exception in thread "main" java.lang.NoSuchMethodError: com.googl Thu, 20 Dec, 10:40
Muthu Jayakumar Re: Spark job on dataproc failing with Exception in thread "main" java.lang.NoSuchMethodError: com.googl Thu, 20 Dec, 13:48
Steven Stetzler Re: Problem running Spark on Kubernetes: Certificate error Thu, 20 Dec, 15:13
Cheikh_SOW [Spark cluster standalone v2.4.0] - problems with reverse proxy functionnality regarding submitted applications in cluster mode and the spark history server ui Thu, 20 Dec, 16:42
prosp4300 Custom Metric Sink on Executor Always ClassNotFound Thu, 20 Dec, 21:47
Marcelo Vanzin Re: Custom Metric Sink on Executor Always ClassNotFound Thu, 20 Dec, 21:53
Gourav Sengupta running updates using SPARK Thu, 20 Dec, 22:05
prosp4300 Re:Re: Custom Metric Sink on Executor Always ClassNotFound Fri, 21 Dec, 01:08
Jiaan Geng Re: Multiple sessions in one application? Fri, 21 Dec, 02:02
Jiaan Geng Re: running updates using SPARK Fri, 21 Dec, 03:36
Jiaan Geng Re: [Spark SQL]use zstd, No enum constant parquet.hadoop.metadata.CompressionCodecName.ZSTD Fri, 21 Dec, 04:07
Jiaan Geng Re: Spark not working with Hadoop 4mc compression Fri, 21 Dec, 04:18
大啊 Re:Re: [Spark SQL]use zstd, No enum constant parquet.hadoop.metadata.CompressionCodecName.ZSTD Fri, 21 Dec, 06:18
大啊 Re:running updates using SPARK Fri, 21 Dec, 06:20
Aakash Basu Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 06:28
Shuporno Choudhury Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 07:21
Aakash Basu Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 07:50
Shuporno Choudhury Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 08:13
Aakash Basu Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 08:51
Gourav Sengupta Re: running updates using SPARK Fri, 21 Dec, 08:55
Aakash Basu Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 12:17
Riccardo Ferrari Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 12:33
Aakash Basu Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 13:46
ddebarbieux Spark 2 - How to order keys in sparse vector (K-means)? Fri, 21 Dec, 14:15
Thakrar, Jayesh Re: Custom Metric Sink on Executor Always ClassNotFound Fri, 21 Dec, 14:34
Riccardo Ferrari Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 15:09
☼ R Nair Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 15:36
Akshay Mendole Spark executors exceeding heap space allocated Fri, 21 Dec, 15:47
Aakash Basu Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 16:23
shyla deshpande java.lang.NumberFormatException: Not a version: 9 after I add spark.cassandra.connection.host property to Spark Interpreter Fri, 21 Dec, 20:22
Mark Hamstra Re: Multiple sessions in one application? Fri, 21 Dec, 21:33
Ascot Moss Powered By Spark Sat, 22 Dec, 08:13
JiaTao Tao Async action in Dataframe Sat, 22 Dec, 08:47
JiaTao Tao About LocalProperty in sqlConf Sat, 22 Dec, 09:16
shyla deshpande Connecting to Cassandra from Zeppelin on EMR cluster Sat, 22 Dec, 16:02
Gezim Sejdiu Re: Connecting to Cassandra from Zeppelin on EMR cluster Sat, 22 Dec, 19:41
大啊 Re:Re: running updates using SPARK Mon, 24 Dec, 02:17
Jiaan Geng Re: Async action in Dataframe Mon, 24 Dec, 03:36
Gourav Sengupta Re: Connection issue with AWS S3 from PySpark 2.3.1 Mon, 24 Dec, 14:22
Gaurav Gupta Getting FileNotFoundException and LeaseExpired Exception while writing a df to hdfs path Mon, 24 Dec, 20:04
Colin Williams Packaging kafka certificates in uber jar Mon, 24 Dec, 20:29
Bin Fan Re: Questions about caching Tue, 25 Dec, 05:20
Akshay Mendole spark application takes significant some time to succeed even after all jobs are completed Tue, 25 Dec, 11:51
Akshay Mendole Tuning G1GC params for aggressive garbage collection? Tue, 25 Dec, 11:57
Jörn Franke Re: spark application takes significant some time to succeed even after all jobs are completed Tue, 25 Dec, 12:00
Akshay Mendole Re: spark application takes significant some time to succeed even after all jobs are completed Tue, 25 Dec, 12:08
Jörn Franke Re: spark application takes significant some time to succeed even after all jobs are completed Tue, 25 Dec, 12:47
Anastasios Zouzias Re: Packaging kafka certificates in uber jar Tue, 25 Dec, 13:26
Ramandeep Singh Nanda Re: Tuning G1GC params for aggressive garbage collection? Tue, 25 Dec, 17:57
shyla deshpande Re: How to clean up logs-dirs and local-dirs of running spark streaming in yarn cluster mode Tue, 25 Dec, 23:05
Akshay Mendole Re: Tuning G1GC params for aggressive garbage collection? Wed, 26 Dec, 02:11
Fawze Abujaber Re: How to clean up logs-dirs and local-dirs of running spark streaming in yarn cluster mode Wed, 26 Dec, 03:26
Debajyoti Roy Spark Dataset transformations for time based events Wed, 26 Dec, 07:34
Colin Williams Re: Packaging kafka certificates in uber jar Wed, 26 Dec, 12:16
shyla deshpande Re: How to clean up logs-dirs and local-dirs of running spark streaming in yarn cluster mode Wed, 26 Dec, 18:14
Colin Williams Corrupt record handling in spark structured streaming and from_json function Wed, 26 Dec, 21:55
Colin Williams Re: Corrupt record handling in spark structured streaming and from_json function Wed, 26 Dec, 22:42
Colin Williams Re: Corrupt record handling in spark structured streaming and from_json function Thu, 27 Dec, 02:01
Nicolas Paris jdbc spark streaming Thu, 27 Dec, 22:52
大啊 Re:jdbc spark streaming Fri, 28 Dec, 02:29
FengYu Cao How do you set POSIX rlimit on mesos Fri, 28 Dec, 03:04
em...@yeikel.com What are the alternatives to nested DataFrames? Fri, 28 Dec, 07:40
Shashikant Bangera Spark Kinesis Connector SSL issue Fri, 28 Dec, 14:13
Shahab Yunus Re: What are the alternatives to nested DataFrames? Fri, 28 Dec, 17:33
Thakrar, Jayesh Re: jdbc spark streaming Fri, 28 Dec, 17:41
Nicolas Paris Re: jdbc spark streaming Fri, 28 Dec, 20:06
em...@yeikel.com RE: What are the alternatives to nested DataFrames? Sat, 29 Dec, 00:35
Andrew Melo Re: What are the alternatives to nested DataFrames? Sat, 29 Dec, 01:47
大啊 Re:Re: Async action in Dataframe Sat, 29 Dec, 03:23
em...@yeikel.com RE: What are the alternatives to nested DataFrames? Sat, 29 Dec, 03:30
Shahab Yunus Re: What are the alternatives to nested DataFrames? Sat, 29 Dec, 04:21
李斌松 [spark-sql] Hive failing on insert empty array into parquet table Sat, 29 Dec, 08:08
李斌松 Re: [spark-sql] Hive failing on insert empty array into parquet table Sat, 29 Dec, 11:54
Nicolas Paris Postgres Read JDBC with COPY TO STDOUT Sat, 29 Dec, 12:06
em...@yeikel.com RE: What are the alternatives to nested DataFrames? Sun, 30 Dec, 04:37
Ritesh Shah Count() not working on streaming dataframe/structured streaming Sun, 30 Dec, 05:17
Simon Dirmeier p-values logistic regression Sun, 30 Dec, 14:37
Gourav Sengupta Python 3.x Sun, 30 Dec, 15:25
Nicolas Paris Re: Postgres Read JDBC with COPY TO STDOUT Mon, 31 Dec, 14:08
Message list« Previous · 1 · 2 · 3 · Next »Thread · Author · Date
Box list
Sep 2019138
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137