spark-user mailing list archives: December 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · Next »Thread · Author · Date
albamoro Continuous Processing roadmap Fri, 14 Dec, 11:07
Kalvin Chau Structured Streaming on Kubernetes Performance Fri, 14 Dec, 17:33
李斌松 spark2.4 arrow enabled true,error log not returned Sat, 15 Dec, 06:39
big data   Maven dependecy problem about spark-streaming-kafka_2.11:1.6.3 Mon, 17 Dec, 07:03
Laurent Thiebaud Mllib / kalman Mon, 17 Dec, 13:59
robin.e...@xense.co.uk   Mllib / kalman Mon, 17 Dec, 14:37
Soheil Pourbafrani Spark App Write nothing on HDFS Mon, 17 Dec, 18:08
Nikhil Goyal Need help with SparkSQL Query Mon, 17 Dec, 21:03
Patrick McCarthy   Re: Need help with SparkSQL Query Mon, 17 Dec, 21:07
Ramandeep Singh Nanda   Re: Need help with SparkSQL Query Mon, 17 Dec, 21:11
Nirav Patel Spark 2.2.1 - Operation not allowed: alter table replace columns Mon, 17 Dec, 23:10
Jiaan Geng   Re: Spark 2.2.1 - Operation not allowed: alter table replace columns Wed, 19 Dec, 11:15
shyla deshpande How to clean up logs-dirs and local-dirs of running spark streaming in yarn cluster mode Tue, 18 Dec, 00:42
shyla deshpande   Re: How to clean up logs-dirs and local-dirs of running spark streaming in yarn cluster mode Tue, 18 Dec, 19:10
shyla deshpande     Re: How to clean up logs-dirs and local-dirs of running spark streaming in yarn cluster mode Tue, 25 Dec, 23:05
Fawze Abujaber       Re: How to clean up logs-dirs and local-dirs of running spark streaming in yarn cluster mode Wed, 26 Dec, 03:26
shyla deshpande         Re: How to clean up logs-dirs and local-dirs of running spark streaming in yarn cluster mode Wed, 26 Dec, 18:14
Yuta Morisawa How to update structured streaming apps gracefully Tue, 18 Dec, 02:56
Priya Matpadi   Re: How to update structured streaming apps gracefully Tue, 18 Dec, 17:29
vincent gromakowski     Re: How to update structured streaming apps gracefully Tue, 18 Dec, 17:45
Priya Matpadi       Re: How to update structured streaming apps gracefully Tue, 18 Dec, 21:18
vincent gromakowski         Re: How to update structured streaming apps gracefully Wed, 19 Dec, 00:09
Yuta Morisawa           Re: How to update structured streaming apps gracefully Wed, 19 Dec, 01:00
Alexander Chermenin State size on joining two streams Tue, 18 Dec, 08:58
Mich Talebzadeh Spark Scala reading from Google Cloud BigQuery table throws error Tue, 18 Dec, 10:26
Jörn Franke   Re: Spark Scala reading from Google Cloud BigQuery table throws error Tue, 18 Dec, 11:16
Mich Talebzadeh     Re: Spark Scala reading from Google Cloud BigQuery table throws error Tue, 18 Dec, 19:46
Sam Elamin       Re: Spark Scala reading from Google Cloud BigQuery table throws error Wed, 19 Dec, 08:36
Mich Talebzadeh         Re: Spark Scala reading from Google Cloud BigQuery table throws error Wed, 19 Dec, 17:08
Devender Yadav Add column value in the dataset on the basis of a condition Tue, 18 Dec, 13:47
Shahab Yunus   Re: Add column value in the dataset on the basis of a condition Tue, 18 Dec, 14:55
Shahab Yunus     Re: Add column value in the dataset on the basis of a condition Tue, 18 Dec, 14:57
Devender Yadav     Re: Add column value in the dataset on the basis of a condition Tue, 18 Dec, 15:17
Re: [Apache Beam] Custom DataSourceV2 instanciation: parameters passing and Encoders
Etienne Chauchot   Re: [Apache Beam] Custom DataSourceV2 instanciation: parameters passing and Encoders Tue, 18 Dec, 16:09
swastik mittal Read Time from a remote data source Tue, 18 Dec, 20:20
jiaan.geng   Re: Read Time from a remote data source Wed, 19 Dec, 03:27
swastik mittal     Re: Read Time from a remote data source Wed, 19 Dec, 15:39
Jiaan Geng       Re: Read Time from a remote data source Thu, 20 Dec, 03:49
Andrew Old Dataset experimental interfaces Tue, 18 Dec, 20:54
Jean Georges Perrin Multiple sessions in one application? Wed, 19 Dec, 11:12
Jiaan Geng   Re: Multiple sessions in one application? Fri, 21 Dec, 02:02
Mark Hamstra     Re: Multiple sessions in one application? Fri, 21 Dec, 21:33
Spark Kafka Streaming with Offset Gaps
Rishabh Pugalia   Spark Kafka Streaming with Offset Gaps Wed, 19 Dec, 11:40
Rishabh Pugalia   Spark Kafka Streaming with Offset Gaps Wed, 19 Dec, 11:46
Kamil Krzysztof Krynicki [Spark Core] Support for parquet column indexes Wed, 19 Dec, 13:09
Daniel O' Shaughnessy [No Subject] Wed, 19 Dec, 13:59
Re: question about barrier execution mode in Spark 2.4.0
Xiangrui Meng   Re: question about barrier execution mode in Spark 2.4.0 Wed, 19 Dec, 17:21
Fwd: Train multiple machine learning models in parallel
Pola Yao   Fwd: Train multiple machine learning models in parallel Wed, 19 Dec, 23:55
李斌松 [Spark SQL]use zstd, No enum constant parquet.hadoop.metadata.CompressionCodecName.ZSTD Thu, 20 Dec, 03:38
Jiaan Geng   Re: [Spark SQL]use zstd, No enum constant parquet.hadoop.metadata.CompressionCodecName.ZSTD Fri, 21 Dec, 04:07
大啊     Re:Re: [Spark SQL]use zstd, No enum constant parquet.hadoop.metadata.CompressionCodecName.ZSTD Fri, 21 Dec, 06:18
Abhijeet Kumar Spark not working with Hadoop 4mc compression Thu, 20 Dec, 06:03
Jiaan Geng   Re: Spark not working with Hadoop 4mc compression Fri, 21 Dec, 04:18
l...@china-inv.cn [SPARK SQL] Difference between 'Hive on spark' and Spark SQL Thu, 20 Dec, 07:17
Jörn Franke   Re: [SPARK SQL] Difference between 'Hive on spark' and Spark SQL Thu, 20 Dec, 08:34
Re: Spark job on dataproc failing with Exception in thread "main" java.lang.NoSuchMethodError: com.googl
Mich Talebzadeh   Re: Spark job on dataproc failing with Exception in thread "main" java.lang.NoSuchMethodError: com.googl Thu, 20 Dec, 10:40
Muthu Jayakumar     Re: Spark job on dataproc failing with Exception in thread "main" java.lang.NoSuchMethodError: com.googl Thu, 20 Dec, 13:48
Cheikh_SOW [Spark cluster standalone v2.4.0] - problems with reverse proxy functionnality regarding submitted applications in cluster mode and the spark history server ui Thu, 20 Dec, 16:42
prosp4300 Custom Metric Sink on Executor Always ClassNotFound Thu, 20 Dec, 21:47
Marcelo Vanzin   Re: Custom Metric Sink on Executor Always ClassNotFound Thu, 20 Dec, 21:53
prosp4300     Re:Re: Custom Metric Sink on Executor Always ClassNotFound Fri, 21 Dec, 01:08
Thakrar, Jayesh     Re: Custom Metric Sink on Executor Always ClassNotFound Fri, 21 Dec, 14:34
Gourav Sengupta running updates using SPARK Thu, 20 Dec, 22:05
Jiaan Geng   Re: running updates using SPARK Fri, 21 Dec, 03:36
Gourav Sengupta     Re: running updates using SPARK Fri, 21 Dec, 08:55
大啊       Re:Re: running updates using SPARK Mon, 24 Dec, 02:17
大啊   Re:running updates using SPARK Fri, 21 Dec, 06:20
Aakash Basu Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 06:28
Shuporno Choudhury   Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 07:21
Aakash Basu     Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 07:50
Shuporno Choudhury       Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 08:13
Aakash Basu         Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 08:51
Aakash Basu           Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 12:17
Riccardo Ferrari             Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 12:33
Aakash Basu               Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 13:46
ddebarbieux                 Spark 2 - How to order keys in sparse vector (K-means)? Fri, 21 Dec, 14:15
Riccardo Ferrari                 Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 15:09
☼ R Nair                   Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 15:36
Aakash Basu                     Re: Connection issue with AWS S3 from PySpark 2.3.1 Fri, 21 Dec, 16:23
Gourav Sengupta                       Re: Connection issue with AWS S3 from PySpark 2.3.1 Mon, 24 Dec, 14:22
Akshay Mendole Spark executors exceeding heap space allocated Fri, 21 Dec, 15:47
shyla deshpande java.lang.NumberFormatException: Not a version: 9 after I add spark.cassandra.connection.host property to Spark Interpreter Fri, 21 Dec, 20:22
Ascot Moss Powered By Spark Sat, 22 Dec, 08:13
JiaTao Tao Async action in Dataframe Sat, 22 Dec, 08:47
Jiaan Geng   Re: Async action in Dataframe Mon, 24 Dec, 03:36
大啊     Re:Re: Async action in Dataframe Sat, 29 Dec, 03:23
JiaTao Tao About LocalProperty in sqlConf Sat, 22 Dec, 09:16
shyla deshpande Connecting to Cassandra from Zeppelin on EMR cluster Sat, 22 Dec, 16:02
Gezim Sejdiu   Re: Connecting to Cassandra from Zeppelin on EMR cluster Sat, 22 Dec, 19:41
Gaurav Gupta Getting FileNotFoundException and LeaseExpired Exception while writing a df to hdfs path Mon, 24 Dec, 20:04
Colin Williams Packaging kafka certificates in uber jar Mon, 24 Dec, 20:29
Anastasios Zouzias   Re: Packaging kafka certificates in uber jar Tue, 25 Dec, 13:26
Colin Williams     Re: Packaging kafka certificates in uber jar Wed, 26 Dec, 12:16
Akshay Mendole spark application takes significant some time to succeed even after all jobs are completed Tue, 25 Dec, 11:51
Jörn Franke   Re: spark application takes significant some time to succeed even after all jobs are completed Tue, 25 Dec, 12:00
Akshay Mendole     Re: spark application takes significant some time to succeed even after all jobs are completed Tue, 25 Dec, 12:08
Jörn Franke       Re: spark application takes significant some time to succeed even after all jobs are completed Tue, 25 Dec, 12:47
Akshay Mendole Tuning G1GC params for aggressive garbage collection? Tue, 25 Dec, 11:57
Ramandeep Singh Nanda   Re: Tuning G1GC params for aggressive garbage collection? Tue, 25 Dec, 17:57
Akshay Mendole     Re: Tuning G1GC params for aggressive garbage collection? Wed, 26 Dec, 02:11
Debajyoti Roy Spark Dataset transformations for time based events Wed, 26 Dec, 07:34
Message list« Previous · 1 · 2 · 3 · Next »Thread · Author · Date
Box list
Mar 2020223
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137