spark-user mailing list archives: December 2016

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
5g2w35+83j86k7gef...@guerrillamail.com TO ALL WHO WANT TO UNSUBSCRIBE Thu, 08 Dec, 14:49
黄晓萌 how to see cpu time of application on yarn mode Fri, 16 Dec, 02:07
LQ how to use Dataset of transform method Mon, 05 Dec, 01:33
任弘迪 Re: [Spark Structured Streaming]: Is it possible to ingest data from a jdbc data source incrementally? Fri, 30 Dec, 05:45
李斌松 How to reflect dynamic registration udf? Fri, 16 Dec, 02:27
李斌松 The spark hive udf can read broadcast the variables? Sat, 17 Dec, 15:24
Juan Rodríguez Hortalá Re: unit testing in spark Mon, 12 Dec, 00:30
Michal Šenkýř Re: Spark 2.x Pyspark Spark SQL createDataframe Error Fri, 02 Dec, 00:19
Michal Šenkýř Re: RDD flatmap to multiple key/value pairs Fri, 02 Dec, 18:38
Michal Šenkýř Re: Can spark support exactly once based kafka ? Due to these following question? Mon, 05 Dec, 07:59
Michal Šenkýř Re: How to convert a unix timestamp column into date format(yyyy-MM-dd) ? Mon, 05 Dec, 08:33
Michal Šenkýř Accessing classpath resources in Spark Shell Wed, 07 Dec, 21:48
Michal Šenkýř Re: Dataset encoders for further types? Sat, 17 Dec, 11:10
François Garillot Re: Publishing of the Spectral LDA model on Spark Packages Thu, 08 Dec, 10:32
Jorge Sánchez Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode Mon, 05 Dec, 17:38
Léo Biscassi Getting Hive Metastore error without using Hive Sun, 25 Dec, 15:53
Léo Biscassi Re: Location for the additional jar files in Spark Tue, 27 Dec, 12:59
Otávio Carvalho Spark-shell doesn't see changes coming from Kafka topic Thu, 01 Dec, 14:31
Otávio Carvalho Re: Spark-shell doesn't see changes coming from Kafka topic Tue, 06 Dec, 00:40
Piotr Smoliński Re: Can spark support exactly once based kafka ? Due to these following question? Mon, 05 Dec, 09:08
"Yuanzhe Yang (杨远哲)" [Spark Structured Streaming]: Is it possible to ingest data from a jdbc data source incrementally? Thu, 29 Dec, 12:05
Jörn Franke Re: Access multiple cluster Mon, 05 Dec, 06:17
Jörn Franke Re: Can spark support exactly once based kafka ? Due to these following question? Mon, 05 Dec, 10:17
Jörn Franke Re: .tar.bz2 in spark Thu, 08 Dec, 23:41
Jörn Franke Re: Optimization for Processing a million of HTML files Tue, 13 Dec, 06:55
Jörn Franke Re: Reading xls and xlsx files Mon, 19 Dec, 10:32
Jörn Franke Re: Has anyone managed to connect to Oracle via JDBC from Spark CDH 5.5.2 Thu, 22 Dec, 21:03
A Shaikh Spark SQL Syntax Mon, 19 Dec, 13:06
A Shaikh Re: Spark SQL Syntax Mon, 19 Dec, 14:28
A Shaikh Custom delimiter file load Sat, 31 Dec, 17:58
AShaita...@nz.imshealth.com Adding a new nested column into dataframe Wed, 07 Dec, 05:09
Aakash Basu Hortonworks Spark Certification Query Wed, 14 Dec, 17:02
Adnan Ahmed SparkContext not creating due Logger initialization Thu, 08 Dec, 19:29
Adrian Bridgett coalesce ending up very unbalanced - but why? Wed, 14 Dec, 13:56
Adrian Bridgett Re: coalesce ending up very unbalanced - but why? Wed, 14 Dec, 14:41
Ajit Jaokar Unsubscribe Thu, 08 Dec, 05:12
Ajith Jose unsubscribe Thu, 08 Dec, 03:53
Akhilesh Pathodia Re: How many Spark streaming applications can be run at a time on a Spark cluster? Thu, 15 Dec, 02:54
Aleksander Eskilson Driver/Executor Memory values during Unit Testing Wed, 07 Dec, 21:44
AlexModestov spark use /tmp directory instead of directory from spark.local.dir Thu, 15 Dec, 13:13
Alexander Kapustin RE: Has anyone managed to connect to Oracle via JDBC from Spark CDH 5.5.2 Thu, 22 Dec, 10:44
Amir Rahnama Re: Spark 2 or Spark 1.6.x? Mon, 12 Dec, 14:53
Amit Sela RDD getPartitions() size and HashPartitioner numPartitions Fri, 02 Dec, 21:53
Anant Chintamaneni Re: Do we really need mesos or yarn? or is standalone sufficent? Fri, 16 Dec, 19:03
Anastasios Zouzias Re: Ingesting data in elasticsearch from hdfs using spark , cluster setup and usage Fri, 23 Dec, 09:02
Andy Dang Re: Best Practice for Spark Job Jar Generation Fri, 23 Dec, 15:04
Andy Dang Re: Best Practice for Spark Job Jar Generation Fri, 23 Dec, 18:11
Aniket Bhatnagar Re: OS killing Executor due to high (possibly off heap) memory usage Thu, 08 Dec, 16:53
Aniket More Identifying DataFrames in executing tasks Wed, 07 Dec, 09:27
Aniket R More Records processed metric for intermediate datasets Thu, 08 Dec, 13:18
Anil Langote Parquet with group by queries Wed, 21 Dec, 16:41
Anil Langote Re: Parquet with group by queries Wed, 21 Dec, 16:50
Ankur Srivastava Spark GraphFrames generic question Sat, 17 Dec, 02:39
Annabel Melongo Re: DataFrame to read json and include raw Json in DataFrame Fri, 30 Dec, 02:20
Annabel Melongo Re: DataFrame to read json and include raw Json in DataFrame Fri, 30 Dec, 05:21
Anton Kravchenko spark reshape hive table and save to parquet Thu, 08 Dec, 16:53
Anton Kravchenko Re: spark reshape hive table and save to parquet Wed, 14 Dec, 23:39
Anton Kravchenko Re: spark reshape hive table and save to parquet Thu, 15 Dec, 23:43
Anton Okolnychyi Spark Streaming with Kafka Sun, 11 Dec, 14:51
Anton Okolnychyi Re: Spark Streaming with Kafka Sun, 11 Dec, 16:46
Anton Okolnychyi Re: Spark Streaming with Kafka Mon, 12 Dec, 17:34
AntonIpp [GraphX] Extreme scheduler delay Tue, 06 Dec, 11:49
Anty Rao Not per-key state Wed, 07 Dec, 08:13
Anty Rao Not per-key state in spark streaming Wed, 07 Dec, 11:42
Anty Rao Re: Not per-key state in spark streaming Thu, 08 Dec, 02:11
Anty Rao Re: Not per-key state in spark streaming Thu, 08 Dec, 02:49
Anty Rao Re: Not per-key state in spark streaming Fri, 09 Dec, 06:19
Appu K Managed memory leak : spark-2.0.2 Thu, 08 Dec, 11:10
Appu K Re: Managed memory leak : spark-2.0.2 Thu, 08 Dec, 15:55
Appu K groupByKey vs reduceByKey Fri, 09 Dec, 12:18
Aseem Bansal Is there any scheduled release date for Spark 2.1.0? Fri, 23 Dec, 09:00
Bas Harenslak Re: using replace function Mon, 12 Dec, 13:48
Benjamin Kim Merging Parquet Files Thu, 22 Dec, 22:01
Benjamin Kim Re: Merging Parquet Files Fri, 23 Dec, 02:21
Benjamin Kim Re: Merging Parquet Files Fri, 23 Dec, 06:47
Benyi Wang Re: Accessing log for lost executors Fri, 02 Dec, 09:45
Bertrand Dechoux Re: Belief propagation algorithm is open sourced Thu, 15 Dec, 09:03
Bhavani Sudha Saktheeswaran mapWithState's checkpoint size Thu, 01 Dec, 06:25
Brad Cox Proper use of map(..., Encoder<T>) Wed, 14 Dec, 16:05
Bruno Faria Terminate job without killing Wed, 07 Dec, 03:03
Bryan Cutler Re: Belief propagation algorithm is open sourced Thu, 15 Dec, 04:21
Bryan Jeffrey Streaming Batch Oddities Tue, 13 Dec, 17:11
Bryan Jeffrey Re: Streaming Batch Oddities Wed, 14 Dec, 02:14
Burak Yavuz Re: Spark Streaming - join streaming and static data Tue, 06 Dec, 17:11
Calvin Jia Re: About Spark Multiple Shared Context with Spark 2.0 Tue, 13 Dec, 19:04
Calvin Jia Re: Question about Spark and filesystems Mon, 19 Dec, 08:31
Carl Ballantyne Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 05:20
Carl Ballantyne Re: Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 05:30
Carl Ballantyne Re: Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 05:59
Carl Ballantyne Re: Spark Standalone Cluster - Running applications in JSON format Thu, 01 Dec, 06:07
Cassa L Spark job server pros and cons Fri, 09 Dec, 22:31
Cesar credentials are not hiding on a jdbc query Wed, 07 Dec, 00:33
Chanh Le How to set classpath for a job that submit to Mesos cluster Tue, 13 Dec, 10:20
Chawla,Sumit Monitoring the User Metrics for a long running Spark Job Tue, 06 Dec, 00:17
Chawla,Sumit Re: Monitoring the User Metrics for a long running Spark Job Tue, 06 Dec, 04:17
Chawla,Sumit Re: Monitoring the User Metrics for a long running Spark Job Tue, 06 Dec, 04:30
Chawla,Sumit Re: Monitoring the User Metrics for a long running Spark Job Tue, 06 Dec, 19:40
Chawla,Sumit Re: Monitoring the User Metrics for a long running Spark Job Mon, 12 Dec, 02:40
Chawla,Sumit Output Side Effects for different chain of operations Tue, 13 Dec, 16:31
Chawla,Sumit Re: Output Side Effects for different chain of operations Thu, 15 Dec, 19:33
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Box list
May 2019254
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137