spark-user mailing list archives: November 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · Next »Thread · Author · Date
Ramandeep Singh Nanda Is Dataframe write blocking? Thu, 08 Nov, 15:38
Re: [ANNOUNCE] Announcing Apache Spark 2.4.0
Wenchen Fan   Re: [ANNOUNCE] Announcing Apache Spark 2.4.0 Thu, 08 Nov, 18:26
Dongjoon Hyun     Re: [ANNOUNCE] Announcing Apache Spark 2.4.0 Thu, 08 Nov, 19:31
Jules Damji       Re: [ANNOUNCE] Announcing Apache Spark 2.4.0 Thu, 08 Nov, 19:36
Stavros Kontopoulos         Re: [ANNOUNCE] Announcing Apache Spark 2.4.0 Thu, 08 Nov, 21:18
Swapnil Shinde           Re: [ANNOUNCE] Announcing Apache Spark 2.4.0 Fri, 09 Nov, 00:10
Li Gao             Re: [ANNOUNCE] Announcing Apache Spark 2.4.0 Fri, 09 Nov, 00:12
Reynold Xin               Re: [ANNOUNCE] Announcing Apache Spark 2.4.0 Fri, 09 Nov, 00:15
Xiao Li                 Re: [ANNOUNCE] Announcing Apache Spark 2.4.0 Fri, 09 Nov, 00:17
Marcelo Vanzin   Re: [ANNOUNCE] Announcing Apache Spark 2.4.0 Thu, 08 Nov, 19:12
purna pradeep     Re: [ANNOUNCE] Announcing Apache Spark 2.4.0 Fri, 09 Nov, 12:19
Xiao Li The mailing list went down due to the spam server issues Thu, 08 Nov, 18:59
David Hesson Spark event logging with s3a Thu, 08 Nov, 21:36
Li Gao [Spark on K8s] Scaling experiences sharing Fri, 09 Nov, 16:26
Soheil Pourbafrani What is BDV in Spark Source Fri, 09 Nov, 19:06
Georg Heiler   Re: What is BDV in Spark Source Sat, 10 Nov, 13:53
pradeepbaji [Spark-SQL] - Creating Hive Metastore Parquet table from Avro schema Fri, 09 Nov, 19:44
Arijit Tarafdar Questions on Python support with Spark Fri, 09 Nov, 22:04
Patrick McCarthy   Re: Questions on Python support with Spark Mon, 12 Nov, 14:49
Soheil Pourbafrani Scala: The Util is not accessible in def main Sun, 11 Nov, 10:12
Mark Hamstra   Re: Scala: The Util is not accessible in def main Mon, 12 Nov, 04:03
Steve Lewis writing to local files on a worker Sun, 11 Nov, 22:13
Joe   Re: writing to local files on a worker Mon, 12 Nov, 04:37
Jörn Franke   Re: writing to local files on a worker Mon, 12 Nov, 06:51
Steve Lewis     Re: writing to local files on a worker Mon, 12 Nov, 17:20
Steve Lewis       Re: writing to local files on a worker Thu, 15 Nov, 23:34
Re: about LIVY-424
lk_spark   Re: about LIVY-424 Mon, 12 Nov, 06:56
FW: Spark2 and Hive metastore
Ирина Шершукова   FW: Spark2 and Hive metastore Mon, 12 Nov, 08:12
Sergey B.     Re: FW: Spark2 and Hive metastore Mon, 12 Nov, 09:10
Joe question about barrier execution mode in Spark 2.4.0 Mon, 12 Nov, 15:33
Sai Bucketing Mon, 12 Nov, 17:43
l...@china-inv.cn Failed to convert java.sql.Date to String Tue, 13 Nov, 08:48
Yann Moisan [Spark SQL] Does Spark group small files Tue, 13 Nov, 20:28
Silvio Fiorito   Re: [Spark SQL] Does Spark group small files Wed, 14 Nov, 01:12
Lienhart, Pierre (DI IZ) - AF (ext)   RE: [Spark SQL] Does Spark group small files Wed, 14 Nov, 08:31
Colin Williams inferred schemas for spark streaming from a Kafka source Tue, 13 Nov, 20:32
Luciano Resende [ANNOUNCE] Apache Bahir 2.1.3 Released Tue, 13 Nov, 21:07
Luciano Resende [ANNOUNCE] Apache Bahir 2.2.2 Released Tue, 13 Nov, 21:08
Luciano Resende [ANNOUNCE] Apache Toree 0.3.0-incubating Released Tue, 13 Nov, 21:43
Lienhart, Pierre (DI IZ) - AF (ext) [SPARK-SQL] Writing partitioned parquet requires huge amounts of memory Wed, 14 Nov, 15:56
Yann Moisan [Spark SQL] [Spark 2.4.0] Performance regression when reading parquet files from S3 Wed, 14 Nov, 20:07
Jack Kolokasis Measure Serialization / De-serialization Time Thu, 15 Nov, 13:54
François Sarradin [Spark SQL] [Spark 2.4.0] v1 -> struct(v1.e) fails Thu, 15 Nov, 14:46
kathleen li   Re: [Spark SQL] [Spark 2.4.0] v1 -> struct(v1.e) fails Tue, 20 Nov, 05:34
Vitaliy Pisarev How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 14:51
Vitaliy Pisarev   Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 15:00
Brandon Geise   Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 15:27
Thakrar, Jayesh   Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 15:29
Vitaliy Pisarev     Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 16:07
Thakrar, Jayesh       Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 16:58
Vitaliy Pisarev         Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 17:26
Vitaliy Pisarev           Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 17:28
Shahbaz             Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 17:49
Vitaliy Pisarev               Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 19:03
Thakrar, Jayesh                 Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 19:14
Vitaliy Pisarev                   Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 19:58
Thakrar, Jayesh                     Re: How to address seemingly low core utilization on a spark workload? Thu, 15 Nov, 21:23
Omer.Ozsaka...@sony.com Testing Apache Spark applications Thu, 15 Nov, 17:44
☼ R Nair   Re: Testing Apache Spark applications Thu, 15 Nov, 18:42
Vitaliy Pisarev     Re: Testing Apache Spark applications Thu, 15 Nov, 19:26
Lars Albertsson   Re: Testing Apache Spark applications Thu, 15 Nov, 20:19
Soheil Pourbafrani Using columnSimilarity with threshold result in greater than one Thu, 15 Nov, 17:56
Soheil Pourbafrani Using cosinSimilarity method for getting pairwise documents similarity Thu, 15 Nov, 18:03
Lian Jiang spark in jupyter cannot find a class in a jar Thu, 15 Nov, 23:46
崔苗(数据与人工智能产品开发部) programmatically set hadoop_conf_dir for spark Fri, 16 Nov, 01:37
Re: java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericRowWithSchema cannot be cast to Case class
Rico B.   Re: java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericRowWithSchema cannot be cast to Case class Fri, 16 Nov, 09:04
Mahender Sarangam Delta Logic in Spark Sat, 17 Nov, 11:23
puneetloya [Spark Structued Streaming]: Read kafka offset from a timestamp Sun, 18 Nov, 00:52
Jungtaek Lim   Re: [Spark Structued Streaming]: Read kafka offset from a timestamp Tue, 20 Nov, 00:37
Sean Owen CVE-2018-17190: Unsecured Apache Spark standalone executes user code Sun, 18 Nov, 15:36
Nicolas Paris streaming pdf Sun, 18 Nov, 22:29
Jörn Franke   Re: streaming pdf Mon, 19 Nov, 06:23
Nicolas Paris     Re: streaming pdf Mon, 19 Nov, 08:22
Jörn Franke       Re: streaming pdf Tue, 20 Nov, 07:06
Jörn Franke         Re: streaming pdf Tue, 20 Nov, 07:07
Dipl.-Inf. Rico Bergmann Spark DataSets and multiple write(.) calls Mon, 19 Nov, 08:03
Magnus Nilsson   Re: Spark DataSets and multiple write(.) calls Mon, 19 Nov, 08:43
Dipl.-Inf. Rico Bergmann     Re: Spark DataSets and multiple write(.) calls Mon, 19 Nov, 12:51
Vadim Semenov       Re: Spark DataSets and multiple write(.) calls Mon, 19 Nov, 18:12
Dipl.-Inf. Rico Bergmann         Re: Spark DataSets and multiple write(.) calls Tue, 20 Nov, 08:14
Michael Shtelma           Re: Spark DataSets and multiple write(.) calls Tue, 20 Nov, 09:38
Gourav Sengupta             Re: Spark DataSets and multiple write(.) calls Tue, 20 Nov, 16:28
b-moisson Pre build for apache 2.4 broken Mon, 19 Nov, 09:54
igor.berman Regression of external shuffle service spark 2.3 vs spark 2.2 Mon, 19 Nov, 12:15
Shiyuan exhaustive list of configuration options Tue, 20 Nov, 00:14
Ramaswamy, Muthuraman PySpark Streaming and Secured Kafka. Tue, 20 Nov, 01:32
Message list« Previous · 1 · 2 · 3 · Next »Thread · Author · Date
Box list
Sep 2019137
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137