spark-user mailing list archives: June 2019

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Bryan Cutler Re: Should python-2 be supported in Spark 3.0? Sat, 01 Jun, 00:39
Holden Karau Re: Should python-2 be supported in Spark 3.0? Sat, 01 Jun, 00:57
Denny Lee Re: Should python-2 be supported in Spark 3.0? Sat, 01 Jun, 01:22
shane knapp Re: Should python-2 be supported in Spark 3.0? Sat, 01 Jun, 02:38
Rishi Shah Re: [pyspark 2.3+] Bucketing with sort - incremental data load? Sat, 01 Jun, 03:57
Georg Heiler Re: [pyspark 2.3+] Bucketing with sort - incremental data load? Sat, 01 Jun, 05:28
Felix Cheung Re: Should python-2 be supported in Spark 3.0? Sat, 01 Jun, 05:54
kyunam Possible to specify returnType: DataType in UDFRegistration.register()? Sat, 01 Jun, 18:16
Shyam P Re: java.util.NoSuchElementException: Columns not found Mon, 03 Jun, 13:30
Xiangrui Meng Re: Should python-2 be supported in Spark 3.0? Mon, 03 Jun, 15:40
Xiangrui Meng [ANNOUNCEMENT] Plan for dropping Python 2 support Mon, 03 Jun, 15:45
Jun Zhu Spark Thriftserver on yarn, sql submit take long time. Tue, 04 Jun, 06:00
Jun Zhu Re: Spark Thriftserver on yarn, sql submit take long time. Tue, 04 Jun, 06:05
Joe Ammann Spark structured streaming leftOuter join not working as I expect Tue, 04 Jun, 12:31
tkrol Re: Upsert for hive tables Tue, 04 Jun, 13:00
Pipster Neko Spark Streaming: Task not distributed Wed, 05 Jun, 03:05
Pipster Neko Spark Streaming: Task not distributed Wed, 05 Jun, 03:06
ya installation of spark Wed, 05 Jun, 03:50
Jack Kolokasis Re: installation of spark Wed, 05 Jun, 04:09
Tianhua huang spark ./build/mvn test failed on aarch64 Wed, 05 Jun, 07:13
Jungtaek Lim Re: Spark structured streaming leftOuter join not working as I expect Wed, 05 Jun, 07:17
Tianhua huang spark ./build/mvn test failed on aarch64 Wed, 05 Jun, 07:25
Alonso Isidoro Roman Re: installation of spark Wed, 05 Jun, 10:38
Rishi Shah [Pyspark 2.4] Best way to define activity within different time window Wed, 05 Jun, 10:49
Joe Ammann Re: Spark structured streaming leftOuter join not working as I expect Wed, 05 Jun, 14:57
Jungtaek Lim Re: Spark structured streaming leftOuter join not working as I expect Wed, 05 Jun, 15:35
pacuna Spark on K8S - --packages not working for cluster mode? Wed, 05 Jun, 20:18
Daniel Mateus Pires Blog post: DataFrame.transform -- Spark function composition Wed, 05 Jun, 20:47
Anthony May Spark MySQL Invalid DateTime value killing job Thu, 06 Jun, 00:29
Anthony May Re: Spark MySQL Invalid DateTime value killing job Thu, 06 Jun, 01:10
ya sparksql in sparkR? Thu, 06 Jun, 06:48
Akshay Bhardwaj Re: adding a column to a groupBy (dataframe) Thu, 06 Jun, 09:48
Akshay Bhardwaj Re: adding a column to a groupBy (dataframe) Thu, 06 Jun, 09:51
Stavros Kontopoulos Re: Spark on K8S - --packages not working for cluster mode? Thu, 06 Jun, 12:37
Shi Tyshanchn [No Subject] Thu, 06 Jun, 12:40
Marcelo Valle Re: adding a column to a groupBy (dataframe) Thu, 06 Jun, 12:53
pacuna Re: Spark on K8S - --packages not working for cluster mode? Thu, 06 Jun, 13:35
Magnus Nilsson Re: adding a column to a groupBy (dataframe) Thu, 06 Jun, 13:50
Marcelo Valle Re: adding a column to a groupBy (dataframe) Thu, 06 Jun, 14:02
Symeon Meichanetzoglou Multi-dimensional aggregations in Structured Streaming Thu, 06 Jun, 14:09
Marcelo Valle Re: adding a column to a groupBy (dataframe) Thu, 06 Jun, 16:24
Ricardo Martinelli de Oliveira Fwd: [Spark SQL Thrift Server] Persistence errors with PostgreSQL and MySQL in 2.4.3 Thu, 06 Jun, 19:56
Bruno Nassivet Re: adding a column to a groupBy (dataframe) Thu, 06 Jun, 19:57
Nick Dawes Spark on Kubernetes Authentication error Thu, 06 Jun, 20:37
dimitris plakas Task - Id : Staus Failed Thu, 06 Jun, 20:48
Marcelo Valle Re: adding a column to a groupBy (dataframe) Fri, 07 Jun, 09:06
test test Spark logging questions Fri, 07 Jun, 11:13
tkrol Getting driver logs in Standalone Cluster Fri, 07 Jun, 14:21
Jacek Laskowski [SQL] Why casting string column to timestamp gives null? Fri, 07 Jun, 16:38
Felix Cheung Re: sparksql in sparkR? Fri, 07 Jun, 16:43
Chetan Khatri Kafka Topic to Parquet HDFS with Structured Streaming Fri, 07 Jun, 21:59
Chetan Khatri Re: Kafka Topic to Parquet HDFS with Structured Streaming Fri, 07 Jun, 23:48
ya Spark SQL in R? Sat, 08 Jun, 03:26
anbutech Spark 2.2 With Column usage Sat, 08 Jun, 04:05
Jacek Laskowski Re: Spark 2.2 With Column usage Sat, 08 Jun, 09:42
Jacek Laskowski Re: Spark logging questions Sat, 08 Jun, 09:49
anbutech Re: Spark 2.2 With Column usage Sat, 08 Jun, 10:53
Luciano Resende [ANNOUNCE] Apache Bahir 2.2.3 Released Sat, 08 Jun, 17:55
Luciano Resende [ANNOUNCE] Apache Bahir 2.3.3 Released Sat, 08 Jun, 17:55
Felix Cheung Re: Spark SQL in R? Sat, 08 Jun, 23:06
Deepak Sharma Read hdfs files in spark streaming Sun, 09 Jun, 13:08
big data Re: [Pyspark 2.4] Best way to define activity within different time window Sun, 09 Jun, 13:59
Jörn Franke Re: [Pyspark 2.4] Best way to define activity within different time window Sun, 09 Jun, 17:17
vaquar khan Re: Read hdfs files in spark streaming Sun, 09 Jun, 17:33
Rishi Shah [pyspark 2.3+] Querying non-partitioned @TB data table is too slow Sun, 09 Jun, 21:50
Rishi Shah Re: High level explanation of dropDuplicates Mon, 10 Jun, 03:00
Deepak Sharma Re: Read hdfs files in spark streaming Mon, 10 Jun, 05:13
Deng Ching-Mallete Re: Kafka Topic to Parquet HDFS with Structured Streaming Mon, 10 Jun, 09:28
Shyam P How to handle small file problem in spark structured streaming? Mon, 10 Jun, 10:25
Shyam P Re: Read hdfs files in spark streaming Mon, 10 Jun, 10:29
Deepak Sharma Re: Read hdfs files in spark streaming Mon, 10 Jun, 10:44
Shyam P How spark structured streaming consumers initiated and invoked while reading multi-partitioned kafka topics? Mon, 10 Jun, 10:52
Deepak Sharma Re: Read hdfs files in spark streaming Mon, 10 Jun, 11:12
Shyam P Does anyone used spark-structured streaming successfully in production ? Mon, 10 Jun, 13:31
Amit Sharma Fwd: Spark kafka streaming job stopped Mon, 10 Jun, 15:05
Alex Dettinger [Spark Core]: What is the release date for Spark 3 ? Mon, 10 Jun, 15:24
naresh Goud Spark SQL Mon, 10 Jun, 19:06
Russell Spitzer Re: Spark SQL Mon, 10 Jun, 19:29
Chetan Khatri Re: Kafka Topic to Parquet HDFS with Structured Streaming Mon, 10 Jun, 20:25
Joe Ammann Re: Spark structured streaming leftOuter join not working as I expect Mon, 10 Jun, 22:06
Dave Jaffe Spark on Kubernetes - log4j.properties not read Tue, 11 Jun, 01:15
Tianhua huang ARM CI for spark Tue, 11 Jun, 02:21
Youngwoo Kim (김영우) Re: ARM CI for spark Tue, 11 Jun, 02:40
Rao, Abhishek (Nokia - IN/Bangalore) RE: Spark on Kubernetes - log4j.properties not read Tue, 11 Jun, 03:00
Rishi Shah Re: [Pyspark 2.4] Best way to define activity within different time window Tue, 11 Jun, 04:09
Jacek Laskowski Re: Spark 2.2 With Column usage Tue, 11 Jun, 06:20
Georg Heiler Re: [Pyspark 2.4] Best way to define activity within different time window Tue, 11 Jun, 08:07
Lourier, Jean-Michel (FIX1) AW: Getting driver logs in Standalone Cluster Tue, 11 Jun, 09:50
Marcelo Valle best docker image to use Tue, 11 Jun, 09:51
Jungtaek Lim Re: Spark structured streaming leftOuter join not working as I expect Tue, 11 Jun, 10:07
nitin jain Re: Read hdfs files in spark streaming Tue, 11 Jun, 10:40
Riccardo Ferrari Re: best docker image to use Tue, 11 Jun, 11:19
Amit Sharma Re: Spark kafka streaming job stopped Tue, 11 Jun, 11:21
Femi Anthony AWS EMR slow write to HDFS Tue, 11 Jun, 12:50
rmartine Re: Fwd: [Spark SQL Thrift Server] Persistence errors with PostgreSQL and MySQL in 2.4.3 Tue, 11 Jun, 14:08
Shyam P Why my spark job STATE--> Running FINALSTATE --> Undefined. Tue, 11 Jun, 14:11
Dave Jaffe RE: Spark on Kubernetes - log4j.properties not read Tue, 11 Jun, 15:09
Prudhvi Chennuru (CONT) Re: [External Sender] Re: Spark 2.4.1 on Kubernetes - DNS resolution of driver fails Tue, 11 Jun, 16:22
Rishi Shah [pyspark 2.3+] count distinct returns different value every time it is run on the same dataset Wed, 12 Jun, 01:33
em...@yeikel.com What is the compatibility between releases? Wed, 12 Jun, 04:25
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Oct 201958
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137