spark-user mailing list archives: February 2019

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
linr...@itri.org.tw Task skew or Data skew problem for Spark Standalone (2.3.1) Fri, 01 Feb, 02:53
Aakash Basu Avoiding collect but use foreach Fri, 01 Feb, 07:37
刘虓   Re: Avoiding collect but use foreach Mon, 04 Feb, 08:33
Re: Aws
Pedro Tuero   Re: Aws Fri, 01 Feb, 16:11
Hiroyuki Nagata     Re: Aws Thu, 07 Feb, 23:16
Noritaka Sekiyama       Re: Aws Fri, 08 Feb, 00:37
Pedro Tuero         Re: Aws Fri, 08 Feb, 14:49
Re: Structured streaming from Kafka by timestamp
Tomas Bartalos   Re: Structured streaming from Kafka by timestamp Fri, 01 Feb, 16:58
Cody Koeninger     Re: Structured streaming from Kafka by timestamp Tue, 05 Feb, 16:31
karan alang Jupyter Notebook (Scala, kernel - Apache Toree) with Vegas, Graph not showing data Fri, 01 Feb, 19:17
Re: testing frameworks
Marco Mistroni   Re: testing frameworks Sun, 03 Feb, 21:41
Hichame El Khalfi     Re: testing frameworks Sun, 03 Feb, 21:58
Marco Mistroni       Re: testing frameworks Mon, 04 Feb, 21:22
Moein Hosseini Can not start thrift-server on spark2.4 Mon, 04 Feb, 09:36
Re: Unsubscribe
Sunil Prabhakara   Re: Unsubscribe Mon, 04 Feb, 11:05
Simon Hewitt Re: SPIP: DataFrame-based Property Graphs, Cypher Queries, and Algorithms Mon, 04 Feb, 21:21
Shubham Chaurasia DataSourceV2 producing wrong date value in Custom Data Writer Tue, 05 Feb, 12:46
Ryan Blue   Re: DataSourceV2 producing wrong date value in Custom Data Writer Tue, 05 Feb, 16:58
Shubham Chaurasia     Re: DataSourceV2 producing wrong date value in Custom Data Writer Wed, 06 Feb, 08:21
Re: Back pressure not working on streaming
Cody Koeninger   Re: Back pressure not working on streaming Tue, 05 Feb, 16:35
Serega Sheypak Spark 2.x duplicates output when task fails at "repartition" stage. Checkpointing is enabled before repartition. Tue, 05 Feb, 18:15
Artur Sukhenko 3 equalTo "3.15" = true Wed, 06 Feb, 15:31
Russell Spitzer   Re: 3 equalTo "3.15" = true Wed, 06 Feb, 16:19
Artur Sukhenko     Re: 3 equalTo "3.15" = true Wed, 06 Feb, 16:32
Artur Sukhenko       Re: 3 equalTo "3.15" = true Wed, 06 Feb, 16:41
Denis DEBARBIEUX     RE : 3 equalTo "3.15" = true Wed, 06 Feb, 17:43
Faiz Chachiya Spark DataFrame/DataSet Wide Transformations Thu, 07 Feb, 03:20
hemant singh   Re: Spark DataFrame/DataSet Wide Transformations Thu, 07 Feb, 04:52
Faiz Chachiya     Re: Spark DataFrame/DataSet Wide Transformations Thu, 07 Feb, 05:55
Hande, Ranjit Dilip (Ranjit) java.lang.IllegalArgumentException: Unsupported class file major version 55 Thu, 07 Feb, 11:44
Gabor Somogyi   Re: java.lang.IllegalArgumentException: Unsupported class file major version 55 Thu, 07 Feb, 12:18
Jungtaek Lim     Re: java.lang.IllegalArgumentException: Unsupported class file major version 55 Thu, 07 Feb, 13:22
Felix Cheung     Re: java.lang.IllegalArgumentException: Unsupported class file major version 55 Sun, 10 Feb, 23:23
Pedro Tuero Spark 2.4 partitions and tasks Thu, 07 Feb, 18:30
Pedro Tuero   Re: Spark 2.4 partitions and tasks Fri, 08 Feb, 15:50
Pedro Tuero     Re: Spark 2.4 partitions and tasks Fri, 08 Feb, 16:09
Jacek Laskowski       Re: Spark 2.4 partitions and tasks Tue, 12 Feb, 12:13
Pedro Tuero         Re: Spark 2.4 partitions and tasks Tue, 12 Feb, 14:22
Pedro Tuero           Re: Spark 2.4 partitions and tasks Tue, 12 Feb, 16:08
Pedro Tuero             Re: Spark 2.4 partitions and tasks Tue, 12 Feb, 18:25
Pedro Tuero               Re: Spark 2.4 partitions and tasks Wed, 13 Feb, 15:56
Yeikel                 Re: Spark 2.4 partitions and tasks Sun, 24 Feb, 00:27
Pedro Tuero                   Re: Spark 2.4 partitions and tasks Mon, 25 Feb, 14:50
Riccardo Ferrari PySpark OOM when running PCA Fri, 08 Feb, 01:26
Andreas Weise Spark 2.4 Regression with posexplode and structs Fri, 08 Feb, 13:43
Andre Carneiro (send this email to subscribe) Fri, 08 Feb, 18:02
Simon Dirmeier Element-wise multiplication in Pyspark Fri, 08 Feb, 22:46
Simon Dirmeier Pyspark elementwise matrix multiplication Fri, 08 Feb, 23:10
Yeikel   Re: Pyspark elementwise matrix multiplication Thu, 14 Feb, 04:39
Multiple column aggregations
Sonu Jyotshna   Multiple column aggregations Sat, 09 Feb, 04:46
Shiva Prashanth Vallabhaneni     RE: Multiple column aggregations Mon, 11 Feb, 13:23
Lian Jiang structured streaming handling validation and json flattening Sat, 09 Feb, 19:25
Jacek Laskowski   Re: structured streaming handling validation and json flattening Mon, 11 Feb, 14:59
Phillip Henry     Re: structured streaming handling validation and json flattening Tue, 12 Feb, 09:58
Serega Sheypak Spark on YARN, HowTo kill executor or individual task? Sun, 10 Feb, 12:30
Jörn Franke   Re: Spark on YARN, HowTo kill executor or individual task? Sun, 10 Feb, 15:19
Gabor Somogyi     Re: Spark on YARN, HowTo kill executor or individual task? Sun, 10 Feb, 15:57
Serega Sheypak       Re: Spark on YARN, HowTo kill executor or individual task? Sun, 10 Feb, 20:36
Gabor Somogyi         Re: Spark on YARN, HowTo kill executor or individual task? Sun, 10 Feb, 20:49
Serega Sheypak           Re: Spark on YARN, HowTo kill executor or individual task? Mon, 11 Feb, 09:30
Gabor Somogyi             Re: Spark on YARN, HowTo kill executor or individual task? Mon, 11 Feb, 09:37
Serega Sheypak               Re: Spark on YARN, HowTo kill executor or individual task? Mon, 11 Feb, 13:40
Vadim Semenov                 Re: Spark on YARN, HowTo kill executor or individual task? Mon, 11 Feb, 20:19
Serega Sheypak                   Re: Spark on YARN, HowTo kill executor or individual task? Tue, 12 Feb, 11:40
Vadim Semenov                     Re: Spark on YARN, HowTo kill executor or individual task? Tue, 12 Feb, 18:39
Aakash Basu Data growth vs Cluster Size planning Mon, 11 Feb, 09:40
Phillip Henry   Re: Data growth vs Cluster Size planning Tue, 12 Feb, 11:26
l...@china-inv.cn The spark sql ODBC/JDBC driver that supports Kerbose delegation Tue, 12 Feb, 07:37
Soheil Pourbafrani Create Hive table from CSVfile Tue, 12 Feb, 10:45
另一片天 取消订阅 Wed, 13 Feb, 01:13
Spark with Kubernetes connecting to pod id, not address
Pat Ferrel   Spark with Kubernetes connecting to pod id, not address Wed, 13 Feb, 01:47
Re: Dataset experimental interfaces
yeikel   Re: Dataset experimental interfaces Wed, 13 Feb, 02:06
Allu👌🏽 Thomas Exception in thread "main" org.apache.spark.sql.streaming.StreamingQueryException: Not authorized to access group: spark-kafka-source-060f3ceb-09f4-4e28-8210-3ef8a845fc92--2038748645-driver-2 Wed, 13 Feb, 02:48
Gabor Somogyi   Re: Exception in thread "main" org.apache.spark.sql.streaming.StreamingQueryException: Not authorized to access group: spark-kafka-source-060f3ceb-09f4-4e28-8210-3ef8a845fc92--2038748645-driver-2 Wed, 13 Feb, 09:36
Jungtaek Lim     Re: Exception in thread "main" org.apache.spark.sql.streaming.StreamingQueryException: Not authorized to access group: spark-kafka-source-060f3ceb-09f4-4e28-8210-3ef8a845fc92--2038748645-driver-2 Wed, 13 Feb, 09:53
dawn breaks Got fatal error when running spark 2.4.0 on k8s Wed, 13 Feb, 08:21
Sinha, Breeta (Nokia - IN/Bangalore)   RE: Got fatal error when running spark 2.4.0 on k8s Wed, 13 Feb, 13:10
dawn breaks   Re: Got fatal error when running spark 2.4.0 on k8s Thu, 14 Feb, 03:23
Rafael Mendes Subscribe Wed, 13 Feb, 11:30
Horváth Péter Gergely Spark2 DataFrameWriter.saveAsTable defaults to external table if path is provided Wed, 13 Feb, 11:37
Chris Teoh   Re: Spark2 DataFrameWriter.saveAsTable defaults to external table if path is provided Wed, 13 Feb, 12:08
Horváth Péter Gergely     Re: Spark2 DataFrameWriter.saveAsTable defaults to external table if path is provided Wed, 13 Feb, 16:08
Chris Teoh       Re: Spark2 DataFrameWriter.saveAsTable defaults to external table if path is provided Wed, 13 Feb, 20:29
Thijs Haarhuis SparkR + binary type + how to get value Wed, 13 Feb, 14:01
Felix Cheung   Re: SparkR + binary type + how to get value Thu, 14 Feb, 04:31
Thijs Haarhuis   Re: SparkR + binary type + how to get value Thu, 14 Feb, 12:01
Felix Cheung   Re: SparkR + binary type + how to get value Sun, 17 Feb, 18:18
Thijs Haarhuis   Re: SparkR + binary type + how to get value Tue, 19 Feb, 13:28
Felix Cheung   Re: SparkR + binary type + how to get value Wed, 20 Feb, 03:23
Kumar sp [No Subject] Wed, 13 Feb, 15:51
Kumar sp Design recommendation Wed, 13 Feb, 16:07
Nirav Patel Stage or Tasks level logs missing Wed, 13 Feb, 18:54
Alex Nastetsky "where" clause able to access fields not in its schema Wed, 13 Feb, 22:32
Yeikel   Re: "where" clause able to access fields not in its schema Thu, 14 Feb, 01:03
Vadim Semenov     Re: "where" clause able to access fields not in its schema Thu, 14 Feb, 01:55
Yeikel       Re: "where" clause able to access fields not in its schema Thu, 14 Feb, 05:07
Re: Spark with Kubernetes connecting to pod ID, not address
Pat Ferrel   Re: Spark with Kubernetes connecting to pod ID, not address Thu, 14 Feb, 01:22
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
May 2019281
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137