spark-user mailing list archives: June 2020

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Re: Spark Security
Wilbert S.   Re: Spark Security Mon, 01 Jun, 12:19
Sean Owen     Re: Spark Security Mon, 01 Jun, 13:59
Wilbert S.   Re: Spark Security Mon, 01 Jun, 12:20
Rishi Shah [PySpark 2.3+] Reading parquet entire path vs a set of file paths Mon, 01 Jun, 13:33
Rishi Shah   Re: [PySpark 2.3+] Reading parquet entire path vs a set of file paths Wed, 03 Jun, 18:15
Re: Using Spark Accumulators with Structured Streaming
ZHANG Wei   Re: Using Spark Accumulators with Structured Streaming Tue, 02 Jun, 02:28
ZHANG Wei     Re: Using Spark Accumulators with Structured Streaming Thu, 04 Jun, 06:56
Something Something       Re: Using Spark Accumulators with Structured Streaming Mon, 08 Jun, 05:44
Srinivas V         Re: Using Spark Accumulators with Structured Streaming Mon, 08 Jun, 17:58
Something Something           Re: Using Spark Accumulators with Structured Streaming Mon, 08 Jun, 18:54
Something Something             Re: Using Spark Accumulators with Structured Streaming Mon, 08 Jun, 18:57
Srinivas V               Re: Using Spark Accumulators with Structured Streaming Mon, 08 Jun, 19:06
Something Something                 Re: Using Spark Accumulators with Structured Streaming Tue, 09 Jun, 01:53
Chetan Khatri Join on Condition provide at run time Tue, 02 Jun, 15:53
Manjunath Shetty H Spark stage stuck Tue, 02 Jun, 16:45
charles_cai NoClassDefFoundError: scala/Product$class Wed, 03 Jun, 05:44
Pol Santamaria   Re: NoClassDefFoundError: scala/Product$class Wed, 03 Jun, 08:37
charles_cai     Re: NoClassDefFoundError: scala/Product$class Sat, 06 Jun, 04:10
Sean Owen       Re: NoClassDefFoundError: scala/Product$class Sat, 06 Jun, 13:47
James Moore       Re: NoClassDefFoundError: scala/Product$class Sat, 06 Jun, 22:23
charles_cai         Re: NoClassDefFoundError: scala/Product$class Mon, 08 Jun, 01:59
YuqingWan WARN ProcfsMetricsGetter: Exception when trying to compute pagesize, as a result reporting of ProcessTree metrics is stopped Thu, 04 Jun, 03:12
Boris Litvak [Spark RDD] Persisting Spark RDDs across spark contexts/applications - options Thu, 04 Jun, 07:11
Bin Fan   Re: [Spark RDD] Persisting Spark RDDs across spark contexts/applications - options Thu, 04 Jun, 17:42
Re: [PySpark] Tagging descriptions
Rishi Shah   Re: [PySpark] Tagging descriptions Thu, 04 Jun, 20:14
gpatcham How to set Description in UI SQL tab Thu, 04 Jun, 20:20
VP   Re: How to set Description in UI SQL tab Fri, 05 Jun, 11:17
Stone Zhong Add python library with native code Fri, 05 Jun, 07:42
Dark Crusader   Re: Add python library with native code Fri, 05 Jun, 02:32
Stone Zhong     Re: Add python library with native code Fri, 05 Jun, 08:29
Masood Krohy       Re: Add python library with native code Sat, 06 Jun, 02:46
Stone Zhong         Re: Add python library with native code Sat, 06 Jun, 12:04
Anwar AliKhan     Add python library Sat, 06 Jun, 20:16
Patrick McCarthy       Re: Add python library Mon, 08 Jun, 14:01
Unsubscribe
Sunil Prabhakara   Unsubscribe Sat, 06 Jun, 13:49
Angel Angel   Unsubscribe Thu, 11 Jun, 16:27
Mishra, Dhiraj A.     [External] Unsubscribe Thu, 11 Jun, 17:07
Punna Yenumala   Unsubscribe Sun, 21 Jun, 20:20
Wesley     Re: Unsubscribe Mon, 22 Jun, 00:58
Rishi Shah [pyspark 2.3+] Add scala library to pyspark app and use to derive columns Sat, 06 Jun, 17:05
Sunil Kalra Spark :- Update record in partition. Sun, 07 Jun, 16:35
ayan guha   Re: Spark :- Update record in partition. Sun, 07 Jun, 22:12
ArtemisDev Structured Streaming using File Source - How to handle live files Sun, 07 Jun, 17:41
Jungtaek Lim   Re: Structured Streaming using File Source - How to handle live files Sun, 07 Jun, 21:35
Gourav Sengupta     Re: Structured Streaming using File Source - How to handle live files Sat, 13 Jun, 09:45
unsubscribe
Arkadiy Ver   unsubscribe Mon, 08 Jun, 05:12
Wesley     Re: unsubscribe Mon, 08 Jun, 05:42
Marian Zsemlye   unsubscribe Mon, 08 Jun, 05:26
Ferguson, Jon   unsubscribe Wed, 17 Jun, 10:39
Jeff Evans     Re: unsubscribe Wed, 17 Jun, 13:32
DIALLO Ibrahima (BPCE-IT - Consultime)   unsubscribe Wed, 17 Jun, 13:56
Jeff Evans     Re: unsubscribe Wed, 17 Jun, 14:11
Jeff Evans   Re: unsubscribe Sat, 27 Jun, 23:20
Wesley Peng   Re: unsubscribe Sun, 28 Jun, 00:22
stephen   unsubscribe Mon, 29 Jun, 00:56
xufei   unsubscribe Mon, 29 Jun, 03:47
obaidul karim   unsubscribe Mon, 29 Jun, 15:34
Bartłomiej Niemienionek   unsubscribe Tue, 30 Jun, 18:31
Jeff Evans     Re: unsubscribe Tue, 30 Jun, 18:44
ilaimalka we control spark file names before we write them - should we opensource it? Mon, 08 Jun, 13:16
Stefan Panayotov   RE: we control spark file names before we write them - should we opensource it? Mon, 08 Jun, 13:55
ilaimalka     RE: we control spark file names before we write them - should we opensource it? Mon, 22 Jun, 10:48
Panos Bletsos   Re: we control spark file names before we write them - should we opensource it? Mon, 08 Jun, 14:46
ilaimalka     Re: we control spark file names before we write them - should we opensource it? Mon, 22 Jun, 10:44
Sunil Pasumarthi Out of memory causing due to high number of spark submissions in FIFO mode Tue, 09 Jun, 07:40
Ablaye FAYE [PySpark CrossValidator] Dropping column randCol before fitting model Tue, 09 Jun, 08:59
Re: [SPARK-30957][SQL] Null-safe variant of Dataset.join(Dataset[_], Seq[String])
Alexandros Biratsis   Re: [SPARK-30957][SQL] Null-safe variant of Dataset.join(Dataset[_], Seq[String]) Tue, 09 Jun, 10:59
Srinivas V [spark-structured-streaming] [kafka] consume topics from multiple Kafka clusters Tue, 09 Jun, 16:10
German SM   Re: [spark-structured-streaming] [kafka] consume topics from multiple Kafka clusters Tue, 09 Jun, 16:18
Srinivas V     Re: [spark-structured-streaming] [kafka] consume topics from multiple Kafka clusters Tue, 09 Jun, 16:30
Gerard Maas       Re: [spark-structured-streaming] [kafka] consume topics from multiple Kafka clusters Tue, 09 Jun, 18:00
Srinivas V         Re: [spark-structured-streaming] [kafka] consume topics from multiple Kafka clusters Tue, 09 Jun, 18:07
a s how can i write spark addListener metric to kafka Tue, 09 Jun, 20:40
Tathagata Das   Re: how can i write spark addListener metric to kafka Tue, 09 Jun, 22:01
Tzahi File Issue with pyspark query Wed, 10 Jun, 11:24
Mich Talebzadeh Accessing Teradata DW data from Spark Wed, 10 Jun, 16:49
Gourav Sengupta   Re: Accessing Teradata DW data from Spark Sat, 13 Jun, 09:52
tcon...@gmail.com Broadcast join data reuse Thu, 11 Jun, 00:09
Ankur Srivastava   Re: Broadcast join data reuse Thu, 11 Jun, 16:18
gypsysunny     Re: Broadcast join data reuse Mon, 15 Jun, 16:59
Nasrulla Khan Haris Does Spark SQL support GRANT/REVOKE operations on Tables? Thu, 11 Jun, 00:55
Nasrulla Khan Haris   RE: Does Spark SQL support GRANT/REVOKE operations on Tables? Thu, 11 Jun, 03:43
Bill Glennon     Re: Does Spark SQL support GRANT/REVOKE operations on Tables? Thu, 11 Jun, 04:30
Holden Karau [ANNOUNCE] Apache Spark 2.4.6 released Thu, 11 Jun, 01:37
Hyukjin Kwon   Re: [ANNOUNCE] Apache Spark 2.4.6 released Thu, 11 Jun, 01:59
Dongjoon Hyun     Re: [ANNOUNCE] Apache Spark 2.4.6 released Thu, 11 Jun, 02:15
Takeshi Yamamuro       Re: [ANNOUNCE] Apache Spark 2.4.6 released Thu, 11 Jun, 02:26
Re: Arrow RecordBatches/Pandas Dataframes to (Arrow enabled) Spark Dataframe conversion in streaming fashion
Tanveer Ahmad - EWI   Re: Arrow RecordBatches/Pandas Dataframes to (Arrow enabled) Spark Dataframe conversion in streaming fashion Thu, 11 Jun, 15:05
AaronLee Spark ml how to extract split points from trained decision tree mode Thu, 11 Jun, 23:57
Sean Owen   Re: Spark ml how to extract split points from trained decision tree mode Fri, 12 Jun, 00:28
AaronLee     Re: Spark ml how to extract split points from trained decision tree mode Fri, 12 Jun, 03:35
Sean Owen       Re: Spark ml how to extract split points from trained decision tree mode Fri, 12 Jun, 04:04
AaronLee         Re: Spark ml how to extract split points from trained decision tree mode Fri, 12 Jun, 05:16
AaronLee           Re: Spark ml how to extract split points from trained decision tree mode Fri, 12 Jun, 19:33
hashbon...@hushmail.com.INVALID Re: Unsubscribe martha focker Fri, 12 Jun, 02:55
charles_cai GPU Acceleration for spark-3.0.0 Sat, 13 Jun, 03:50
Bobby Evans   Re: GPU Acceleration for spark-3.0.0 Mon, 15 Jun, 12:44
charles_cai     Re: GPU Acceleration for spark-3.0.0 Thu, 18 Jun, 04:17
Bobby Evans       Re: GPU Acceleration for spark-3.0.0 Thu, 18 Jun, 14:05
Srinivas V [spark-structured-streaming] [stateful] Sun, 14 Jun, 06:47
krchia [2.4.5 Standalone Master]: Idle cores not being allocated Mon, 15 Jun, 12:01
GroupBy issue while running K-Means - Dataframe
Deepak Sharma   GroupBy issue while running K-Means - Dataframe Tue, 16 Jun, 07:29
Tanveer Ahmad - EWI Spark dataframe creation through already distributed in-memory data sets Tue, 16 Jun, 14:01
shensonj Check point storage and its redundancy Tue, 16 Jun, 17:06
lk_spark how to know what happen between tasks launch Wed, 17 Jun, 11:29
Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues)
Rachana Srivastava   Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Wed, 17 Jun, 13:44
Rachana Srivastava     How to manage offsets in Spark Structured Streaming? Wed, 17 Jun, 16:00
Tathagata Das     Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Wed, 17 Jun, 17:33
Jungtaek Lim       Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Wed, 17 Jun, 21:02
Breno Arosa         Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Wed, 17 Jun, 21:23
Rachana Srivastava         Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Wed, 17 Jun, 21:31
Rachana Srivastava           Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Wed, 17 Jun, 21:46
Rachana Srivastava         Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Wed, 17 Jun, 22:03
Jacek Laskowski           Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Thu, 18 Jun, 10:23
Rachana Srivastava             Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Thu, 18 Jun, 15:22
Burak Yavuz               Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Thu, 18 Jun, 23:03
Jungtaek Lim                 Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Fri, 19 Jun, 00:16
Jacek Laskowski                   Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Fri, 19 Jun, 09:02
Bartosz Konieczny                     Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Fri, 19 Jun, 10:41
Jungtaek Lim                       Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Fri, 19 Jun, 11:09
Bartosz Konieczny                         Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Fri, 19 Jun, 11:40
Rachana Srivastava                           Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Fri, 19 Jun, 21:14
Rachana Srivastava                             Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Mon, 22 Jun, 18:28
Bartosz Konieczny                               Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Tue, 23 Jun, 04:38
murat migdisoglu                                 elasticsearch-hadoop is not compatible with spark 3.0( scala 2.12) Tue, 23 Jun, 11:48
Rachana Srivastava                       Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Fri, 19 Jun, 11:25
Rachana Srivastava                 Re: Is Spark Structured Streaming TOTALLY BROKEN (Spark Metadata Issues) Fri, 19 Jun, 10:55
murat migdisoglu java.lang.ClassNotFoundException: com.hortonworks.spark.cloud.commit.PathOutputCommitProtoco Wed, 17 Jun, 22:35
murat migdisoglu   Re: java.lang.ClassNotFoundException for s3a comitter Fri, 19 Jun, 00:24
Stephen Coy     Re: java.lang.ClassNotFoundException for s3a comitter Fri, 19 Jun, 02:07
Steve Loughran     Re: java.lang.ClassNotFoundException for s3a comitter Mon, 29 Jun, 12:34
Chetan Khatri Reading TB of JSON file Thu, 18 Jun, 13:11
Patrick McCarthy   Re: Reading TB of JSON file Thu, 18 Jun, 13:14
Chetan Khatri     Re: Reading TB of JSON file Thu, 18 Jun, 13:33
Jörn Franke   Re: Reading TB of JSON file Thu, 18 Jun, 13:16
Chetan Khatri     Re: Reading TB of JSON file Thu, 18 Jun, 13:34
Gourav Sengupta       Re: Reading TB of JSON file Thu, 18 Jun, 16:34
Chetan Khatri         Re: Reading TB of JSON file Fri, 19 Jun, 12:36
nihed mbarek   Re: Reading TB of JSON file Thu, 18 Jun, 13:19
Stephan Wehner   Re: Reading TB of JSON file Thu, 18 Jun, 16:54
Chetan Khatri     Re: Reading TB of JSON file Fri, 19 Jun, 12:37
Jörn Franke       Re: Reading TB of JSON file Fri, 19 Jun, 12:39
Chetan Khatri         Re: Reading TB of JSON file Fri, 19 Jun, 12:41
Message list1 · 2 · Next »Thread · Author · Date
Box list
Jul 2021141
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137