spark-user mailing list archives: July 2018

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Re: Setting log level to DEBUG while keeping httpclient.wire on WARN
yujhe.li   Re: Setting log level to DEBUG while keeping httpclient.wire on WARN Sun, 01 Jul, 02:11
Re: Repartition not working on a csv file
yujhe.li   Re: Repartition not working on a csv file Sun, 01 Jul, 02:28
Abdeali Kothari     Re: Repartition not working on a csv file Sun, 01 Jul, 02:52
yujhe.li       Re: Repartition not working on a csv file Sun, 01 Jul, 03:00
Abdeali Kothari         Re: Repartition not working on a csv file Sun, 01 Jul, 03:04
Alexander Czech           Re: Repartition not working on a csv file Sun, 01 Jul, 10:20
Abdeali Kothari             Re: Repartition not working on a csv file Sun, 01 Jul, 11:09
吴晓菊 Unable to acquire N bytes of memory, got 0 Sun, 01 Jul, 12:26
Holden Karau [ANNOUNCE] Apache Spark 2.1.3 Sun, 01 Jul, 19:01
Colin Williams Dataframe reader does not read microseconds, but TimestampType supports microseconds Mon, 02 Jul, 07:03
Jörn Franke   Re: Dataframe reader does not read microseconds, but TimestampType supports microseconds Mon, 02 Jul, 08:05
Imran Rajjad union of multiple twitter streams [spark-streaming-twitter_2.11] Mon, 02 Jul, 10:44
kant kodali Error while doing stream-stream inner join (java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access) Mon, 02 Jul, 10:56
Jungtaek Lim   Re: Error while doing stream-stream inner join (java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access) Tue, 03 Jul, 21:02
Shixiong(Ryan) Zhu   Re: Error while doing stream-stream inner join (java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access) Tue, 03 Jul, 22:12
kant kodali     Re: Error while doing stream-stream inner join (java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access) Wed, 04 Jul, 05:30
Mike Buck Question about Spark, Inner Join and Delegation to a Parquet Table Mon, 02 Jul, 13:23
subramgr [Structured Streaming] Metrics or logs of events that are ignored due to watermark Mon, 02 Jul, 18:39
Jungtaek Lim   Re: [Structured Streaming] Metrics or logs of events that are ignored due to watermark Tue, 03 Jul, 05:42
subramgr     Re: [Structured Streaming] Metrics or logs of events that are ignored due to watermark Tue, 03 Jul, 17:51
Nirav Patel How to avoid duplicate column names after join with multiple conditions Mon, 02 Jul, 21:52
Gokula Krishnan D   Re: How to avoid duplicate column names after join with multiple conditions Fri, 06 Jul, 20:47
Vamshi Talla     Re: How to avoid duplicate column names after join with multiple conditions Mon, 09 Jul, 02:39
Nirav Patel       Re: How to avoid duplicate column names after join with multiple conditions Thu, 12 Jul, 16:20
Prem Sure         Re: How to avoid duplicate column names after join with multiple conditions Thu, 12 Jul, 16:38
Nirav Patel           Re: How to avoid duplicate column names after join with multiple conditions Thu, 12 Jul, 17:23
Prem Sure             Re: How to avoid duplicate column names after join with multiple conditions Fri, 13 Jul, 01:40
Re: Spark Druid Ingestion
gosoy   Re: Spark Druid Ingestion Tue, 03 Jul, 02:56
Aakash Basu [G1GC] -XX: -ResizePLAB How to provide in Spark Submit Tue, 03 Jul, 07:00
Vadim Semenov   Re: [G1GC] -XX: -ResizePLAB How to provide in Spark Submit Tue, 03 Jul, 12:56
Aakash Basu     Re: [G1GC] -XX: -ResizePLAB How to provide in Spark Submit Tue, 03 Jul, 13:36
Aakash Basu Inferring Data driven Spark parameters Tue, 03 Jul, 07:34
Jörn Franke   Re: Inferring Data driven Spark parameters Tue, 03 Jul, 07:39
Aakash Basu     Re: Inferring Data driven Spark parameters Tue, 03 Jul, 08:30
Vadim Semenov       Re: Inferring Data driven Spark parameters Tue, 03 Jul, 12:58
Aakash Basu         Re: Inferring Data driven Spark parameters Wed, 04 Jul, 07:04
Prem Sure           Re: Inferring Data driven Spark parameters Wed, 04 Jul, 14:17
Mich Talebzadeh   Re: Inferring Data driven Spark parameters Wed, 04 Jul, 14:30
Chetan Khatri Run Python User Defined Functions / code in Spark with Scala Codebase Tue, 03 Jul, 11:58
Chetan Khatri   Re: Run Python User Defined Functions / code in Spark with Scala Codebase Wed, 04 Jul, 14:29
Prem Sure     Re: Run Python User Defined Functions / code in Spark with Scala Codebase Wed, 04 Jul, 15:08
Chetan Khatri       Re: Run Python User Defined Functions / code in Spark with Scala Codebase Thu, 05 Jul, 10:39
Jayant Shekhar         Re: Run Python User Defined Functions / code in Spark with Scala Codebase Thu, 05 Jul, 21:26
Chetan Khatri           Re: Run Python User Defined Functions / code in Spark with Scala Codebase Tue, 10 Jul, 04:56
Jayant Shekhar             Re: Run Python User Defined Functions / code in Spark with Scala Codebase Thu, 12 Jul, 08:06
Chetan Khatri               Re: Run Python User Defined Functions / code in Spark with Scala Codebase Mon, 16 Jul, 04:32
Gourav Sengupta                 Re: Run Python User Defined Functions / code in Spark with Scala Codebase Mon, 16 Jul, 13:39
Re: Building SparkML vectors from long data
Patrick McCarthy   Re: Building SparkML vectors from long data Tue, 03 Jul, 16:34
subramgr Number of records per micro-batch in DStream vs Structured Streaming Tue, 03 Jul, 17:55
subramgr   Re: Number of records per micro-batch in DStream vs Structured Streaming Mon, 09 Jul, 03:48
Re: spark 2.3.1 with kafka spark-streaming-kafka-0-10 (java.lang.AbstractMethodError)
Shixiong(Ryan) Zhu   Re: spark 2.3.1 with kafka spark-streaming-kafka-0-10 (java.lang.AbstractMethodError) Tue, 03 Jul, 20:22
Peter Liu     Re: spark 2.3.1 with kafka spark-streaming-kafka-0-10 (java.lang.AbstractMethodError) Tue, 03 Jul, 23:32
thomas lavocat [Spark Streaming MEMORY_ONLY] Understanding Dataflow Wed, 04 Jul, 08:26
Prem Sure   Re: [Spark Streaming MEMORY_ONLY] Understanding Dataflow Wed, 04 Jul, 14:09
Thomas Lavocat     Re: [Spark Streaming MEMORY_ONLY] Understanding Dataflow Thu, 05 Jul, 06:48
Serega Sheypak Kill spark executor when spark runs specific stage Wed, 04 Jul, 17:04
Re: How to branch a Stream / have multiple Sinks / do multiple Queries on one Stream
chandan prakash   Re: How to branch a Stream / have multiple Sinks / do multiple Queries on one Stream Thu, 05 Jul, 06:00
Amiya Mishra     Re: How to branch a Stream / have multiple Sinks / do multiple Queries on one Stream Thu, 05 Jul, 07:33
Tathagata Das       Re: How to branch a Stream / have multiple Sinks / do multiple Queries on one Stream Thu, 05 Jul, 23:00
Amiya Mishra         Re: How to branch a Stream / have multiple Sinks / do multiple Queries on one Stream Fri, 06 Jul, 09:12
chandan prakash           Re: How to branch a Stream / have multiple Sinks / do multiple Queries on one Stream Mon, 09 Jul, 06:05
chandan prakash structured streaming: how to keep counter of error records in log running streaming application Thu, 05 Jul, 06:19
SRK Automatic Json Schema inference using Structured Streaming Thu, 05 Jul, 07:08
chandan prakash   Re: Automatic Json Schema inference using Structured Streaming Mon, 09 Jul, 06:36
Mamillapalli, Purna Pradeep Spark 2.3 Kubernetes error Thu, 05 Jul, 12:46
purna pradeep   Spark 2.3 Kubernetes error Thu, 05 Jul, 12:49
purna pradeep     Spark 2.3 Kubernetes error Fri, 06 Jul, 11:54
bsikander Strange behavior of Spark Masters during rolling update Thu, 05 Jul, 15:55
bsikander   Re: Strange behavior of Spark Masters during rolling update Mon, 09 Jul, 08:19
Fwd: BeakerX 1.0 released
s...@draves.org   Fwd: BeakerX 1.0 released Thu, 05 Jul, 21:33
unsubscribe
Peter   unsubscribe Thu, 05 Jul, 22:02
BEKHTI, Abdelmajid   unsubscribe Fri, 06 Jul, 07:55
[SPARK on MESOS] Avoid re-fetching Spark binary
Tien Dat   [SPARK on MESOS] Avoid re-fetching Spark binary Fri, 06 Jul, 08:00
Timothy Chen     Re: [SPARK on MESOS] Avoid re-fetching Spark binary Fri, 06 Jul, 08:32
Tien Dat       Re: [SPARK on MESOS] Avoid re-fetching Spark binary Fri, 06 Jul, 08:57
Timothy Chen         Re: [SPARK on MESOS] Avoid re-fetching Spark binary Fri, 06 Jul, 09:18
Tien Dat           Re: [SPARK on MESOS] Avoid re-fetching Spark binary Fri, 06 Jul, 10:12
Timothy Chen             Re: [SPARK on MESOS] Avoid re-fetching Spark binary Fri, 06 Jul, 23:06
Mark Hamstra               Re: [SPARK on MESOS] Avoid re-fetching Spark binary Sun, 08 Jul, 05:31
Mark Hamstra             Re: [SPARK on MESOS] Avoid re-fetching Spark binary Fri, 06 Jul, 23:21
Mark Hamstra   Re: [SPARK on MESOS] Avoid re-fetching Spark binary Tue, 10 Jul, 15:49
Tien Dat     Re: [SPARK on MESOS] Avoid re-fetching Spark binary Wed, 11 Jul, 10:40
Tien Dat Retry option and range resource configuration for Spark job on Mesos Fri, 06 Jul, 14:42
Timothy Chen   Re: Retry option and range resource configuration for Spark job on Mesos Fri, 06 Jul, 23:00
anna stax Unable to see the table created using saveAsTable From Beeline. Please help! Fri, 06 Jul, 23:10
anna stax   Re: Unable to see the table created using saveAsTable From Beeline. Please help! Sat, 07 Jul, 15:12
Mich Talebzadeh     Re: Unable to see the table created using saveAsTable From Beeline. Please help! Sat, 07 Jul, 22:25
amin MH Structured streaming Sat, 07 Jul, 14:20
kant kodali spark-shell gets stuck in ACCEPTED state forever when ran in YARN client mode. Sun, 08 Jul, 13:58
Marco Mistroni   Re: spark-shell gets stuck in ACCEPTED state forever when ran in YARN client mode. Sun, 08 Jul, 14:19
kant kodali     Re: spark-shell gets stuck in ACCEPTED state forever when ran in YARN client mode. Sun, 08 Jul, 14:40
yohann jardin       Re: spark-shell gets stuck in ACCEPTED state forever when ran in YARN client mode. Sun, 08 Jul, 15:02
kant kodali         Re: spark-shell gets stuck in ACCEPTED state forever when ran in YARN client mode. Sun, 08 Jul, 15:09
kant kodali           Re: spark-shell gets stuck in ACCEPTED state forever when ran in YARN client mode. Sun, 08 Jul, 16:11
yohann jardin             Re: spark-shell gets stuck in ACCEPTED state forever when ran in YARN client mode. Sun, 08 Jul, 17:27
kant kodali               Re: spark-shell gets stuck in ACCEPTED state forever when ran in YARN client mode. Mon, 09 Jul, 02:36
kant kodali                 Re: spark-shell gets stuck in ACCEPTED state forever when ran in YARN client mode. Mon, 09 Jul, 11:14
☼ R Nair (रविशंकर नायर)     Re: spark-shell gets stuck in ACCEPTED state forever when ran in YARN client mode. Sun, 08 Jul, 14:47
Re: Create an Empty dataframe
Shmuel Blitz   Re: Create an Empty dataframe Sun, 08 Jul, 14:43
☼ R Nair (रविशंकर नायर)     Re: Create an Empty dataframe Sun, 08 Jul, 14:50
ryanda...@gmail.com repartition Sun, 08 Jul, 16:26
Vamshi Talla   Re: repartition Mon, 09 Jul, 02:32
Rich Bowen Register now for ApacheCon and save $250 Mon, 09 Jul, 14:31
bsikander [REST API] Rest API unusable due to application id changing Mon, 09 Jul, 16:05
Thodoris Zois Spark on Mesos - Weird behavior Mon, 09 Jul, 18:04
Pavel Plotnikov   Re: Spark on Mesos - Weird behavior Tue, 10 Jul, 11:35
Thodoris Zois     Re: Spark on Mesos - Weird behavior Tue, 10 Jul, 14:07
Pavel Plotnikov       Re: Spark on Mesos - Weird behavior Wed, 11 Jul, 14:09
Thodoris Zois         Re: Spark on Mesos - Weird behavior Wed, 11 Jul, 14:10
Pavel Plotnikov           Re: Spark on Mesos - Weird behavior Wed, 11 Jul, 14:22
Susan X. Huynh             Re: Spark on Mesos - Weird behavior Mon, 23 Jul, 17:55
Thodoris Zois               Re: Spark on Mesos - Weird behavior Mon, 23 Jul, 21:31
Nirav Patel Dataframe joins - UnsupportedOperationException: Unimplemented type: IntegerType Mon, 09 Jul, 18:53
Vadim Semenov   Re: Dataframe joins - UnsupportedOperationException: Unimplemented type: IntegerType Mon, 09 Jul, 19:53
Jeffrey Charles Dynamic allocation not releasing executors after unpersisting all cached data Mon, 09 Jul, 18:59
Vadim Semenov   Re: Dynamic allocation not releasing executors after unpersisting all cached data Mon, 09 Jul, 19:51
Jeffrey Charles     Re: Dynamic allocation not releasing executors after unpersisting all cached data Tue, 10 Jul, 16:54
trung kien Kubernetes security context when submitting job through k8s servers Mon, 09 Jul, 21:05
Yinan Li   Re: Kubernetes security context when submitting job through k8s servers Mon, 09 Jul, 21:47
trung kien     Re: Kubernetes security context when submitting job through k8s servers Mon, 09 Jul, 22:46
Yinan Li       Re: Kubernetes security context when submitting job through k8s servers Mon, 09 Jul, 22:55
Mohit Jaggi Pyspark access to scala/java libraries Mon, 09 Jul, 22:45
Mohit Jaggi   Re: Pyspark access to scala/java libraries Sun, 15 Jul, 06:01
Holden Karau     Re: Pyspark access to scala/java libraries Sun, 15 Jul, 10:01
Mohit Jaggi       Re: Pyspark access to scala/java libraries Tue, 17 Jul, 22:30
HARSH TAKKAR         Re: Pyspark access to scala/java libraries Wed, 18 Jul, 12:03
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
Dec 201966
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137