spark-user mailing list archives: May 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Martin Engen Structured Streaming, Reading and Updating a variable Tue, 15 May, 13:23
Koert Kuipers   Re: Structured Streaming, Reading and Updating a variable Tue, 15 May, 15:23
Lalwani, Jayesh   Re: Structured Streaming, Reading and Updating a variable Tue, 15 May, 19:59
Martin Engen   Re: Structured Streaming, Reading and Updating a variable Wed, 16 May, 10:22
Mina Aslani OneHotEncoderEstimator - java.lang.NoSuchMethodError: org.apache.spark.sql.Dataset.withColumns Tue, 15 May, 14:58
Matteo Cossu   Re: OneHotEncoderEstimator - java.lang.NoSuchMethodError: org.apache.spark.sql.Dataset.withColumns Fri, 18 May, 07:57
Bryan Cutler     Re: OneHotEncoderEstimator - java.lang.NoSuchMethodError: org.apache.spark.sql.Dataset.withColumns Fri, 18 May, 17:13
HARSH TAKKAR Sklearn model in pyspark prediction Tue, 15 May, 16:38
Mina Aslani java.lang.IllegalArgumentException: requirement failed: BLAS.dot(x: Vector, y:Vector) was given Vectors with non-matching sizes Tue, 15 May, 17:53
Yuta Morisawa Continuous Processing mode behaves differently from Batch mode Wed, 16 May, 00:38
Shixiong(Ryan) Zhu   Re: Continuous Processing mode behaves differently from Batch mode Wed, 16 May, 06:24
Yuta Morisawa     Re: Continuous Processing mode behaves differently from Batch mode Fri, 18 May, 01:41
karthikjay [structured-streaming][kafka] Will the Kafka readstream timeout after connections.max.idle.ms 540000 ms ? Wed, 16 May, 01:25
Shixiong(Ryan) Zhu   Re: [structured-streaming][kafka] Will the Kafka readstream timeout after connections.max.idle.ms 540000 ms ? Wed, 16 May, 06:38
Daniel Galvez Interest in adding ability to request GPU's to the spark client? Wed, 16 May, 05:58
xmehaut [Java] impact of java 10 on spark dev Wed, 16 May, 06:20
Jörn Franke   Re: [Java] impact of java 10 on spark dev Wed, 16 May, 08:44
weand OOM: Structured Streaming aggregation state not cleaned up propertly Wed, 16 May, 09:55
weand   Re: OOM: Structured Streaming aggregation state not cleaned up propertly Sat, 19 May, 10:30
abhijeet bedagkar Datafarme save as table operation is failing when the child columns name contains special characters Wed, 16 May, 12:43
abhijeet bedagkar   Re: Datafarme save as table operation is failing when the child columns name contains special characters Wed, 30 May, 08:18
prudhviraj202m Structured Streaming Job stops abruptly and No errors logged Wed, 16 May, 17:32
varma dantuluri Unsubscribe Wed, 16 May, 20:39
Shiyuan Submit many spark applications Wed, 16 May, 20:45
Marcelo Vanzin   Re: Submit many spark applications Wed, 16 May, 21:24
ayan guha     Re: Submit many spark applications Wed, 16 May, 22:42
raksja     Re: Submit many spark applications Wed, 23 May, 19:04
Marcelo Vanzin       Re: Submit many spark applications Wed, 23 May, 19:09
raksja         Re: Submit many spark applications Fri, 25 May, 17:09
Marcelo Vanzin           Re: Submit many spark applications Fri, 25 May, 17:10
raksja             Re: Submit many spark applications Fri, 25 May, 17:18
Marcelo Vanzin               Re: Submit many spark applications Fri, 25 May, 17:20
raksja                 Re: Submit many spark applications Fri, 25 May, 17:23
Marcelo Vanzin                   Re: Submit many spark applications Fri, 25 May, 17:24
yncxcw   Re: Submit many spark applications Fri, 25 May, 17:40
Ofer Eliassaf PySpark Structured Streaming - using previous iteration computed results in current iteration Thu, 17 May, 05:18
Biplob Biswas Spark Jobs ends when assignment not found for Kafka Partition Thu, 17 May, 08:28
JF Chen Snappy file compatible problem with spark Thu, 17 May, 08:59
JF Chen   Re: Snappy file compatible problem with spark Thu, 17 May, 09:55
karthikjay [structured-streaming] foreachPartition alternative in structured streaming. Thu, 17 May, 20:30
SparkUser6 Getting Data From Hbase using Spark is Extremely Slow Fri, 18 May, 00:21
ShaoFeng Shi Using Apache Kylin as data source for Spark Fri, 18 May, 03:56
Li Yang   Re: Using Apache Kylin as data source for Spark Sat, 26 May, 05:49
Shiyuan Exception thrown in awaitResult during application launch in yarn cluster Fri, 18 May, 07:12
Esa Heikkinen How to Spark can solve this example Fri, 18 May, 07:20
Matteo Cossu   Re: How to Spark can solve this example Fri, 18 May, 07:51
Esa Heikkinen     RE: How to Spark can solve this example Fri, 18 May, 07:59
정유선님(JUNG YOUSUN)     RE: How to Spark can solve this example Fri, 18 May, 09:12
shubham Understanding the results from Spark's KMeans clustering object Fri, 18 May, 07:53
peay Spark on YARN in client-mode: do we need 1 vCore for the AM? Fri, 18 May, 10:20
Jeff Zhang   Re: Spark on YARN in client-mode: do we need 1 vCore for the AM? Fri, 25 May, 01:09
Chao Fang RDD does not have sc error Fri, 18 May, 15:37
karthikjay Spark job terminated without any errors Fri, 18 May, 20:44
Aakash Basu XGBoost on PySpark Sat, 19 May, 06:51
Aakash Basu   Fwd: XGBoost on PySpark Wed, 23 May, 06:02
SparkUser6 Spark is not evenly distributing data Sat, 19 May, 19:52
kedarsdixit   Re: Spark is not evenly distributing data Wed, 23 May, 12:02
Ted Yu Re: OOM: Structured Streaming aggregation state not cleaned up properly Sat, 19 May, 20:40
weand   Re: OOM: Structured Streaming aggregation state not cleaned up properly Tue, 22 May, 07:24
weand     Re: OOM: Structured Streaming aggregation state not cleaned up properly Tue, 22 May, 07:29
Jungtaek Lim       Re: OOM: Structured Streaming aggregation state not cleaned up properly Tue, 22 May, 08:21
Tathagata Das         Re: OOM: Structured Streaming aggregation state not cleaned up properly Tue, 22 May, 23:06
weand           Re: OOM: Structured Streaming aggregation state not cleaned up properly Wed, 23 May, 10:12
Jungtaek Lim             Re: OOM: Structured Streaming aggregation state not cleaned up properly Wed, 23 May, 11:01
Spark UNEVENLY distributing data
Alchemist   Spark UNEVENLY distributing data Sat, 19 May, 22:40
Saad Mufti     Re: Spark UNEVENLY distributing data Tue, 22 May, 17:55
giri ar Does Spark shows logical or physical plan when executing job on the yarn cluster Sun, 20 May, 07:21
Ajay   Re: Does Spark shows logical or physical plan when executing job on the yarn cluster Sun, 20 May, 07:26
kant kodali is it possible to create one KafkaDirectStream (Dstream) per topic? Sun, 20 May, 22:24
Alonso Isidoro Roman   Re: is it possible to create one KafkaDirectStream (Dstream) per topic? Mon, 21 May, 08:44
Re: [Spark2.1] SparkStreaming to Cassandra performance problem
Saulo Sobreiro   Re: [Spark2.1] SparkStreaming to Cassandra performance problem Mon, 21 May, 02:34
Alonso Isidoro Roman     Re: [Spark2.1] SparkStreaming to Cassandra performance problem Mon, 21 May, 10:01
Russell Spitzer       Re: [Spark2.1] SparkStreaming to Cassandra performance problem Mon, 21 May, 13:09
Saulo Sobreiro         Re: [Spark2.1] SparkStreaming to Cassandra performance problem Mon, 28 May, 21:32
JF Chen How to skip nonexistent file when read files with spark? Mon, 21 May, 03:30
Thakrar, Jayesh   Re: How to skip nonexistent file when read files with spark? Mon, 21 May, 13:01
JF Chen     Re: How to skip nonexistent file when read files with spark? Tue, 22 May, 01:27
ayan guha       Re: How to skip nonexistent file when read files with spark? Tue, 22 May, 02:33
JF Chen         Re: How to skip nonexistent file when read files with spark? Tue, 22 May, 03:20
Thakrar, Jayesh           Re: How to skip nonexistent file when read files with spark? Tue, 22 May, 03:22
JF Chen             Re: How to skip nonexistent file when read files with spark? Tue, 22 May, 03:46
Javier Pareja Executors slow down when running on the same node Mon, 21 May, 08:53
Malveeka Bhandari Adding jars Mon, 21 May, 09:23
kedarsdixit   Re: Adding jars Wed, 23 May, 11:58
Sushil Kotnala     Re: Adding jars Wed, 23 May, 12:04
kedarsdixit       Re: Adding jars Wed, 23 May, 12:09
Sushil Kotnala         Re: Adding jars Wed, 23 May, 12:31
kedarsdixit           Re: Adding jars Wed, 23 May, 12:54
Steve Pruitt testing frameworks Mon, 21 May, 12:24
Holden Karau   Re: testing frameworks Mon, 21 May, 15:32
Steve Pruitt     RE: [EXTERNAL] - Re: testing frameworks Tue, 22 May, 17:48
Joel D       Re: [EXTERNAL] - Re: testing frameworks Tue, 22 May, 18:34
umargeek   Re: testing frameworks Wed, 23 May, 05:07
Spico Florin     Re: testing frameworks Wed, 30 May, 11:14
Holden Karau       Re: testing frameworks Wed, 30 May, 12:11
amit kumar singh help in copying data from one azure subscription to another azure subscription Mon, 21 May, 12:59
Pushkar.Gujar   Re: help in copying data from one azure subscription to another azure subscription Thu, 24 May, 01:16
unk1102 Spark horizontal scaling is not supported in which cluster mode? Ask Mon, 21 May, 16:29
Mark Hamstra   Re: Spark horizontal scaling is not supported in which cluster mode? Ask Mon, 21 May, 17:26
Spark Worker Re-register to Master
sushil.chaudhary   Spark Worker Re-register to Master Mon, 21 May, 19:04
sushil.chaudhary     Re: Spark Worker Re-register to Master Tue, 22 May, 13:57
sushil.chaudhary   Spark Worker Re-register to Master Mon, 21 May, 19:05
Makoto Hashimoto Encounter 'Could not find or load main class' error when submitting spark job on kubernetes Tue, 22 May, 07:45
Marcelo Vanzin   Re: Encounter 'Could not find or load main class' error when submitting spark job on kubernetes Tue, 22 May, 16:09
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Jan 202195
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137