spark-user mailing list archives: January 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Marcelo Vanzin Re: why does spark web UI keeps changing its port? Mon, 23 Jan, 20:45
hakanilter Spark streaming multiple kafka topic doesn't work at-least-once Mon, 23 Jan, 21:14
Michael Armbrust Re: Setting startingOffsets to earliest in structured streaming never catches up Mon, 23 Jan, 22:18
Marco Mistroni converting timestamp column to a java.util.Date Mon, 23 Jan, 23:18
Takeshi Yamamuro Re: converting timestamp column to a java.util.Date Tue, 24 Jan, 00:59
kant kodali what would be the recommended production requirements? Tue, 24 Jan, 01:09
Matthew Dailey Re: tuning the spark.locality.wait Tue, 24 Jan, 01:19
shyla deshpande How to make the state in a streaming application idempotent? Tue, 24 Jan, 01:41
Matthew Dailey Re: Do jobs fail because of other users of a cluster? Tue, 24 Jan, 01:43
Cody Koeninger Re: Spark streaming multiple kafka topic doesn't work at-least-once Tue, 24 Jan, 02:42
Sirisha Cheruvu hc.sql("hive udf query") not able to convert Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: java.lang.Long cannot be cast to org.apache.hadoop.io.LongWritable Tue, 24 Jan, 04:24
Sirisha Cheruvu Re: Do jobs fail because of other users of a cluster? Tue, 24 Jan, 04:29
Naveen Re: Tue, 24 Jan, 04:40
Sirisha Cheruvu Fwd: hc.sql("hive udf query") not able to convert Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: java.lang.Long cannot be cast to org.apache.hadoop.io.LongWritable Tue, 24 Jan, 04:42
Hakan İlter Re: Spark streaming multiple kafka topic doesn't work at-least-once Tue, 24 Jan, 06:35
Vinayak Joshi5 pyspark.ml Pipeline stages are corrupted under multi-threaded access - is this a bug? Tue, 24 Jan, 09:41
Ravi Prasad Running Hive Beeline .hql file in Spark Tue, 24 Jan, 09:42
haowei tian Can I use speed up my sparse vector operator with mkl? Tue, 24 Jan, 11:07
Mendelson, Assaf Wierd performance on windows laptop Tue, 24 Jan, 11:39
Sirisha Cheruvu help!!!----issue with spark-sql type cast form long to longwritable Tue, 24 Jan, 11:59
David Frese Re: Do jobs fail because of other users of a cluster? Tue, 24 Jan, 12:30
smartzjp Re: why does spark web UI keeps changing its port? Tue, 24 Jan, 12:38
Erwan ALLAIN Failure handling Tue, 24 Jan, 13:50
Deepak Sharma Re: help!!!----issue with spark-sql type cast form long to longwritable Tue, 24 Jan, 15:02
Cody Koeninger Re: Failure handling Tue, 24 Jan, 15:11
Cody Koeninger Re: Spark streaming multiple kafka topic doesn't work at-least-once Tue, 24 Jan, 15:26
Takeshi Yamamuro Re: help!!!----issue with spark-sql type cast form long to longwritable Tue, 24 Jan, 15:49
Koert Kuipers printSchema showing incorrect datatype? Tue, 24 Jan, 16:28
Madabhattula Rajesh Kumar PrefixSpan Tue, 24 Jan, 17:12
shyla deshpande Re: How to make the state in a streaming application idempotent? Tue, 24 Jan, 17:44
Fernando Avalos Node guardian implementation and Spark standalone process Tue, 24 Jan, 18:52
Hakan İlter Re: Spark streaming multiple kafka topic doesn't work at-least-once Tue, 24 Jan, 20:11
Ivan Gozali Re: Sorting each partitions and writing to CSVs Tue, 24 Jan, 20:29
Cody Koeninger Re: Spark streaming multiple kafka topic doesn't work at-least-once Tue, 24 Jan, 20:45
Hakan İlter Re: Spark streaming multiple kafka topic doesn't work at-least-once Tue, 24 Jan, 20:51
Cody Koeninger Re: Spark streaming multiple kafka topic doesn't work at-least-once Tue, 24 Jan, 21:24
Shiyuan best practice for paralleling model training Tue, 24 Jan, 21:48
Jacek Laskowski Re: best practice for paralleling model training Tue, 24 Jan, 22:16
kant kodali How do I dynamically add nodes to spark standalone cluster and be able to discover them? Tue, 24 Jan, 22:41
Jacek Laskowski Re: Spark Streaming proactive monitoring Tue, 24 Jan, 22:44
Koert Kuipers Re: Spark SQL DataFrame to Kafka Topic Tue, 24 Jan, 23:01
shyla deshpande Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 00:01
ayan guha Re: Spark SQL DataFrame to Kafka Topic Wed, 25 Jan, 01:10
Andrew Ehrlich json_tuple fails to parse string with emoji Wed, 25 Jan, 01:14
Takeshi Yamamuro Re: printSchema showing incorrect datatype? Wed, 25 Jan, 01:23
kant kodali How many spark masters and do I need to tolerate one failure in one DC and two AZ? Wed, 25 Jan, 01:37
kant kodali Re: How many spark masters and do I need to tolerate one failure in one DC and two AZ? Wed, 25 Jan, 02:16
kumar r Cached table details Wed, 25 Jan, 04:54
Saulo Ricci [ML - Intermediate - Debug] - Loading Customized Transformers in Apache Spark raised a NullPointerException Wed, 25 Jan, 05:47
shyla deshpande Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 05:53
shyla deshpande Recovering from checkpoint question Wed, 25 Jan, 06:33
marcos rebelo Scala Developers Wed, 25 Jan, 08:24
Selvam Raman is it possible to read .mdb file in spark Wed, 25 Jan, 10:47
Hyukjin Kwon Re: Scala Developers Wed, 25 Jan, 11:26
Sean Owen Re: Scala Developers Wed, 25 Jan, 11:29
Chetan Khatri HBaseContext with Spark Wed, 25 Jan, 11:32
Amrit Jangid Re: HBaseContext with Spark Wed, 25 Jan, 11:39
Petr Shestov Java heap error during matrix multiplication Wed, 25 Jan, 12:23
Andrew Milkowski Re: freeing up memory occupied by processed Stream Blocks Wed, 25 Jan, 14:30
Ted Yu Re: HBaseContext with Spark Wed, 25 Jan, 14:43
Chetan Khatri Re: HBaseContext with Spark Wed, 25 Jan, 15:38
Erwan ALLAIN Re: Failure handling Wed, 25 Jan, 15:45
Ted Yu Re: HBaseContext with Spark Wed, 25 Jan, 15:56
Burak Yavuz Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 17:13
shyla deshpande Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 17:28
Michael Armbrust Re: printSchema showing incorrect datatype? Wed, 25 Jan, 18:04
Bowden, Chris Catalyst Expression(s) - Cleanup Wed, 25 Jan, 18:13
Koert Kuipers Re: printSchema showing incorrect datatype? Wed, 25 Jan, 18:46
Burak Yavuz Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 18:53
Scott walent Spark Summit East in Boston ‒ 20% off Code Wed, 25 Jan, 19:06
shyla deshpande Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 19:24
Burak Yavuz Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 19:28
kant kodali spark intermediate data fills up the disk Wed, 25 Jan, 19:30
satishl Decompressing Spark Eventlogs with snappy (*.snappy) Wed, 25 Jan, 19:32
kant kodali Re: spark intermediate data fills up the disk Wed, 25 Jan, 19:40
Saulo Ricci [ML - Beginner - How To] - GaussianMixtureModel and GaussianMixtureModel$ Wed, 25 Jan, 20:20
shyla deshpande Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 20:23
Subacini Balakrishnan Drop Partition Fails Wed, 25 Jan, 20:23
Burak Yavuz Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 20:27
shyla deshpande Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 20:51
shyla deshpande Re: How to make the state in a streaming application idempotent? Wed, 25 Jan, 21:02
Koert Kuipers can we plz open up encoder on dataset Wed, 25 Jan, 21:17
shyla deshpande where is mapWithState executed? Wed, 25 Jan, 22:33
shyla deshpande Re: where is mapWithState executed? Wed, 25 Jan, 23:18
Aris SparkML 1.6 GBTRegressor crashes with high maxIter hyper-parameter? Wed, 25 Jan, 23:35
Nikhil Goyal Question about DStreamCheckpointData Wed, 25 Jan, 23:52
Ted Yu Re: HBaseContext with Spark Thu, 26 Jan, 01:05
Takeshi Yamamuro Re: freeing up memory occupied by processed Stream Blocks Thu, 26 Jan, 01:56
Ankur Srivastava Issue returning Map from UDAF Thu, 26 Jan, 03:07
Raghavendra Pandey Re: How do I dynamically add nodes to spark standalone cluster and be able to discover them? Thu, 26 Jan, 03:12
Takeshi Yamamuro Re: Catalyst Expression(s) - Cleanup Thu, 26 Jan, 03:15
Xuan Dzung Doan Dataframe fails to save to MySQL table in spark app, but succeeds in spark shell Thu, 26 Jan, 03:42
Takeshi Yamamuro Re: Issue returning Map from UDAF Thu, 26 Jan, 05:08
Takeshi Yamamuro Re: Dataframe fails to save to MySQL table in spark app, but succeeds in spark shell Thu, 26 Jan, 05:13
kant kodali do I need to run spark standalone master with supervisord? Thu, 26 Jan, 06:48
Eric Dain Ingesting Large csv File to relational database Thu, 26 Jan, 07:13
Sidney Feiner [PySpark 2.1.0] - SparkContext not properly initialized by SparkConf Thu, 26 Jan, 07:25
Didac Gil Re: Dataframe fails to save to MySQL table in spark app, but succeeds in spark shell Thu, 26 Jan, 09:28
Jacek Laskowski Re: where is mapWithState executed? Thu, 26 Jan, 10:07
Jacek Laskowski Re: can we plz open up encoder on dataset Thu, 26 Jan, 10:16
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Box list
Jun 202171
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137