spark-user mailing list archives: February 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Eugene Morozov Fair scheduler pool details Sun, 21 Feb, 00:14
Mark Hamstra   Re: Fair scheduler pool details Sun, 21 Feb, 01:32
Walid LEZZAR Constantly increasing Spark streaming heap memory Sun, 21 Feb, 00:37
Robin East   Re: Constantly increasing Spark streaming heap memory Mon, 22 Feb, 08:30
Glen how to set database in DataFrame.saveAsTable? Sun, 21 Feb, 01:55
gen tang   Re: how to set database in DataFrame.saveAsTable? Sun, 21 Feb, 02:04
Glen     Re: how to set database in DataFrame.saveAsTable? Sun, 21 Feb, 03:26
Mich Talebzadeh       RE: how to set database in DataFrame.saveAsTable? Sun, 21 Feb, 09:35
Jacky Wang         Re:RE: how to set database in DataFrame.saveAsTable? Sun, 21 Feb, 23:54
Mich Talebzadeh           Re:RE: how to set database in DataFrame.saveAsTable? Sun, 21 Feb, 23:57
tuan3w Element appear in both 2 splits of RDD after using randomSplit Sun, 21 Feb, 03:01
Ted Yu   Re: Element appear in both 2 splits of RDD after using randomSplit Sun, 21 Feb, 04:12
nguyen duc tuan     Re: Element appear in both 2 splits of RDD after using randomSplit Sun, 21 Feb, 10:35
Weiwei Zhang Behind the scene of RDD to DataFrame Sun, 21 Feb, 06:18
Hemant Bhanawat   Re: Behind the scene of RDD to DataFrame Sun, 21 Feb, 07:53
Weiwei Zhang     Re: Behind the scene of RDD to DataFrame Sun, 21 Feb, 17:30
Franc Carter filter by dict() key in pySpark Sun, 21 Feb, 11:41
Franc Carter   Re: filter by dict() key in pySpark Wed, 24 Feb, 10:14
Fwd: Evaluating spark streaming use case
Jatin Kumar   Fwd: Evaluating spark streaming use case Sun, 21 Feb, 11:54
Gerard Maas     Re: Evaluating spark streaming use case Sun, 21 Feb, 12:16
Ted Yu       Re: Evaluating spark streaming use case Sun, 21 Feb, 17:22
Chris Fregly         Re: Evaluating spark streaming use case Sun, 21 Feb, 18:47
Ted Yu           Re: Evaluating spark streaming use case Sun, 21 Feb, 18:54
Prathamesh Dharangutte spark-xml can't recognize schema Sun, 21 Feb, 13:19
Sebastian Piu   Re: spark-xml can't recognize schema Sun, 21 Feb, 13:40
Prathamesh Dharangutte     Re: spark-xml can't recognize schema Sun, 21 Feb, 14:14
Sebastian Piu       Re: spark-xml can't recognize schema Sun, 21 Feb, 14:29
Prathamesh Dharangutte         Re: spark-xml can't recognize schema Sun, 21 Feb, 14:34
Sebastian Piu           Re: spark-xml can't recognize schema Sun, 21 Feb, 14:36
Dave Moyers       Re: spark-xml can't recognize schema Sun, 21 Feb, 16:12
Tenghuan He RDD[org.apache.spark.sql.Row] filter ERROR Sun, 21 Feb, 14:42
Ted Yu   Re: RDD[org.apache.spark.sql.Row] filter ERROR Sun, 21 Feb, 14:53
Tenghuan He     Re: RDD[org.apache.spark.sql.Row] filter ERROR Sun, 21 Feb, 18:16
Ted Yu       Re: RDD[org.apache.spark.sql.Row] filter ERROR Sun, 21 Feb, 18:49
Vinti Maheshwari Stream group by Sun, 21 Feb, 17:05
Jatin Kumar   Re: Stream group by Sun, 21 Feb, 17:31
Vinti Maheshwari     Re: Stream group by Sun, 21 Feb, 17:54
Vinti Maheshwari       Re: Stream group by Sun, 21 Feb, 18:00
Jatin Kumar         Re: Stream group by Sun, 21 Feb, 18:10
ayan guha           Re: Stream group by Sun, 21 Feb, 22:22
Vinti Maheshwari             Re: Stream group by Sun, 21 Feb, 23:56
Vinti Maheshwari               Re: Stream group by Sun, 21 Feb, 23:58
Saiph Kappa Specify number of executors in standalone cluster mode Sun, 21 Feb, 17:31
Hemant Bhanawat   Re: Specify number of executors in standalone cluster mode Mon, 22 Feb, 05:01
@Sanjiv Singh Spark SQL is not returning records for hive bucketed tables on HDP Mon, 22 Feb, 03:27
Varadharajan Mukundan   Re: Spark SQL is not returning records for hive bucketed tables on HDP Mon, 22 Feb, 03:31
@Sanjiv Singh     Re: Spark SQL is not returning records for hive bucketed tables on HDP Mon, 22 Feb, 03:57
Varadharajan Mukundan       Re: Spark SQL is not returning records for hive bucketed tables on HDP Mon, 22 Feb, 04:19
@Sanjiv Singh         Re: Spark SQL is not returning records for hive bucketed tables on HDP Mon, 22 Feb, 06:09
Varadharajan Mukundan           Re: Spark SQL is not returning records for hive bucketed tables on HDP Mon, 22 Feb, 08:08
@Sanjiv Singh             Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 06:27
Varadharajan Mukundan               Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 06:34
@Sanjiv Singh                 Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 07:05
Varadharajan Mukundan                   Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 08:32
@Sanjiv Singh                     Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 08:45
Varadharajan Mukundan                       Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 08:58
@Sanjiv Singh                         Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 09:19
Divya Gehlot Error :Type mismatch error when passing hdfs file path to spark-csv load method Mon, 22 Feb, 04:45
Jonathan Kelly   Re: Error :Type mismatch error when passing hdfs file path to spark-csv load method Mon, 22 Feb, 06:22
HARSH TAKKAR [Please Help] Log redirection on EMR Mon, 22 Feb, 06:44
Sabarish Sasidharan   Re: [Please Help] Log redirection on EMR Mon, 22 Feb, 06:55
HARSH TAKKAR     Re: [Please Help] Log redirection on EMR Tue, 23 Feb, 09:32
ashokkumar rajendran How to start spark streaming application with recent past timestamp for replay of old batches? Mon, 22 Feb, 06:48
Akhil Das   Re: How to start spark streaming application with recent past timestamp for replay of old batches? Mon, 22 Feb, 07:53
Divya Gehlot [Example] : read custom schema from file Mon, 22 Feb, 07:40
Mohannad Ali   Re: [Example] : read custom schema from file Mon, 22 Feb, 08:51
Akhil Das   Re: [Example] : read custom schema from file Mon, 22 Feb, 10:18
Mishra, Abhishek Sample project on Image Processing Mon, 22 Feb, 08:23
Akhil Das   Re: Sample project on Image Processing Mon, 22 Feb, 11:08
Sainath Palla   Re: Sample project on Image Processing Mon, 22 Feb, 13:34
ndj...@gmail.com     Re: Sample project on Image Processing Mon, 22 Feb, 14:00
Mishra, Abhishek       RE: Sample project on Image Processing Tue, 23 Feb, 05:54
Amjad ALSHABANI Loading file into executor classpath Mon, 22 Feb, 08:32
Paul Leclercq Kafka streaming receiver approach - new topic not read from beginning Mon, 22 Feb, 09:52
Saisai Shao   Re: Kafka streaming receiver approach - new topic not read from beginning Mon, 22 Feb, 09:57
Paul Leclercq     Re: Kafka streaming receiver approach - new topic not read from beginning Mon, 22 Feb, 10:55
Paul Leclercq       Re: Kafka streaming receiver approach - new topic not read from beginning Tue, 23 Feb, 08:28
Jan Algermissen [Cassandra-Connector] No Such Method Error despite correct versions Mon, 22 Feb, 11:13
Jan Algermissen   Re: [Cassandra-Connector] No Such Method Error despite correct versions Mon, 22 Feb, 12:16
开心延年 a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 11:14
Akhil Das   Re: a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 12:12
开心延年     回复: a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 12:27
Gavin Yue       Re: 回复: a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 13:33
开心延年         回复: 回复: a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 14:03
回复:a new FileFormat 5x~100x faster than parquet
平平   回复:a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 11:46
沈阳延云云计算   回复:a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 11:47
How to add a typesafe config file which is located on HDFS to spark-submit (cluster-mode)?
Jobs   How to add a typesafe config file which is located on HDFS to spark-submit (cluster-mode)? Mon, 22 Feb, 13:22
Johannes Haaß   How to add a typesafe config file which is located on HDFS to spark-submit (cluster-mode)? Tue, 23 Feb, 07:42
开心延年 回复: 回复: a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 14:12
Ted Yu   Re: 回复: a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 15:09
Abhishek Anand java.io.IOException: java.lang.reflect.InvocationTargetException on new spark machines Mon, 22 Feb, 14:12
Abhishek Anand   Re: java.io.IOException: java.lang.reflect.InvocationTargetException on new spark machines Fri, 26 Feb, 07:51
Abhishek Anand     Re: java.io.IOException: java.lang.reflect.InvocationTargetException on new spark machines Sat, 27 Feb, 07:05
Shixiong(Ryan) Zhu       Re: java.io.IOException: java.lang.reflect.InvocationTargetException on new spark machines Sun, 28 Feb, 22:16
Abhishek Anand         Re: java.io.IOException: java.lang.reflect.InvocationTargetException on new spark machines Mon, 29 Feb, 09:34
Alex Dzhagriev an OOM while persist as DISK_ONLY Mon, 22 Feb, 14:12
Vinti Maheshwari Spark Streaming not reading input coming from the other ip Mon, 22 Feb, 14:38
Vinti Maheshwari   Re: Spark Streaming not reading input coming from the other ip Mon, 22 Feb, 14:59
Shixiong(Ryan) Zhu     Re: Spark Streaming not reading input coming from the other ip Mon, 22 Feb, 21:10
Vinti Maheshwari       Re: Spark Streaming not reading input coming from the other ip Mon, 22 Feb, 21:15
Anthony Brew Option[Long] parameter in case class parsed from JSON DataFrame failing when key not present in JSON Mon, 22 Feb, 14:42
Jorge Machado   Re: Option[Long] parameter in case class parsed from JSON DataFrame failing when key not present in JSON Mon, 22 Feb, 20:17
Jakob Odersky     Re: Option[Long] parameter in case class parsed from JSON DataFrame failing when key not present in JSON Tue, 23 Feb, 00:43
Anthony Brew       Re: Option[Long] parameter in case class parsed from JSON DataFrame failing when key not present in JSON Tue, 23 Feb, 14:08
Pietro Gentile Spark Cache Eviction Mon, 22 Feb, 14:43
Ted Yu   Re: Spark Cache Eviction Mon, 22 Feb, 15:41
Saif.A.Ell...@wellsfargo.com Can we load csv partitioned data into one DF? Mon, 22 Feb, 15:25
Alex Dzhagriev   Re: Can we load csv partitioned data into one DF? Mon, 22 Feb, 15:32
Mich Talebzadeh     Re: Can we load csv partitioned data into one DF? Mon, 22 Feb, 15:45
Mohammed Guller   RE: Can we load csv partitioned data into one DF? Tue, 23 Feb, 02:08
jdkorigan DataFrame and char encoding Mon, 22 Feb, 17:01
Re: Does Spark satisfy my requirements?
Chitturi Padma   Re: Does Spark satisfy my requirements? Mon, 22 Feb, 18:10
Brian London map operation clears custom partitioner Mon, 22 Feb, 18:21
Sean Owen   Re: map operation clears custom partitioner Mon, 22 Feb, 18:34
Silvio Fiorito   Re: map operation clears custom partitioner Mon, 22 Feb, 18:45
vaibhavrtk1 Read from kafka after application is restarted Mon, 22 Feb, 19:06
Cody Koeninger   Re: Read from kafka after application is restarted Mon, 22 Feb, 19:23
Chitturi Padma   Re: Read from kafka after application is restarted Mon, 22 Feb, 19:55
Gideon   Re: Read from kafka after application is restarted Tue, 23 Feb, 08:19
vaibhavrtk1     Re: Read from kafka after application is restarted Tue, 23 Feb, 11:39
Ted Yu       Re: Read from kafka after application is restarted Tue, 23 Feb, 13:56
Chitturi Padma       Re: Read from kafka after application is restarted Wed, 24 Feb, 05:47
Re: Left/Right Outer join on multiple Columns
Abhisheks   Re: Left/Right Outer join on multiple Columns Mon, 22 Feb, 20:41
Abhisheks     Re: Left/Right Outer join on multiple Columns Wed, 24 Feb, 20:05
Philippe de Rochambeau Newbie questions regarding log processing Mon, 22 Feb, 21:13
Mich Talebzadeh   Re: Newbie questions regarding log processing Mon, 22 Feb, 21:36
Jorge Machado     Re: Newbie questions regarding log processing Mon, 22 Feb, 21:41
Philippe de Rochambeau       Re: Newbie questions regarding log processing Mon, 22 Feb, 21:48
Teng Qiu     Re: Newbie questions regarding log processing Mon, 22 Feb, 21:45
Daniel Siegmann Serializing collections in Datasets Mon, 22 Feb, 21:51
Michael Armbrust   Re: Serializing collections in Datasets Mon, 22 Feb, 23:24
Koert Kuipers     Re: Serializing collections in Datasets Mon, 22 Feb, 23:28
Daniel Siegmann     Re: Serializing collections in Datasets Tue, 23 Feb, 18:32
igor.berman DirectFileOutputCommiter Mon, 22 Feb, 22:18
Teng Qiu   Re: DirectFileOutputCommiter Thu, 25 Feb, 23:01
Yin Yang     Re: DirectFileOutputCommiter Thu, 25 Feb, 23:21
Teng Qiu       Re: DirectFileOutputCommiter Thu, 25 Feb, 23:39
Takeshi Yamamuro         Re: DirectFileOutputCommiter Fri, 26 Feb, 06:24
Alexander Pivovarov           Re: DirectFileOutputCommiter Fri, 26 Feb, 08:57
Igor Berman             Re: DirectFileOutputCommiter Fri, 26 Feb, 11:40
Teng Qiu           Re: DirectFileOutputCommiter Fri, 26 Feb, 10:43
Igor Berman           Re: DirectFileOutputCommiter Fri, 26 Feb, 11:38
Igor Berman           Re: DirectFileOutputCommiter Fri, 26 Feb, 11:45
Reynold Xin             Re: DirectFileOutputCommiter Fri, 26 Feb, 19:50
Alexander Pivovarov               Re: DirectFileOutputCommiter Fri, 26 Feb, 20:19
Igor Berman               Re: DirectFileOutputCommiter Sat, 27 Feb, 10:38
Takeshi Yamamuro                 Re: DirectFileOutputCommiter Mon, 29 Feb, 08:07
Steve Loughran           Re: DirectFileOutputCommiter Mon, 29 Feb, 10:26
Aris Streaming mapWithState API has NullPointerException Mon, 22 Feb, 22:29
Tathagata Das   Re: Streaming mapWithState API has NullPointerException Mon, 22 Feb, 22:48
Aris     Re: Streaming mapWithState API has NullPointerException Mon, 22 Feb, 22:57
Tathagata Das       Re: Streaming mapWithState API has NullPointerException Wed, 24 Feb, 02:29
Mich Talebzadeh Using functional programming rather than SQL Mon, 22 Feb, 23:16
Kevin Mellott   Re: Using functional programming rather than SQL Mon, 22 Feb, 23:45
Dean Wampler     Re: Using functional programming rather than SQL Tue, 23 Feb, 00:26
Mich Talebzadeh       Re: Using functional programming rather than SQL Tue, 23 Feb, 00:39
Ted Yu         Re: Using functional programming rather than SQL Tue, 23 Feb, 00:50
Michał Zieliński           Re: Using functional programming rather than SQL Tue, 23 Feb, 07:36
Koert Kuipers     Re: Using functional programming rather than SQL Tue, 23 Feb, 00:28
Mich Talebzadeh   Re: Using functional programming rather than SQL Wed, 24 Feb, 00:09
Koert Kuipers     Re: Using functional programming rather than SQL Wed, 24 Feb, 02:50
Sabarish Sasidharan     Re: Using functional programming rather than SQL Wed, 24 Feb, 06:27
Koert Kuipers       Re: Using functional programming rather than SQL Wed, 24 Feb, 15:45
Sabarish Sasidharan         Re: Using functional programming rather than SQL Wed, 24 Feb, 18:15
Mohannad Ali           Re: Using functional programming rather than SQL Wed, 24 Feb, 18:19
Sabarish Sasidharan             Re: Using functional programming rather than SQL Wed, 24 Feb, 18:25
Mohannad Ali               Re: Using functional programming rather than SQL Wed, 24 Feb, 18:41
Koert Kuipers               Re: Using functional programming rather than SQL Wed, 24 Feb, 19:59
Koert Kuipers                 Re: Using functional programming rather than SQL Wed, 24 Feb, 20:05
Mich Talebzadeh                   Re: Using functional programming rather than SQL Wed, 24 Feb, 20:16
Mich Talebzadeh                   Re: Using functional programming rather than SQL Wed, 24 Feb, 20:25
Mich Talebzadeh       Re: Using Spark functional programming rather than SQL, Spark on Hive tables Wed, 24 Feb, 16:20
Sabarish Sasidharan         Re: Using Spark functional programming rather than SQL, Spark on Hive tables Wed, 24 Feb, 18:20
Mich Talebzadeh           Re: Using Spark functional programming rather than SQL, Spark on Hive tables Wed, 24 Feb, 20:14
Sabarish Sasidharan         Re: Using Spark functional programming rather than SQL, Spark on Hive tables Wed, 24 Feb, 18:22
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Box list
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137