spark-user mailing list archives: August 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Mich Talebzadeh Breaking down text String into Array elements Tue, 23 Aug, 17:42
Nick Pentreath   Re: Breaking down text String into Array elements Tue, 23 Aug, 18:00
Mich Talebzadeh     Re: Breaking down text String into Array elements Tue, 23 Aug, 18:12
Nick Pentreath       Re: Breaking down text String into Array elements Tue, 23 Aug, 19:26
RK Aduri         Re: Breaking down text String into Array elements Tue, 23 Aug, 20:20
Mich Talebzadeh           Re: Breaking down text String into Array elements Tue, 23 Aug, 21:22
kant kodali Are RDD's ever persisted to disk? Tue, 23 Aug, 18:12
srikanth.je...@gmail.com   RE: Are RDD's ever persisted to disk? Tue, 23 Aug, 18:23
kant kodali     Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 18:41
srikanth.je...@gmail.com       RE: Are RDD's ever persisted to disk? Tue, 23 Aug, 19:10
RK Aduri         Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 19:19
kant kodali           Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 19:26
Nirav             Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 19:55
kant kodali               Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 19:59
srikanth.je...@gmail.com                 RE: Are RDD's ever persisted to disk? Tue, 23 Aug, 20:11
kant kodali                   Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 20:28
kant kodali                     Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 20:36
Sean Owen                     Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 20:42
kant kodali                       Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 21:23
RK Aduri                         Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 21:39
kant kodali                           Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 23:17
kant kodali                             Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 23:21
RK Aduri                               Re: Are RDD's ever persisted to disk? Tue, 23 Aug, 23:37
kant kodali                                 Re: Are RDD's ever persisted to disk? Wed, 24 Aug, 00:26
Jeoffrey Lim Maelstrom: Kafka integration with Spark Tue, 23 Aug, 19:19
Cody Koeninger   Re: Maelstrom: Kafka integration with Spark Wed, 24 Aug, 01:49
Jeoffrey Lim     Re: Maelstrom: Kafka integration with Spark Wed, 24 Aug, 03:18
Cody Koeninger       Re: Maelstrom: Kafka integration with Spark Wed, 24 Aug, 14:46
Jeoffrey Lim         Re: Maelstrom: Kafka integration with Spark Wed, 24 Aug, 19:23
Jeoffrey Lim           Re: Maelstrom: Kafka integration with Spark Wed, 24 Aug, 20:21
Srikanth Spark 2.0 with Kafka 0.10 exception Tue, 23 Aug, 20:44
Cody Koeninger   Re: Spark 2.0 with Kafka 0.10 exception Wed, 24 Aug, 01:52
Srikanth     Re: Spark 2.0 with Kafka 0.10 exception Wed, 24 Aug, 18:13
twisterius spark-jdbc impala with kerberos using yarn-client Tue, 23 Aug, 21:12
Marcelo Vanzin   Re: spark-jdbc impala with kerberos using yarn-client Wed, 24 Aug, 18:43
Rachana Srivastava How do we process/scale variable size batches in Apache Spark Streaming Tue, 23 Aug, 22:20
Subhajit Purkayastha DataFrame Data Manipulation - Based on a timestamp column Not Working Tue, 23 Aug, 22:46
Bedrytski Aliaksandr   Re: DataFrame Data Manipulation - Based on a timestamp column Not Working Wed, 24 Aug, 08:31
dynamic allocation in Spark 2.0
Shane Lee   dynamic allocation in Spark 2.0 Wed, 24 Aug, 07:16
Saisai Shao     Re: dynamic allocation in Spark 2.0 Wed, 24 Aug, 09:07
mas Future of GraphX Wed, 24 Aug, 07:46
Devi P.V Spark MLlib:Collaborative Filtering Wed, 24 Aug, 08:28
glen   Re: Spark MLlib:Collaborative Filtering Wed, 24 Aug, 08:38
Praveen Devarao     Re: Spark MLlib:Collaborative Filtering Wed, 24 Aug, 10:10
Devi P.V       Re: Spark MLlib:Collaborative Filtering Thu, 25 Aug, 04:43
Adamantios Corais Best range of parameters for grid search? Wed, 24 Aug, 09:26
AlexModestov work with russian letters Wed, 24 Aug, 09:37
Jacek Laskowski   Re: work with russian letters Wed, 24 Aug, 10:33
tony....@tendcloud.com Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 12:11
Saisai Shao   Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 13:02
Sun Rui     Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 14:09
Saisai Shao       Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 14:15
Sun Rui         Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 14:17
tony....@tendcloud.com   Re: Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 14:30
Saisai Shao     Re: Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 14:42
Sun Rui     Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 15:16
sujeet jog Dataframe write to DB , loosing primary key index & data types. Wed, 24 Aug, 14:37
sujeet jog   Re: Dataframe write to DB , loosing primary key index & data types. Wed, 24 Aug, 14:48
Richard Siebeling Best way to calculate intermediate column statistics Wed, 24 Aug, 14:42
Bedrytski Aliaksandr   Re: Best way to calculate intermediate column statistics Wed, 24 Aug, 15:01
Mich Talebzadeh     Re: Best way to calculate intermediate column statistics Wed, 24 Aug, 16:52
Richard Siebeling       Re: Best way to calculate intermediate column statistics Wed, 24 Aug, 20:37
Mich Talebzadeh         Re: Best way to calculate intermediate column statistics Wed, 24 Aug, 20:54
Richard Siebeling           Re: Best way to calculate intermediate column statistics Thu, 25 Aug, 07:24
Mich Talebzadeh             Re: Best way to calculate intermediate column statistics Thu, 25 Aug, 09:39
Bedrytski Aliaksandr               Re: Best way to calculate intermediate column statistics Fri, 26 Aug, 14:18
Mich Talebzadeh                 Re: Best way to calculate intermediate column statistics Fri, 26 Aug, 15:14
Re: a question about LBFGS in Spark
DB Tsai   Re: a question about LBFGS in Spark Wed, 24 Aug, 18:48
Fwd: quick question
kant kodali   Fwd: quick question Wed, 24 Aug, 20:52
Kevin Mellott     Re: quick question Thu, 25 Aug, 03:51
kant kodali       Re: quick question Thu, 25 Aug, 05:30
Sivakumaran S         Re: quick question Thu, 25 Aug, 05:38
kant kodali           Re: quick question Thu, 25 Aug, 06:08
Sivakumaran S             Re: quick question Thu, 25 Aug, 09:37
kant kodali               Re: quick question Thu, 25 Aug, 10:53
Sivakumaran S                 Re: quick question Thu, 25 Aug, 13:06
kant kodali                   Re: quick question Thu, 25 Aug, 19:09
Sivakumaran S                     Re: quick question Thu, 25 Aug, 19:39
kant kodali                       Re: quick question Thu, 25 Aug, 20:18
kant kodali What do I loose if I run spark without using HDFS or Zookeeper? Wed, 24 Aug, 20:54
Mich Talebzadeh   Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 16:18
kant kodali     Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 18:57
Sean Owen       Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 19:39
Mark Hamstra         Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 19:51
Mark Hamstra           Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 19:52
Mich Talebzadeh             Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 20:13
Ofir Manor               Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 20:35
kant kodali                 Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 20:55
Michael Gummelt                   Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 21:00
kant kodali                     Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 21:49
ayan guha                       Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 22:36
Michael Gummelt                         Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 22:47
Mark Hamstra                         Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 22:48
kant kodali                           Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 23:58
kant kodali                             Re: What do I loose if I run spark without using HDFS or Zookeeper? Fri, 26 Aug, 00:02
Carlile, Ken                               Re: What do I loose if I run spark without using HDFS or Zookeeper? Fri, 26 Aug, 12:52
Steve Loughran                       Re: What do I loose if I run spark without using HDFS or Zookeeper? Fri, 26 Aug, 09:50
kant kodali                         Re: What do I loose if I run spark without using HDFS or Zookeeper? Fri, 26 Aug, 11:58
Mich Talebzadeh                           Re: What do I loose if I run spark without using HDFS or Zookeeper? Fri, 26 Aug, 12:46
kant kodali                             Re: What do I loose if I run spark without using HDFS or Zookeeper? Fri, 26 Aug, 13:24
Steve Loughran                           Re: What do I loose if I run spark without using HDFS or Zookeeper? Fri, 26 Aug, 16:50
kant kodali                             Re: What do I loose if I run spark without using HDFS or Zookeeper? Sun, 28 Aug, 01:49
Peter Figliozzi   Re: What do I loose if I run spark without using HDFS or Zookeeper? Thu, 25 Aug, 17:02
Venkata Penikalapati Sqoop vs spark jdbc Wed, 24 Aug, 21:39
Mich Talebzadeh   Re: Sqoop vs spark jdbc Wed, 24 Aug, 22:07
Sean Owen     Re: Sqoop vs spark jdbc Thu, 25 Aug, 07:30
Ranadip Chatterjee   Re: Sqoop vs spark jdbc Thu, 25 Aug, 04:08
ayan guha     Re: Sqoop vs spark jdbc Thu, 25 Aug, 04:34
Bhaskar Dutta   Re: Sqoop vs spark jdbc Thu, 25 Aug, 08:07
Mich Talebzadeh     Re: Sqoop vs spark jdbc Thu, 25 Aug, 09:34
Bhaskar Dutta       Re: Sqoop vs spark jdbc Thu, 25 Aug, 10:48
Mich Talebzadeh         Re: Sqoop vs spark jdbc Thu, 25 Aug, 10:51
kant kodali How to compute a net (difference) given a bi-directional stream of numbers using spark streaming? Wed, 24 Aug, 21:48
Oldskoola Incremental Updates and custom SQL via JDBC Wed, 24 Aug, 23:08
Mich Talebzadeh   Re: Incremental Updates and custom SQL via JDBC Wed, 24 Aug, 23:24
Sascha Schmied     Re: Incremental Updates and custom SQL via JDBC Wed, 24 Aug, 23:54
Mich Talebzadeh       Re: Incremental Updates and custom SQL via JDBC Thu, 25 Aug, 16:22
N B Spark Streaming user function exceptions causing hangs Thu, 25 Aug, 01:07
John Jacobs Spark Logging : log4j.properties or log4j.xml Thu, 25 Aug, 04:23
Aseem Bansal spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 05:21
Tal Grynbaum   Re: spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 05:40
Takeshi Yamamuro     Re: spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 11:56
Tal Grynbaum       Re: spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 12:16
Takeshi Yamamuro         Re: spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 12:20
Steve Loughran         Re: spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 15:04
Mich Talebzadeh Is there anyway Spark UI is set to poll and refreshes itself Thu, 25 Aug, 09:55
Marek Wiewiorka   Re: Is there anyway Spark UI is set to poll and refreshes itself Thu, 25 Aug, 10:01
Jacek Laskowski   Re: Is there anyway Spark UI is set to poll and refreshes itself Fri, 26 Aug, 22:21
Mich Talebzadeh     Re: Is there anyway Spark UI is set to poll and refreshes itself Fri, 26 Aug, 22:38
Mich Talebzadeh       Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 08:34
Mich Talebzadeh         Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 09:10
Mich Talebzadeh           Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 13:17
nguyen duc Tuan             Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 14:01
Mich Talebzadeh               Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 14:59
Jacek Laskowski         Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 11:50
Mich Talebzadeh UDF on lpad Thu, 25 Aug, 11:06
Mich Talebzadeh   Re: UDF on lpad Thu, 25 Aug, 14:27
Mike Metzger     Re: UDF on lpad Thu, 25 Aug, 16:29
Mich Talebzadeh       Re: UDF on lpad Thu, 25 Aug, 17:39
Mike Metzger         Re: UDF on lpad Thu, 25 Aug, 19:05
Dibyendu Bhattacharya Latest Release of Receiver based Kafka Consumer for Spark Streaming. Thu, 25 Aug, 11:33
mdkhajaasm...@gmail.com   Re: Latest Release of Receiver based Kafka Consumer for Spark Streaming. Thu, 25 Aug, 13:31
Dibyendu Bhattacharya     Re: Latest Release of Receiver based Kafka Consumer for Spark Streaming. Thu, 25 Aug, 13:45
Pradeep Kafka message metadata with Dstreams Thu, 25 Aug, 11:45
Cody Koeninger   Re: Kafka message metadata with Dstreams Thu, 25 Aug, 14:34
Re: namespace quota not take effect
Ted Yu   Re: namespace quota not take effect Thu, 25 Aug, 12:46
Ethan Aubin Pyspark SQL 1.6.0 write problem Thu, 25 Aug, 15:00
luohui20...@sina.com SparkStreaming + Flume: org.jboss.netty.channel.ChannelException: Failed to bind to: master60/10.0.10.60:31001 Thu, 25 Aug, 15:21
Pasquinell Urbani Perform an ALS with TF-IDF output (spark 2.0) Thu, 25 Aug, 16:22
Jestin Ma Caching broadcasted DataFrames? Thu, 25 Aug, 17:07
Takeshi Yamamuro   Re: Caching broadcasted DataFrames? Thu, 25 Aug, 19:38
Gavin Yue How to output RDD to one file with specific name? Thu, 25 Aug, 17:15
Stefan Panayotov   RE: How to output RDD to one file with specific name? Thu, 25 Aug, 17:55
Anil Langote Running yarn with spark not working with Java 8 Thu, 25 Aug, 19:15
Selvam Raman Insert non-null values from dataframe Thu, 25 Aug, 20:23
Russell Spitzer   Re: Insert non-null values from dataframe Fri, 26 Aug, 15:38
Selvam Raman     Re: Insert non-null values from dataframe Mon, 29 Aug, 06:35
Marco Mistroni Please assist: Building Docker image containing spark 2.0 Thu, 25 Aug, 20:31
Michael Gummelt   Re: Please assist: Building Docker image containing spark 2.0 Thu, 25 Aug, 21:01
Marco Mistroni     Re: Please assist: Building Docker image containing spark 2.0 Thu, 25 Aug, 21:29
Michael Gummelt       Re: Please assist: Building Docker image containing spark 2.0 Fri, 26 Aug, 17:18
Marco Mistroni         Re: Please assist: Building Docker image containing spark 2.0 Fri, 26 Aug, 21:18
Tal Grynbaum           Re: Please assist: Building Docker image containing spark 2.0 Fri, 26 Aug, 21:23
Michael Gummelt             Re: Please assist: Building Docker image containing spark 2.0 Fri, 26 Aug, 22:14
Mike Metzger               Re: Please assist: Building Docker image containing spark 2.0 Sat, 27 Aug, 03:04
Marco Mistroni                 Re: Please assist: Building Docker image containing spark 2.0 Sat, 27 Aug, 08:06
Marco Mistroni                   Re: Please assist: Building Docker image containing spark 2.0 Sat, 27 Aug, 14:46
Marco Mistroni Converting DataFrame's int column to Double Thu, 25 Aug, 21:09
Jestin Ma   Re: Converting DataFrame's int column to Double Thu, 25 Aug, 21:13
Marco Mistroni     Re: Converting DataFrame's int column to Double Thu, 25 Aug, 21:17
Rex X How to do this pairing in Spark? Fri, 26 Aug, 01:00
ayan guha   Re: How to do this pairing in Spark? Fri, 26 Aug, 07:46
Rex X     Re: How to do this pairing in Spark? Fri, 26 Aug, 11:28
ayan guha   Re: How to do this pairing in Spark? Fri, 26 Aug, 13:21
kant kodali How to install spark with s3 on AWS? Fri, 26 Aug, 11:46
Devi P.V   Re: How to install spark with s3 on AWS? Fri, 26 Aug, 12:13
kant kodali     Re: How to install spark with s3 on AWS? Fri, 26 Aug, 12:59
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Box list
Dec 202035
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137