spark-user mailing list archives: August 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Rex X How to make new composite columns by combining rows in the same group? Fri, 26 Aug, 11:54
Rex X   Re: How to make new composite columns by combining rows in the same group? Fri, 26 Aug, 11:56
Xinh Huynh   Re: How to make new composite columns by combining rows in the same group? Fri, 26 Aug, 15:31
kant kodali unable to start slaves from master (SSH problem) Fri, 26 Aug, 12:32
kant kodali   Re: unable to start slaves from master (SSH problem) Fri, 26 Aug, 18:09
aecc zookeeper mesos logging in spark Fri, 26 Aug, 15:31
Michael Gummelt   Re: zookeeper mesos logging in spark Fri, 26 Aug, 16:47
Renato Marroquín Mogrovejo Reading parquet files into Spark Streaming Fri, 26 Aug, 15:42
Renato Marroquín Mogrovejo   Re: Reading parquet files into Spark Streaming Fri, 26 Aug, 21:56
Akhilesh Pathodia     Re: Reading parquet files into Spark Streaming Sat, 27 Aug, 05:01
Akhilesh Pathodia     Re: Reading parquet files into Spark Streaming Sat, 27 Aug, 07:01
Renato Marroquín Mogrovejo       Re: Reading parquet files into Spark Streaming Sat, 27 Aug, 13:24
Sebastian Piu         Re: Reading parquet files into Spark Streaming Sat, 27 Aug, 18:18
Sebastian Piu           Re: Reading parquet files into Spark Streaming Sat, 27 Aug, 18:19
Mich Talebzadeh Spark driver memory breakdown Fri, 26 Aug, 16:48
Subhajit Purkayastha Spark 2.0 - Insert/Update to a DataFrame Fri, 26 Aug, 16:53
Mike Metzger   Re: Spark 2.0 - Insert/Update to a DataFrame Fri, 26 Aug, 20:12
Subhajit Purkayastha     RE: Spark 2.0 - Insert/Update to a DataFrame Fri, 26 Aug, 20:29
Mike Metzger       Re: Spark 2.0 - Insert/Update to a DataFrame Fri, 26 Aug, 21:11
Subhajit Purkayastha         RE: Spark 2.0 - Insert/Update to a DataFrame Fri, 26 Aug, 21:45
Mike Metzger           Re: Spark 2.0 - Insert/Update to a DataFrame Sat, 27 Aug, 03:50
kalkimann spark 2.0 home brew package missing Fri, 26 Aug, 17:25
Noorul Islam K M   Re: spark 2.0 home brew package missing Fri, 26 Aug, 17:37
RAJESHWAR MANN     Re: spark 2.0 home brew package missing Fri, 26 Aug, 18:06
Saurabh Malviya (samalviy) EMR for spark job - instance type suggestion Fri, 26 Aug, 17:29
Gavin Yue   Re: EMR for spark job - instance type suggestion Fri, 26 Aug, 17:58
kant kodali is there a HTTP2 (v2) endpoint for Spark Streaming? Fri, 26 Aug, 19:42
Jacek Laskowski   Re: is there a HTTP2 (v2) endpoint for Spark Streaming? Fri, 26 Aug, 21:20
kant kodali     Re: is there a HTTP2 (v2) endpoint for Spark Streaming? Fri, 26 Aug, 21:47
kant kodali       Re: is there a HTTP2 (v2) endpoint for Spark Streaming? Fri, 26 Aug, 22:02
Benjamin Kim Spark 1.6 Streaming with Checkpointing Fri, 26 Aug, 20:54
Jacek Laskowski   Re: Spark 1.6 Streaming with Checkpointing Fri, 26 Aug, 21:11
Vadim Semenov Dynamically change executors settings Sat, 27 Aug, 02:40
linguin....@gmail.com   Re: Dynamically change executors settings Sat, 27 Aug, 03:11
spats Issues with Spark On Hbase Connector and versions Sat, 27 Aug, 11:47
Sachin Jain   Re: Issues with Spark On Hbase Connector and versions Mon, 29 Aug, 06:12
Weiqing Yang     Re: Issues with Spark On Hbase Connector and versions Tue, 30 Aug, 19:45
Kevin Tran Write parquet file from Spark Streaming Sun, 28 Aug, 01:32
Taotao.Li How to persist SparkContext? Sun, 28 Aug, 03:32
Mich Talebzadeh   Re: How to persist SparkContext? Sun, 28 Aug, 08:34
ayan guha     Re: How to persist SparkContext? Sun, 28 Aug, 09:07
yaroslav Equivalent of "predict" function from LogisticRegressionWithLBFGS in OneVsRest with LogisticRegression classifier (Spark 2.0) Sun, 28 Aug, 09:06
Nick Pentreath   Re: Equivalent of "predict" function from LogisticRegressionWithLBFGS in OneVsRest with LogisticRegression classifier (Spark 2.0) Mon, 29 Aug, 07:33
AssafMendelson UDF/UDAF performance Sun, 28 Aug, 09:53
Kevin Tran Spark StringType could hold how many characters ? Sun, 28 Aug, 14:24
Sean Owen   Re: Spark StringType could hold how many characters ? Sun, 28 Aug, 15:00
Kevin Tran Best practises to storing data in Parquet files Sun, 28 Aug, 14:43
Mich Talebzadeh   Re: Best practises to storing data in Parquet files Sun, 28 Aug, 17:18
Kevin Tran     Re: Best practises to storing data in Parquet files Sun, 28 Aug, 23:47
Chanh Le   Re: Best practises to storing data in Parquet files Mon, 29 Aug, 02:23
Mich Talebzadeh     Re: Best practises to storing data in Parquet files Mon, 29 Aug, 07:23
Design patterns involving Spark
Ashok Kumar   Design patterns involving Spark Sun, 28 Aug, 17:04
Sivakumaran S     Re: Design patterns involving Spark Sun, 28 Aug, 18:43
Mich Talebzadeh       Re: Design patterns involving Spark Sun, 28 Aug, 23:18
Ashok Kumar         Re: Design patterns involving Spark Mon, 29 Aug, 12:19
ayan guha           Re: Design patterns involving Spark Mon, 29 Aug, 13:02
Mich Talebzadeh             Re: Design patterns involving Spark Mon, 29 Aug, 17:19
Bhaarat Sharma         Re: Design patterns involving Spark Mon, 29 Aug, 17:53
Mich Talebzadeh           Re: Design patterns involving Spark Mon, 29 Aug, 20:23
Chanh Le             Re: Design patterns involving Spark Tue, 30 Aug, 02:19
Mich Talebzadeh               Re: Design patterns involving Spark Tue, 30 Aug, 06:56
Alonso Isidoro Roman                 Re: Design patterns involving Spark Tue, 30 Aug, 07:33
Mich Talebzadeh                   Re: Design patterns involving Spark Tue, 30 Aug, 07:52
Alonso Isidoro Roman                     Re: Design patterns involving Spark Tue, 30 Aug, 08:10
Todd Nist                       Re: Design patterns involving Spark Tue, 30 Aug, 12:16
Tal Grynbaum Suggestions for calculating MAU/WAU/DAU Sun, 28 Aug, 18:48
Everett Anderson S3A + EMR failure when writing Parquet? Sun, 28 Aug, 19:51
Everett Anderson   Re: S3A + EMR failure when writing Parquet? Sun, 28 Aug, 23:19
Everett Anderson     Re: S3A + EMR failure when writing Parquet? Mon, 29 Aug, 17:18
Steve Loughran       Re: S3A + EMR failure when writing Parquet? Tue, 30 Aug, 18:49
Russell Jurney Automating lengthy command to pyspark with configuration? Sun, 28 Aug, 22:30
ayan guha   Re: Automating lengthy command to pyspark with configuration? Mon, 29 Aug, 04:19
Russell Jurney     Re: Automating lengthy command to pyspark with configuration? Mon, 29 Aug, 18:47
BiksN Issue with Spark HBase connector streamBulkGet method Mon, 29 Aug, 03:57
Sachin Mittal How can we connect RDD from previous job to next job Mon, 29 Aug, 04:30
Roger Marin   Re: How can we connect RDD from previous job to next job Mon, 29 Aug, 04:39
Sean Owen   Re: How can we connect RDD from previous job to next job Mon, 29 Aug, 08:09
Sachin Mittal     Re: How can we connect RDD from previous job to next job Mon, 29 Aug, 08:27
Sean Owen       Re: How can we connect RDD from previous job to next job Mon, 29 Aug, 08:43
Mich Talebzadeh         Re: How can we connect RDD from previous job to next job Mon, 29 Aug, 09:08
filousen json with millisecond timestamp in spark 2 Mon, 29 Aug, 07:05
kant kodali can I use cassandra for checkpointing during a spark streaming job Mon, 29 Aug, 07:14
Sree Eedupuganti How to acess the WrappedArray Mon, 29 Aug, 09:27
Denis Bolshakov   Re: How to acess the WrappedArray Mon, 29 Aug, 10:44
Bedrytski Aliaksandr   Re: How to acess the WrappedArray Mon, 29 Aug, 11:28
Rohit Kumar Prusty After calling persist, why the size in sparkui is not matching with the actual file size Mon, 29 Aug, 13:52
Denis Bolshakov   Re: After calling persist, why the size in sparkui is not matching with the actual file size Mon, 29 Aug, 15:32
Rohit Kumar Prusty     RE: After calling persist, why the size in sparkui is not matching with the actual file size Tue, 30 Aug, 04:27
Matt Smith Spark Streaming batch sequence number Mon, 29 Aug, 15:18
Exception during creation of ActorReceiver when running ActorWordCount on CDH 5.5.2
Ricky Pritchett   Exception during creation of ActorReceiver when running ActorWordCount on CDH 5.5.2 Mon, 29 Aug, 15:35
Thunder Stumpges Coding in the Spark ml "ecosystem" why is everything private?! Mon, 29 Aug, 16:46
Sean Owen   Re: Coding in the Spark ml "ecosystem" why is everything private?! Mon, 29 Aug, 16:49
Thunder Stumpges     Re: Coding in the Spark ml "ecosystem" why is everything private?! Mon, 29 Aug, 17:01
Yong Zhang Great performance improvement of Spark 1.6.2 on our production cluster Mon, 29 Aug, 17:16
Jestin Ma Cleanup after Spark SQL job with window aggregation takes a long time Mon, 29 Aug, 22:57
ckanth99 Spark launcher handle and listener not giving state Mon, 29 Aug, 23:36
Marcelo Vanzin   Re: Spark launcher handle and listener not giving state Mon, 29 Aug, 23:39
ckanth99     Re: Spark launcher handle and listener not giving state Tue, 30 Aug, 02:12
kant kodali java.lang.RuntimeException: java.lang.AssertionError: assertion failed: A ReceiverSupervisor has not been attached to the receiver yet. Mon, 29 Aug, 23:49
kant kodali How to attach a ReceiverSupervisor for a Custom receiver in Spark Streaming? Tue, 30 Aug, 00:18
Aseem Bansal Spark 2.0.0 - What all access is needed to save model to S3? Tue, 30 Aug, 05:20
Steve Loughran   Re: Spark 2.0.0 - What all access is needed to save model to S3? Tue, 30 Aug, 19:01
canan chen How to use custom class in DataSet Tue, 30 Aug, 05:39
Jakob Odersky   Re: How to use custom class in DataSet Tue, 30 Aug, 22:57
Otis Gospodnetić Spark metrics when running with YARN? Tue, 30 Aug, 05:53
Mich Talebzadeh   Re: Spark metrics when running with YARN? Tue, 30 Aug, 06:51
Vijay Kiran   Re: Spark metrics when running with YARN? Tue, 30 Aug, 10:48
Mich Talebzadeh     Re: Spark metrics when running with YARN? Tue, 30 Aug, 10:59
Otis Gospodnetić       Re: Spark metrics when running with YARN? Tue, 30 Aug, 12:43
Vijay Kiran         Re: Spark metrics when running with YARN? Tue, 30 Aug, 12:52
How to convert List<Row> into json object / json Array
Sree Eedupuganti   How to convert List<Row> into json object / json Array Tue, 30 Aug, 07:06
Sree Eedupuganti   How to convert List<Row> into json object / json Array Tue, 30 Aug, 08:55
Sivakumaran S     Re: How to convert List<Row> into json object / json Array Tue, 30 Aug, 09:04
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Box list
Nov 2020142
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137