spark-user mailing list archives: August 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Akhilesh Pathodia Re: Reading parquet files into Spark Streaming Sat, 27 Aug, 07:01
Marco Mistroni Re: Please assist: Building Docker image containing spark 2.0 Sat, 27 Aug, 08:06
Mich Talebzadeh Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 08:34
Mich Talebzadeh Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 09:10
spats Issues with Spark On Hbase Connector and versions Sat, 27 Aug, 11:47
Jacek Laskowski Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 11:50
Mich Talebzadeh Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 13:17
Renato Marroquín Mogrovejo Re: Reading parquet files into Spark Streaming Sat, 27 Aug, 13:24
nguyen duc Tuan Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 14:01
Marco Mistroni Re: Please assist: Building Docker image containing spark 2.0 Sat, 27 Aug, 14:46
Mich Talebzadeh Re: Is there anyway Spark UI is set to poll and refreshes itself Sat, 27 Aug, 14:59
Sebastian Piu Re: Reading parquet files into Spark Streaming Sat, 27 Aug, 18:18
Sebastian Piu Re: Reading parquet files into Spark Streaming Sat, 27 Aug, 18:19
Kevin Tran Write parquet file from Spark Streaming Sun, 28 Aug, 01:32
kant kodali Re: What do I loose if I run spark without using HDFS or Zookeeper? Sun, 28 Aug, 01:49
Taotao.Li How to persist SparkContext? Sun, 28 Aug, 03:32
Jacek Laskowski Re: Spark 2.0 - Join statement compile error Sun, 28 Aug, 07:47
Mich Talebzadeh Re: Spark 2.0 - Join statement compile error Sun, 28 Aug, 08:25
Mich Talebzadeh Re: How to persist SparkContext? Sun, 28 Aug, 08:34
yaroslav Equivalent of "predict" function from LogisticRegressionWithLBFGS in OneVsRest with LogisticRegression classifier (Spark 2.0) Sun, 28 Aug, 09:06
ayan guha Re: How to persist SparkContext? Sun, 28 Aug, 09:07
AssafMendelson UDF/UDAF performance Sun, 28 Aug, 09:53
Kevin Tran Spark StringType could hold how many characters ? Sun, 28 Aug, 14:24
Kevin Tran Best practises to storing data in Parquet files Sun, 28 Aug, 14:43
Sean Owen Re: Spark StringType could hold how many characters ? Sun, 28 Aug, 15:00
Ashok Kumar Design patterns involving Spark Sun, 28 Aug, 17:04
Mich Talebzadeh Re: Best practises to storing data in Parquet files Sun, 28 Aug, 17:18
Sivakumaran S Re: Design patterns involving Spark Sun, 28 Aug, 18:43
Tal Grynbaum Suggestions for calculating MAU/WAU/DAU Sun, 28 Aug, 18:48
Everett Anderson S3A + EMR failure when writing Parquet? Sun, 28 Aug, 19:51
Russell Jurney Automating lengthy command to pyspark with configuration? Sun, 28 Aug, 22:30
Mich Talebzadeh Re: Design patterns involving Spark Sun, 28 Aug, 23:18
Everett Anderson Re: S3A + EMR failure when writing Parquet? Sun, 28 Aug, 23:19
Kevin Tran Re: Best practises to storing data in Parquet files Sun, 28 Aug, 23:47
Chanh Le Re: Best practises to storing data in Parquet files Mon, 29 Aug, 02:23
BiksN Issue with Spark HBase connector streamBulkGet method Mon, 29 Aug, 03:57
ayan guha Re: Automating lengthy command to pyspark with configuration? Mon, 29 Aug, 04:19
Sachin Mittal How can we connect RDD from previous job to next job Mon, 29 Aug, 04:30
Roger Marin Re: How can we connect RDD from previous job to next job Mon, 29 Aug, 04:39
Sachin Jain Re: Issues with Spark On Hbase Connector and versions Mon, 29 Aug, 06:12
Selvam Raman Re: Insert non-null values from dataframe Mon, 29 Aug, 06:35
filousen json with millisecond timestamp in spark 2 Mon, 29 Aug, 07:05
kant kodali can I use cassandra for checkpointing during a spark streaming job Mon, 29 Aug, 07:14
Mich Talebzadeh Re: Best practises to storing data in Parquet files Mon, 29 Aug, 07:23
Nick Pentreath Re: Equivalent of "predict" function from LogisticRegressionWithLBFGS in OneVsRest with LogisticRegression classifier (Spark 2.0) Mon, 29 Aug, 07:33
Sean Owen Re: How can we connect RDD from previous job to next job Mon, 29 Aug, 08:09
Sachin Mittal Re: How can we connect RDD from previous job to next job Mon, 29 Aug, 08:27
Sean Owen Re: How can we connect RDD from previous job to next job Mon, 29 Aug, 08:43
Mich Talebzadeh Re: How can we connect RDD from previous job to next job Mon, 29 Aug, 09:08
Sree Eedupuganti How to acess the WrappedArray Mon, 29 Aug, 09:27
Denis Bolshakov Re: How to acess the WrappedArray Mon, 29 Aug, 10:44
Marius Soutier Re: Is there a reduceByKey functionality in DataFrame API? Mon, 29 Aug, 10:44
Bedrytski Aliaksandr Re: How to acess the WrappedArray Mon, 29 Aug, 11:28
Ashok Kumar Re: Design patterns involving Spark Mon, 29 Aug, 12:19
ayan guha Re: Is there a reduceByKey functionality in DataFrame API? Mon, 29 Aug, 12:56
ayan guha Re: Design patterns involving Spark Mon, 29 Aug, 13:02
Marius Soutier Re: Is there a reduceByKey functionality in DataFrame API? Mon, 29 Aug, 13:31
Rohit Kumar Prusty After calling persist, why the size in sparkui is not matching with the actual file size Mon, 29 Aug, 13:52
Matt Smith Spark Streaming batch sequence number Mon, 29 Aug, 15:18
Denis Bolshakov Re: After calling persist, why the size in sparkui is not matching with the actual file size Mon, 29 Aug, 15:32
Ricky Pritchett Exception during creation of ActorReceiver when running ActorWordCount on CDH 5.5.2 Mon, 29 Aug, 15:35
Thunder Stumpges Coding in the Spark ml "ecosystem" why is everything private?! Mon, 29 Aug, 16:46
Sean Owen Re: Coding in the Spark ml "ecosystem" why is everything private?! Mon, 29 Aug, 16:49
Thunder Stumpges Re: Coding in the Spark ml "ecosystem" why is everything private?! Mon, 29 Aug, 17:01
Yong Zhang Great performance improvement of Spark 1.6.2 on our production cluster Mon, 29 Aug, 17:16
Everett Anderson Re: S3A + EMR failure when writing Parquet? Mon, 29 Aug, 17:18
Mich Talebzadeh Re: Design patterns involving Spark Mon, 29 Aug, 17:19
Bhaarat Sharma Re: Design patterns involving Spark Mon, 29 Aug, 17:53
Russell Jurney Re: Automating lengthy command to pyspark with configuration? Mon, 29 Aug, 18:47
Mich Talebzadeh Re: Design patterns involving Spark Mon, 29 Aug, 20:23
Jestin Ma Cleanup after Spark SQL job with window aggregation takes a long time Mon, 29 Aug, 22:57
ckanth99 Spark launcher handle and listener not giving state Mon, 29 Aug, 23:36
Marcelo Vanzin Re: Spark launcher handle and listener not giving state Mon, 29 Aug, 23:39
kant kodali java.lang.RuntimeException: java.lang.AssertionError: assertion failed: A ReceiverSupervisor has not been attached to the receiver yet. Mon, 29 Aug, 23:49
kant kodali How to attach a ReceiverSupervisor for a Custom receiver in Spark Streaming? Tue, 30 Aug, 00:18
ckanth99 Re: Spark launcher handle and listener not giving state Tue, 30 Aug, 02:12
Chanh Le Re: Design patterns involving Spark Tue, 30 Aug, 02:19
Rohit Kumar Prusty RE: After calling persist, why the size in sparkui is not matching with the actual file size Tue, 30 Aug, 04:27
Aseem Bansal Spark 2.0.0 - What all access is needed to save model to S3? Tue, 30 Aug, 05:20
canan chen How to use custom class in DataSet Tue, 30 Aug, 05:39
Otis Gospodnetić Spark metrics when running with YARN? Tue, 30 Aug, 05:53
Mich Talebzadeh Re: Spark metrics when running with YARN? Tue, 30 Aug, 06:51
Mich Talebzadeh Re: Design patterns involving Spark Tue, 30 Aug, 06:56
Sree Eedupuganti How to convert List<Row> into json object / json Array Tue, 30 Aug, 07:06
Alonso Isidoro Roman Re: Design patterns involving Spark Tue, 30 Aug, 07:33
Mich Talebzadeh Re: Design patterns involving Spark Tue, 30 Aug, 07:52
Alonso Isidoro Roman Re: Design patterns involving Spark Tue, 30 Aug, 08:10
Mich Talebzadeh Re: Spark 2.0 - Join statement compile error Tue, 30 Aug, 08:27
Sree Eedupuganti How to convert List<Row> into json object / json Array Tue, 30 Aug, 08:55
Sivakumaran S Re: How to convert List<Row> into json object / json Array Tue, 30 Aug, 09:04
Mich Talebzadeh Writing to Hbase table from Spark Tue, 30 Aug, 09:13
ayan guha Re: Writing to Hbase table from Spark Tue, 30 Aug, 09:23
Jacek Laskowski Re: Spark 2.0 - Join statement compile error Tue, 30 Aug, 09:52
shengshanzhang Re: Spark 2.0 - Join statement compile error Tue, 30 Aug, 09:55
Vijay Kiran Re: Spark metrics when running with YARN? Tue, 30 Aug, 10:48
Mich Talebzadeh Re: Spark metrics when running with YARN? Tue, 30 Aug, 10:59
Cleosson José Pirani de Souza ApplicationMaster + Fair Scheduler + Dynamic resource allocation Tue, 30 Aug, 11:30
Todd Nist Re: Writing to Hbase table from Spark Tue, 30 Aug, 12:08
AssafMendelson broadcast fails on join Tue, 30 Aug, 12:09
Todd Nist Re: Design patterns involving Spark Tue, 30 Aug, 12:16
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
Jan 2021203
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137