spark-user mailing list archives: September 2016

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · Next »Thread · Author · Date
Re: Spark 2.0 - Parquet data with fields containing periods "."
Don Drake   Re: Spark 2.0 - Parquet data with fields containing periods "." Thu, 01 Sep, 00:05
RE: AnalysisException exception while parsing XML
srikanth.je...@gmail.com   RE: AnalysisException exception while parsing XML Thu, 01 Sep, 00:54
Peyman Mohajerian     Re: AnalysisException exception while parsing XML Thu, 01 Sep, 01:26
ayan guha Scala Vs Python Thu, 01 Sep, 02:02
时金魁   Re:Scala Vs Python Thu, 01 Sep, 02:26
Santoshakhilesh   RE: Scala Vs Python Thu, 01 Sep, 05:02
AssafMendelson   RE: Scala Vs Python Thu, 01 Sep, 06:45
kant kodali     Re: Scala Vs Python Thu, 01 Sep, 14:57
ayan guha       Re: Scala Vs Python Thu, 01 Sep, 21:20
Jakob Odersky         Re: Scala Vs Python Thu, 01 Sep, 21:49
Mich Talebzadeh           Re: Scala Vs Python Thu, 01 Sep, 22:01
Peyman Mohajerian             Re: Scala Vs Python Thu, 01 Sep, 22:10
Mich Talebzadeh               Re: Scala Vs Python Thu, 01 Sep, 22:15
Jakob Odersky                 Re: Scala Vs Python Thu, 01 Sep, 23:08
ayan guha                   Re: Scala Vs Python Fri, 02 Sep, 01:55
darren   Re: Scala Vs Python Thu, 01 Sep, 22:15
Tal Grynbaum     Re: Scala Vs Python Fri, 02 Sep, 06:10
ayan guha       Re: Scala Vs Python Fri, 02 Sep, 06:25
Santoshakhilesh         RE: Scala Vs Python Fri, 02 Sep, 07:10
Jakob Odersky         Re: Scala Vs Python Fri, 02 Sep, 07:11
Jakob Odersky           Re: Scala Vs Python Fri, 02 Sep, 07:23
Mich Talebzadeh             Re: Scala Vs Python Fri, 02 Sep, 07:58
Sivakumaran S               Re: Scala Vs Python Fri, 02 Sep, 08:03
Nicholas Chammas               Re: Scala Vs Python Fri, 02 Sep, 14:35
Mich Talebzadeh                 Re: Scala Vs Python Fri, 02 Sep, 14:48
andy petrella                   Re: Scala Vs Python Fri, 02 Sep, 14:53
Nicholas Chammas                   Re: Scala Vs Python Fri, 02 Sep, 14:54
Mich Talebzadeh                     Re: Scala Vs Python Fri, 02 Sep, 15:01
Nicholas Chammas                       Re: Scala Vs Python Fri, 02 Sep, 15:03
Mich Talebzadeh                         Re: Scala Vs Python Fri, 02 Sep, 15:18
Luciano Resende     Re: Scala Vs Python Tue, 06 Sep, 00:07
darren   Re: Scala Vs Python Fri, 02 Sep, 15:34
AssafMendelson   RE: Scala Vs Python Sun, 04 Sep, 07:23
ayan guha     Re: Scala Vs Python Sun, 04 Sep, 08:00
Simon Edelhaus       Re: Scala Vs Python Sun, 04 Sep, 08:17
AssafMendelson   RE: Scala Vs Python Sun, 04 Sep, 10:17
Gourav Sengupta     Re: Scala Vs Python Mon, 05 Sep, 22:20
Leonard Cohen   Re: Scala Vs Python Tue, 06 Sep, 10:38
刘虓     Re: Scala Vs Python Tue, 06 Sep, 10:48
Divya Gehlot [Error:]while read s3 buckets in Spark 1.6 in spark -submit Thu, 01 Sep, 02:45
Steve Loughran   Re: [Error:]while read s3 buckets in Spark 1.6 in spark -submit Thu, 01 Sep, 08:59
Divya Gehlot     Re: [Error:]while read s3 buckets in Spark 1.6 in spark -submit Fri, 02 Sep, 07:36
Re: Spark build 1.6.2 error
Divya Gehlot   Re: Spark build 1.6.2 error Thu, 01 Sep, 02:53
Diwakar Dhanuskodi     Re: Spark build 1.6.2 error Sat, 03 Sep, 06:14
Diwakar Dhanuskodi       Re: Spark build 1.6.2 error Sat, 03 Sep, 06:44
Nachiketa         Re: Spark build 1.6.2 error Sat, 03 Sep, 07:09
Diwakar Dhanuskodi           Re: Spark build 1.6.2 error Sat, 03 Sep, 07:38
Eric Ho KeyManager exception in Spark 1.6.2 Thu, 01 Sep, 04:11
saurabh3d Window Functions with SQLContext Thu, 01 Sep, 05:16
Adline Dsilva   RE: Window Functions with SQLContext Thu, 01 Sep, 05:34
Saurabh Dubey     RE: Window Functions with SQLContext Thu, 01 Sep, 05:40
ayan guha   Re: Window Functions with SQLContext Thu, 01 Sep, 05:42
Saurabh Dubey     RE: Window Functions with SQLContext Thu, 01 Sep, 05:47
Divya Gehlot   Re: Window Functions with SQLContext Thu, 01 Sep, 06:02
Saurabh Dubey     RE: Window Functions with SQLContext Thu, 01 Sep, 06:10
Eric Ho how should I compose keyStore and trustStore if Spark needs to talk to Kafka & Cassandra ? Thu, 01 Sep, 08:09
Eric Ho   Re: how should I compose keyStore and trustStore if Spark needs to talk to Kafka & Cassandra ? Thu, 01 Sep, 08:26
Cody Koeninger     Re: how should I compose keyStore and trustStore if Spark needs to talk to Kafka & Cassandra ? Thu, 01 Sep, 15:04
Aseem Bansal spark 2.0.0 - code generation inputadapter_value is not rvalue Thu, 01 Sep, 08:36
Aseem Bansal Spark 2.0.0 - Java vs Scala performance difference Thu, 01 Sep, 09:06
Sean Owen   Re: Spark 2.0.0 - Java vs Scala performance difference Thu, 01 Sep, 09:27
ayan guha     Re: Spark 2.0.0 - Java vs Scala performance difference Thu, 01 Sep, 11:48
Aseem Bansal       Re: Spark 2.0.0 - Java vs Scala performance difference Thu, 01 Sep, 12:11
Adam Roberts         Re: Spark 2.0.0 - Java vs Scala performance difference Thu, 01 Sep, 13:24
Divya Gehlot difference between package and jar Option in Spark Thu, 01 Sep, 09:24
Sean Owen   Re: difference between package and jar Option in Spark Thu, 01 Sep, 09:26
Divya Gehlot     Re: difference between package and jar Option in Spark Mon, 05 Sep, 03:58
Tal Grynbaum       Re: difference between package and jar Option in Spark Mon, 05 Sep, 04:12
ANDREA SPINA java.lang.OutOfMemoryError Spark MLlib ALS matrix factorization Thu, 01 Sep, 09:49
Re: Does a driver jvm houses some rdd partitions?
Jakub Dubovsky   Re: Does a driver jvm houses some rdd partitions? Thu, 01 Sep, 11:47
Jakub Dubovsky Why there is no top method in dataset api Thu, 01 Sep, 11:53
Sean Owen   Re: Why there is no top method in dataset api Thu, 01 Sep, 12:31
Jakub Dubovsky     Re: Why there is no top method in dataset api Mon, 05 Sep, 12:01
Sean Owen       Re: Why there is no top method in dataset api Mon, 05 Sep, 12:26
Jakub Dubovsky         Re: Why there is no top method in dataset api Tue, 13 Sep, 14:08
Aseem Bansal Spark 2.0.0 - has anyone used spark ML to do predictions under 20ms? Thu, 01 Sep, 12:37
Sean Owen   Re: Spark 2.0.0 - has anyone used spark ML to do predictions under 20ms? Thu, 01 Sep, 12:45
Aseem Bansal     Re: Spark 2.0.0 - has anyone used spark ML to do predictions under 20ms? Thu, 01 Sep, 13:01
Sean Owen       Re: Spark 2.0.0 - has anyone used spark ML to do predictions under 20ms? Thu, 01 Sep, 13:08
Aseem Bansal         Re: Spark 2.0.0 - has anyone used spark ML to do predictions under 20ms? Thu, 01 Sep, 13:21
Nick Pentreath           Re: Spark 2.0.0 - has anyone used spark ML to do predictions under 20ms? Thu, 01 Sep, 13:37
Nick Pentreath             Re: Spark 2.0.0 - has anyone used spark ML to do predictions under 20ms? Thu, 01 Sep, 13:39
Sean Owen             Re: Spark 2.0.0 - has anyone used spark ML to do predictions under 20ms? Thu, 01 Sep, 13:42
Aseem Bansal               Re: Spark 2.0.0 - has anyone used spark ML to do predictions under 20ms? Fri, 02 Sep, 09:51
AssafMendelson using multiple worker instances in spark standalone Thu, 01 Sep, 12:54
enrico d'urso Spark scheduling mode Thu, 01 Sep, 14:10
Mark Hamstra   Re: Spark scheduling mode Thu, 01 Sep, 17:24
enrico d'urso   Re: Spark scheduling mode Thu, 01 Sep, 18:11
Mark Hamstra     Re: Spark scheduling mode Thu, 01 Sep, 18:19
enrico d'urso       Re: Spark scheduling mode Thu, 01 Sep, 18:23
Mark Hamstra         Re: Spark scheduling mode Thu, 01 Sep, 18:44
enrico d'urso         Re: Spark scheduling mode Fri, 02 Sep, 09:37
Mark Hamstra           Re: Spark scheduling mode Fri, 02 Sep, 18:34
Mark Hamstra             Re: Spark scheduling mode Fri, 02 Sep, 18:37
Difference between Data set and Data Frame in Spark 2
Ashok Kumar   Difference between Data set and Data Frame in Spark 2 Thu, 01 Sep, 14:17
Sean Owen     Re: Difference between Data set and Data Frame in Spark 2 Thu, 01 Sep, 14:26
Ovidiu-Cristian MARCU       Re: Difference between Data set and Data Frame in Spark 2 Thu, 01 Sep, 14:35
Ovidiu-Cristian MARCU         Re: Difference between Data set and Data Frame in Spark 2 Thu, 01 Sep, 15:33
Mich Talebzadeh           Re: Difference between Data set and Data Frame in Spark 2 Thu, 01 Sep, 15:56
Sean Owen             Re: Difference between Data set and Data Frame in Spark 2 Thu, 01 Sep, 16:15
Maciej Bryński               Re: Difference between Data set and Data Frame in Spark 2 Thu, 01 Sep, 18:11
Mich Talebzadeh                 Re: Difference between Data set and Data Frame in Spark 2 Thu, 01 Sep, 20:02
Re: Hi, guys, does anyone use Spark in finance market?
Adam Roberts   Re: Hi, guys, does anyone use Spark in finance market? Thu, 01 Sep, 14:25
Mich Talebzadeh     Re: Hi, guys, does anyone use Spark in finance market? Thu, 01 Sep, 22:54
Taotao.Li       Re: Hi, guys, does anyone use Spark in finance market? Thu, 01 Sep, 23:54
Taotao.Li     Re: Hi, guys, does anyone use Spark in finance market? Thu, 01 Sep, 23:51
Re: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation.
Romanov   Re: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Thu, 01 Sep, 15:28
Corentin Kerisit Error creating dataframe from schema with nested using case class Thu, 01 Sep, 15:41
Сергей Романов Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Thu, 01 Sep, 15:55
Mich Talebzadeh   Re: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Thu, 01 Sep, 16:35
Сергей Романов     Re[2]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Fri, 02 Sep, 11:03
Mich Talebzadeh       Re: Re[2]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Fri, 02 Sep, 21:22
Сергей Романов         Re[4]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Sat, 03 Sep, 11:54
Сергей Романов           Re[5]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Sat, 03 Sep, 12:40
Сергей Романов             Re[6]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Sat, 03 Sep, 12:50
Сергей Романов               Re[7]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Sat, 03 Sep, 13:04
Gavin Yue               Re: Re[6]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Sat, 03 Sep, 16:53
Сергей Романов                 Re[8]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Mon, 05 Sep, 11:21
Yong Zhang                   Re: Re[8]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Tue, 06 Sep, 21:35
Сергей Романов                     Re[10]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Wed, 07 Sep, 09:33
Davies Liu   Re: Re[8]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Tue, 06 Sep, 18:27
Rajkiran Rajkumar [HELP] Force stop a Spark Streaming application running on EMR Thu, 01 Sep, 16:46
Dataset Filter performance - trying to understand
Darin McBeath   Dataset Filter performance - trying to understand Thu, 01 Sep, 17:40
What's the best way to detect and remove outliers in a table?
Mobius ReX   What's the best way to detect and remove outliers in a table? Thu, 01 Sep, 17:47
Fwd: Need some help
Aakash Basu   Fwd: Need some help Thu, 01 Sep, 19:42
Aakash Basu     Re: Fwd: Need some help Thu, 01 Sep, 20:05
Shashank Mandil       Re: Fwd: Need some help Thu, 01 Sep, 20:18
Aakash Basu         Re: Fwd: Need some help Fri, 02 Sep, 08:24
Aris Possible Code Generation Bug: Can Spark 2.0 Datasets handle Scala Value Classes? Thu, 01 Sep, 20:58
Jakob Odersky   Re: Possible Code Generation Bug: Can Spark 2.0 Datasets handle Scala Value Classes? Thu, 01 Sep, 21:44
Aris     Re: Possible Code Generation Bug: Can Spark 2.0 Datasets handle Scala Value Classes? Thu, 01 Sep, 22:09
Aris       Re: Possible Code Generation Bug: Can Spark 2.0 Datasets handle Scala Value Classes? Thu, 01 Sep, 23:15
Jakob Odersky         Re: Possible Code Generation Bug: Can Spark 2.0 Datasets handle Scala Value Classes? Thu, 01 Sep, 23:43
Re: Expected benefit of parquet filter pushdown?
Christon DeWan   Re: Expected benefit of parquet filter pushdown? Thu, 01 Sep, 23:02
Don Drake Spark 2.0.0 - SQL - Running query with outer join from 1.6 fails Fri, 02 Sep, 00:19
nsareen MLib : Non Linear Optimization Fri, 02 Sep, 01:50
nsareen   Re: MLib : Non Linear Optimization Thu, 08 Sep, 04:04
Robin East     Re: MLib : Non Linear Optimization Thu, 08 Sep, 08:38
Nitin Sareen       Re: MLib : Non Linear Optimization Fri, 09 Sep, 08:51
Ian Stokes Rees PySpark: preference for Python 2.7 or Python 3.5? Fri, 02 Sep, 02:56
Sean Owen   Re: PySpark: preference for Python 2.7 or Python 3.5? Fri, 02 Sep, 07:39
Felix Cheung     Re: PySpark: preference for Python 2.7 or Python 3.5? Fri, 02 Sep, 07:47
Ian Stokes Rees       Re: PySpark: preference for Python 2.7 or Python 3.5? Fri, 02 Sep, 12:47
김태준 Is Spark ML model possible continues learning Fri, 02 Sep, 03:44
Re: Custom return code
Pierre Villard   Re: Custom return code Fri, 02 Sep, 06:17
Re: Grouping on bucketed and sorted columns
Fridtjof Sander   Re: Grouping on bucketed and sorted columns Fri, 02 Sep, 12:25
Amit Shanker Passing Custom App Id for consumption in History Server Fri, 02 Sep, 12:59
Raghavendra Pandey   Re: Passing Custom App Id for consumption in History Server Sat, 03 Sep, 14:30
ayan guha     Re: Passing Custom App Id for consumption in History Server Sun, 04 Sep, 01:36
Spencer, Alex (Santander) BinaryClassificationMetrics - get raw tp/fp/tn/fn stats per threshold? Fri, 02 Sep, 13:54
Sean Owen   Re: BinaryClassificationMetrics - get raw tp/fp/tn/fn stats per threshold? Fri, 02 Sep, 14:38
Lost Overflow Does Spark support Partition Pruning with Parquet Files Fri, 02 Sep, 14:53
Daniel Siegmann Dataset encoder for java.time.LocalDate? Fri, 02 Sep, 15:29
Jakob Odersky   Re: Dataset encoder for java.time.LocalDate? Fri, 02 Sep, 19:25
sagarcasual . Pausing spark kafka streaming (direct) or exclude/include some partitions on the fly per batch Fri, 02 Sep, 17:28
Cody Koeninger   Re: Pausing spark kafka streaming (direct) or exclude/include some partitions on the fly per batch Fri, 02 Sep, 17:37
sagarcasual .     Re: Pausing spark kafka streaming (direct) or exclude/include some partitions on the fly per batch Fri, 02 Sep, 21:33
Cody Koeninger       Re: Pausing spark kafka streaming (direct) or exclude/include some partitions on the fly per batch Sat, 03 Sep, 14:03
Nirav Patel Spark web UI - Missing information Fri, 02 Sep, 17:41
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · Next »Thread · Author · Date
Box list
Aug 201994
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137