spark-user mailing list archives: November 2016

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next »Thread · Author · Date
Re: why spark driver program is creating so many threads? How can I limit this number?
kant kodali   Re: why spark driver program is creating so many threads? How can I limit this number? Tue, 01 Nov, 02:10
kant kodali     Re: why spark driver program is creating so many threads? How can I limit this number? Tue, 01 Nov, 06:24
kant kodali       Re: why spark driver program is creating so many threads? How can I limit this number? Tue, 01 Nov, 08:39
Sean Owen     Re: why spark driver program is creating so many threads? How can I limit this number? Tue, 01 Nov, 09:19
kant kodali       Re: why spark driver program is creating so many threads? How can I limit this number? Tue, 01 Nov, 09:52
kant kodali         Re: why spark driver program is creating so many threads? How can I limit this number? Tue, 01 Nov, 09:58
Shixiong(Ryan) Zhu           Re: why spark driver program is creating so many threads? How can I limit this number? Tue, 01 Nov, 17:14
kant kodali             Re: why spark driver program is creating so many threads? How can I limit this number? Tue, 01 Nov, 18:25
Shixiong(Ryan) Zhu               Re: why spark driver program is creating so many threads? How can I limit this number? Tue, 01 Nov, 18:40
kant kodali                 Re: why spark driver program is creating so many threads? How can I limit this number? Tue, 01 Nov, 20:48
RE: Out Of Memory issue
Kürşat Kurt   RE: Out Of Memory issue Tue, 01 Nov, 04:20
Kürşat Kurt     RE: Out Of Memory issue Tue, 01 Nov, 06:24
Nirav Patel       Re: Out Of Memory issue Wed, 02 Nov, 00:08
Rohit Kumar Prusty       RE: Out Of Memory issue Wed, 02 Nov, 05:50
Kürşat Kurt         RE: Out Of Memory issue Fri, 04 Nov, 22:17
Re: java.lang.OutOfMemoryError: unable to create new native thread
kant kodali   Re: java.lang.OutOfMemoryError: unable to create new native thread Tue, 01 Nov, 05:32
kant kodali     Re: java.lang.OutOfMemoryError: unable to create new native thread Tue, 01 Nov, 06:20
fanooos Spark Job Failed with FileNotFoundException Tue, 01 Nov, 07:16
颜发才(Yan Facai) Addition of two SparseVector Tue, 01 Nov, 08:04
Andrew Holway Python - Spark Cassandra Connector on DC/OS Tue, 01 Nov, 09:04
Andrew Holway   Re: Python - Spark Cassandra Connector on DC/OS Tue, 01 Nov, 09:32
wyj Streaming performance would be better with input than without Tue, 01 Nov, 09:32
Re: Efficient filtering on Spark SQL dataframes with ordered keys
Michael David Pedersen   Re: Efficient filtering on Spark SQL dataframes with ordered keys Tue, 01 Nov, 10:01
Mich Talebzadeh     Re: Efficient filtering on Spark SQL dataframes with ordered keys Tue, 01 Nov, 10:38
Michael David Pedersen       Re: Efficient filtering on Spark SQL dataframes with ordered keys Tue, 01 Nov, 10:50
Mich Talebzadeh         Re: Efficient filtering on Spark SQL dataframes with ordered keys Tue, 01 Nov, 11:11
Michael Armbrust           Re: Efficient filtering on Spark SQL dataframes with ordered keys Tue, 01 Nov, 22:45
Michael David Pedersen             Re: Efficient filtering on Spark SQL dataframes with ordered keys Wed, 02 Nov, 17:42
Nirav Patel Is IDF model reusable Tue, 01 Nov, 10:10
Nirav Patel Spark ML - Is IDF model reusable Tue, 01 Nov, 10:15
Robin East   Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 10:49
Nirav Patel     Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 11:18
Robin East       Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 11:24
Nirav Patel         Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 11:54
ayan guha           Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 12:45
Nirav Patel             Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 18:48
ayan guha               Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 23:01
Nirav Patel                 Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 23:04
ayan guha                   Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 23:09
Nirav Patel                     Re: Spark ML - Is IDF model reusable Tue, 01 Nov, 23:29
Nirav Patel Spark ML - CrossValidation - How to get Evaluation metrics of best model Tue, 01 Nov, 12:10
Sean Owen   Re: Spark ML - CrossValidation - How to get Evaluation metrics of best model Tue, 01 Nov, 13:30
Nirav Patel     Re: Spark ML - CrossValidation - How to get Evaluation metrics of best model Wed, 02 Nov, 17:59
Jan Botorek Add jar files on classpath when submitting tasks to Spark Tue, 01 Nov, 12:11
ayan guha   Re: Add jar files on classpath when submitting tasks to Spark Tue, 01 Nov, 12:49
Jan Botorek     RE: Add jar files on classpath when submitting tasks to Spark Tue, 01 Nov, 12:56
Vinod Mangipudi       Re: Add jar files on classpath when submitting tasks to Spark Tue, 01 Nov, 13:04
Mich Talebzadeh         Re: Add jar files on classpath when submitting tasks to Spark Tue, 01 Nov, 13:17
Jan Botorek           RE: Add jar files on classpath when submitting tasks to Spark Tue, 01 Nov, 13:39
Mich Talebzadeh             Re: Add jar files on classpath when submitting tasks to Spark Tue, 01 Nov, 13:50
Jan Botorek               RE: Add jar files on classpath when submitting tasks to Spark Tue, 01 Nov, 14:02
Mich Talebzadeh                 Re: Add jar files on classpath when submitting tasks to Spark Tue, 01 Nov, 14:22
Jan Botorek                   RE: Add jar files on classpath when submitting tasks to Spark Wed, 02 Nov, 09:36
Mich Talebzadeh                     Re: Add jar files on classpath when submitting tasks to Spark Wed, 02 Nov, 09:56
Alexis Seigneurin Application remains in WAITING state after Master election Tue, 01 Nov, 15:46
Re: GraphFrame BFS
Denny Lee   Re: GraphFrame BFS Tue, 01 Nov, 15:50
Re: Deep learning libraries for scala
Benjamin Kim   Re: Deep learning libraries for scala Tue, 01 Nov, 17:14
Masood Krohy     Re: Deep learning libraries for scala Fri, 04 Nov, 15:29
vinay parekar not table to connect to table using hiveContext Tue, 01 Nov, 23:30
shyla deshpande Does Data pipeline using kafka and structured streaming work? Tue, 01 Nov, 23:45
Michael Armbrust   Re: Does Data pipeline using kafka and structured streaming work? Wed, 02 Nov, 00:19
shyla deshpande     Re: Does Data pipeline using kafka and structured streaming work? Wed, 02 Nov, 00:37
Cody Koeninger       Re: Does Data pipeline using kafka and structured streaming work? Wed, 02 Nov, 01:18
Michael Armbrust         Re: Does Data pipeline using kafka and structured streaming work? Wed, 02 Nov, 01:29
Cody Koeninger           Re: Does Data pipeline using kafka and structured streaming work? Wed, 02 Nov, 01:52
shyla deshpande             Re: Does Data pipeline using kafka and structured streaming work? Wed, 02 Nov, 03:59
map reduced Spark Streaming backpressure weird behavior/bug Wed, 02 Nov, 04:59
Cody Koeninger   Re: Spark Streaming backpressure weird behavior/bug Wed, 02 Nov, 15:43
map reduced     Re: Spark Streaming backpressure weird behavior/bug Wed, 02 Nov, 18:21
map reduced       Re: Spark Streaming backpressure weird behavior/bug Thu, 03 Nov, 02:43
Cody Koeninger         Re: Spark Streaming backpressure weird behavior/bug Thu, 03 Nov, 21:45
map reduced           Re: Spark Streaming backpressure weird behavior/bug Fri, 04 Nov, 00:11
map reduced             Re: Spark Streaming backpressure weird behavior/bug Fri, 04 Nov, 00:40
Cody Koeninger               Re: Spark Streaming backpressure weird behavior/bug Fri, 04 Nov, 00:51
Timur Shenkao               Re: Spark Streaming backpressure weird behavior/bug Sat, 05 Nov, 10:44
map reduced                 Re: Spark Streaming backpressure weird behavior/bug Sat, 05 Nov, 19:48
Mudit Kumar                   Spark Streaming backpressure weird behavior/bug Mon, 07 Nov, 09:41
Michael Segel                     Re: Spark Streaming backpressure weird behavior/bug Mon, 07 Nov, 17:34
map reduced                   Re: Spark Streaming backpressure weird behavior/bug Wed, 09 Nov, 01:07
颜发才(Yan Facai) How to return a case class in map function? Wed, 02 Nov, 07:01
Michael Armbrust   Re: How to return a case class in map function? Wed, 02 Nov, 18:01
颜发才(Yan Facai)     Re: How to return a case class in map function? Thu, 03 Nov, 10:22
颜发才(Yan Facai)       Re: How to return a case class in map function? Thu, 03 Nov, 10:51
How to avoid unnecessary spark starkups on every request?
Fanjin Zeng   How to avoid unnecessary spark starkups on every request? Wed, 02 Nov, 07:34
vincent gromakowski     Re: How to avoid unnecessary spark starkups on every request? Wed, 02 Nov, 08:05
Vadim Semenov     Re: How to avoid unnecessary spark starkups on every request? Wed, 02 Nov, 14:45
kant kodali random idea Wed, 02 Nov, 08:37
Re: Duplicate rows in windowing functions
Pankaj Wahane   Re: Duplicate rows in windowing functions Wed, 02 Nov, 08:43
Pankaj Wahane     Re: Duplicate rows in windowing functions Wed, 02 Nov, 09:12
ponkin [Spark2] huge BloomFilters Wed, 02 Nov, 10:27
unsubscribe
Kunal Gaikwad   unsubscribe Wed, 02 Nov, 10:47
Venkatesh Seshan   unsubscribe Wed, 02 Nov, 18:36
Venkatesh Seshan   unsubscribe Thu, 03 Nov, 15:56
Shashikant Kulkarni (शशिकांत कुलकर्णी)   unsubscribe Fri, 04 Nov, 02:08
junius zhou   unsubscribe Sat, 05 Nov, 13:46
Bibudh Lahiri   unsubscribe Sun, 13 Nov, 05:46
Md. Mahedi Kaysar Need to know about GraphX and Streaming Wed, 02 Nov, 11:20
Ashutosh Kumar Running Google Dataflow on Spark Wed, 02 Nov, 11:48
Sean Owen   Re: Running Google Dataflow on Spark Wed, 02 Nov, 12:07
Mich Talebzadeh Big Data Event London, 3-4th November 2016 from Tomorrow Wed, 02 Nov, 12:25
Unsubscribe
srikrishna chaitanya garimella   Unsubscribe Wed, 02 Nov, 13:57
Bibudh Lahiri   Unsubscribe Thu, 03 Nov, 15:49
Ninad Shringarpure   Unsubscribe Mon, 28 Nov, 15:12
ryou.haseg...@gmail.com     Unsubscribe Mon, 28 Nov, 21:22
R. Revert       Unsubscribe Mon, 28 Nov, 21:28
Charles Allen         Re: Unsubscribe Mon, 28 Nov, 21:41
Bibudh Lahiri   Unsubscribe Wed, 30 Nov, 04:03
Aditya     Unsubscribe Wed, 30 Nov, 08:21
Sivakumar S   Unsubscribe Wed, 30 Nov, 23:43
Yanwei Zhang Use a specific partition of dataframe Wed, 02 Nov, 16:28
Mendelson, Assaf   RE: Use a specific partition of dataframe Thu, 03 Nov, 07:33
Mikael Ståldal Load whole ALS MatrixFactorizationModel into memory Wed, 02 Nov, 16:53
Sean Owen   Re: Load whole ALS MatrixFactorizationModel into memory Wed, 02 Nov, 17:39
Daniel Haviv error: Unable to find encoder for type stored in a Dataset. when trying to map through a DataFrame Wed, 02 Nov, 16:57
Michael Armbrust   Re: error: Unable to find encoder for type stored in a Dataset. when trying to map through a DataFrame Wed, 02 Nov, 17:59
Cassa L Custom receiver for WebSocket in Spark not working Wed, 02 Nov, 17:23
kant kodali   Re: Custom receiver for WebSocket in Spark not working Wed, 02 Nov, 17:56
Nirav Patel Spark ML - Is it rule of thumb that all Estimators should only be Fit on Training data Wed, 02 Nov, 18:05
Sean Owen   Re: Spark ML - Is it rule of thumb that all Estimators should only be Fit on Training data Wed, 02 Nov, 18:11
Michael Segel Quirk in how Spark DF handles JSON input records? Wed, 02 Nov, 18:50
Michael Segel   Re: Quirk in how Spark DF handles JSON input records? Wed, 02 Nov, 18:58
Daniel Siegmann     Re: Quirk in how Spark DF handles JSON input records? Wed, 02 Nov, 19:22
Michael Segel       Re: Quirk in how Spark DF handles JSON input records? Wed, 02 Nov, 19:39
Mendelson, Assaf         RE: Quirk in how Spark DF handles JSON input records? Thu, 03 Nov, 07:41
Michael Segel           Re: Quirk in how Spark DF handles JSON input records? Thu, 03 Nov, 15:29
Kalpana Jalawadi BiMap BroadCast Variable - Kryo Serialization Issue Wed, 02 Nov, 19:05
Aniket Bhatnagar RuntimeException: Null value appeared in non-nullable field when holding Optional Case Class Wed, 02 Nov, 21:12
Aniket Bhatnagar   Re: RuntimeException: Null value appeared in non-nullable field when holding Optional Case Class Thu, 03 Nov, 21:52
Re: mapwithstate Hangs with Error cleaning broadcast
manasdebashiskar   Re: mapwithstate Hangs with Error cleaning broadcast Wed, 02 Nov, 21:59
Anton Bubna-Litic Creating external tables in Spark 2.0.0 Thu, 03 Nov, 04:39
map reduced Increasing Executor threadpool Thu, 03 Nov, 04:48
map reduced   Re: Increasing Executor threadpool Thu, 03 Nov, 07:09
Mich Talebzadeh   Re: Increasing Executor threadpool Thu, 03 Nov, 07:55
map reduced     Re: Increasing Executor threadpool Thu, 03 Nov, 15:37
heather79 distribute partitions evenly to my cluster Thu, 03 Nov, 06:05
heather79   Re: distribute partitions evenly to my cluster Sun, 06 Nov, 19:55
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next »Thread · Author · Date
Box list
Aug 201994
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137