spark-user mailing list archives: February 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Re: eager? in dataframe's checkpoint
Koert Kuipers   Re: eager? in dataframe's checkpoint Wed, 01 Feb, 00:16
Jean Georges Perrin   Re: eager? in dataframe's checkpoint Thu, 02 Feb, 23:36
Jerry Lam Dataset Question: No Encoder found for Set[(scala.Long, scala.Long)] Wed, 01 Feb, 00:33
Koert Kuipers   Re: Dataset Question: No Encoder found for Set[(scala.Long, scala.Long)] Wed, 01 Feb, 01:04
Jerry Lam     Re: Dataset Question: No Encoder found for Set[(scala.Long, scala.Long)] Wed, 01 Feb, 17:03
Koert Kuipers       Re: Dataset Question: No Encoder found for Set[(scala.Long, scala.Long)] Wed, 01 Feb, 23:24
Jerry Lam         Re: Dataset Question: No Encoder found for Set[(scala.Long, scala.Long)] Wed, 01 Feb, 23:38
Re: Resource Leak in Spark Streaming
Shixiong(Ryan) Zhu   Re: Resource Leak in Spark Streaming Wed, 01 Feb, 01:28
Nipun Arora     Re: Resource Leak in Spark Streaming Wed, 01 Feb, 03:21
Nipun Arora       Re: Resource Leak in Spark Streaming Wed, 01 Feb, 03:24
Shixiong(Ryan) Zhu         Re: Resource Leak in Spark Streaming Wed, 01 Feb, 18:31
Nipun Arora           Re: Resource Leak in Spark Streaming Tue, 07 Feb, 23:35
Nipun Arora             Re: Resource Leak in Spark Streaming Wed, 08 Feb, 01:17
Re: JavaRDD text matadata(file name) findings
Hyukjin Kwon   Re: JavaRDD text matadata(file name) findings Wed, 01 Feb, 02:45
neil90   Re: JavaRDD text matadata(file name) findings Thu, 02 Feb, 01:09
Re: Converting timezones in Spark
Don Drake   Re: Converting timezones in Spark Wed, 01 Feb, 03:31
Don Drake Parameterized types and Datasets - Spark 2.1.0 Wed, 01 Feb, 04:12
Michael Armbrust   Re: Parameterized types and Datasets - Spark 2.1.0 Wed, 01 Feb, 21:16
Don Drake     Re: Parameterized types and Datasets - Spark 2.1.0 Wed, 01 Feb, 23:34
Michael Armbrust       Re: Parameterized types and Datasets - Spark 2.1.0 Thu, 02 Feb, 00:10
Don Drake         Re: Parameterized types and Datasets - Spark 2.1.0 Thu, 02 Feb, 02:19
Re: does both below code do the same thing? I had to refactor code to fit in spark-sql
Alex   Re: does both below code do the same thing? I had to refactor code to fit in spark-sql Wed, 01 Feb, 05:38
Alex Hive Java UDF running on spark-sql issue Wed, 01 Feb, 05:56
Marco Mistroni   Re: Hive Java UDF running on spark-sql issue Wed, 01 Feb, 10:37
Alex     Re: Hive Java UDF running on spark-sql issue Wed, 01 Feb, 11:44
RE: Jars directory in Spark 2.0
Sidney Feiner   RE: Jars directory in Spark 2.0 Wed, 01 Feb, 07:23
Marcelo Vanzin     Re: Jars directory in Spark 2.0 Wed, 01 Feb, 17:41
Sidney Feiner       RE: Jars directory in Spark 2.0 Wed, 01 Feb, 21:54
Han-Cheol Cho A question about inconsistency during dataframe creation with RDD/dict in PySpark Wed, 01 Feb, 10:25
Aseem Bansal Question about Multinomial LogisticRegression in spark mllib in spark 2.1.0 Wed, 01 Feb, 11:42
Seth Hendrickson   Re: Question about Multinomial LogisticRegression in spark mllib in spark 2.1.0 Wed, 01 Feb, 16:49
Hollin Wilkins     Re: Question about Multinomial LogisticRegression in spark mllib in spark 2.1.0 Wed, 01 Feb, 23:56
Re: tylerchapman@yahoo-inc.com is no longer with Yahoo! (was: Question about Multinomial LogisticRegression in spark mllib in spark 2.1.0)
Aseem Bansal   Re: tylerchapman@yahoo-inc.com is no longer with Yahoo! (was: Question about Multinomial LogisticRegression in spark mllib in spark 2.1.0) Wed, 01 Feb, 11:45
Koert Kuipers union of compatible types Wed, 01 Feb, 16:02
Jerry Lam using withWatermark on Dataset Wed, 01 Feb, 18:38
Michael Armbrust   Re: using withWatermark on Dataset Wed, 01 Feb, 21:01
Darshan Pandya pivot over non numerical data Wed, 01 Feb, 20:02
Kevin Mellott   Re: pivot over non numerical data Thu, 02 Feb, 05:56
Darshan Pandya     Re: pivot over non numerical data Thu, 02 Feb, 20:10
Re: increasing cross join speed
Takeshi Yamamuro   Re: increasing cross join speed Thu, 02 Feb, 06:18
Appu K Closing resources in the executor Thu, 02 Feb, 06:28
Appu K   Re: Closing resources in the executor Thu, 02 Feb, 10:07
Devi P.V FP growth - Items in a transaction must be unique Thu, 02 Feb, 07:17
Patrick Plaatje   Re: FP growth - Items in a transaction must be unique Thu, 02 Feb, 11:22
Alex Is it okay to run Hive Java UDFS in Spark-sql. Anybody's still doing it? Thu, 02 Feb, 08:33
Jörn Franke   Re: Is it okay to run Hive Java UDFS in Spark-sql. Anybody's still doing it? Thu, 02 Feb, 09:14
Peter Sg filters Pushdown Thu, 02 Feb, 09:41
vincent gromakowski   Re: filters Pushdown Thu, 02 Feb, 10:11
Peter Shmukler     RE: filters Pushdown Thu, 02 Feb, 10:23
ayan guha       Re: filters Pushdown Thu, 02 Feb, 10:30
vincent gromakowski       RE: filters Pushdown Thu, 02 Feb, 10:30
Alex Suprised!!!!!Spark-shell showing inconsistent results Thu, 02 Feb, 10:03
Didac Gil   Re: Suprised!!!!!Spark-shell showing inconsistent results Thu, 02 Feb, 10:53
Marco Mistroni   Re: Suprised!!!!!Spark-shell showing inconsistent results Thu, 02 Feb, 10:56
Alex   Re: Suprised!!!!!Spark-shell showing inconsistent results Fri, 03 Feb, 09:08
Anahita Talebi Running a spark code on multiple machines using google cloud platform Thu, 02 Feb, 12:29
Marco Mistroni   Re: Running a spark code on multiple machines using google cloud platform Thu, 02 Feb, 13:30
Anahita Talebi     Re: Running a spark code on multiple machines using google cloud platform Thu, 02 Feb, 13:46
Koert Kuipers frustration with field names in Dataset Thu, 02 Feb, 15:39
Koert Kuipers   Re: frustration with field names in Dataset Thu, 02 Feb, 15:41
Michael Armbrust   Re: frustration with field names in Dataset Thu, 02 Feb, 19:13
Koert Kuipers     Re: frustration with field names in Dataset Thu, 02 Feb, 19:29
Hollin Wilkins [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Thu, 02 Feb, 16:42
Aseem Bansal   Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Fri, 03 Feb, 12:00
Aseem Bansal     Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Fri, 03 Feb, 12:05
Hollin Wilkins       Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Fri, 03 Feb, 16:53
Asher Krim         Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Fri, 03 Feb, 18:48
Hollin Wilkins           Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Sat, 04 Feb, 00:33
Aseem Bansal         Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Sat, 04 Feb, 15:52
Debasish Das           Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Sat, 04 Feb, 16:54
Aseem Bansal             Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Sat, 04 Feb, 17:11
Debasish Das               Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Sat, 04 Feb, 17:37
Debasish Das                 Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Sat, 04 Feb, 18:06
Chris Fregly                   Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Sat, 04 Feb, 22:17
Aseem Bansal                 Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Sun, 05 Feb, 05:58
Debasish Das                   Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Sun, 05 Feb, 17:51
Aseem Bansal                     Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Mon, 06 Feb, 08:01
Hollin Wilkins                       Re: [ML] MLeap: Deploy Spark ML Pipelines w/o SparkContext Mon, 06 Feb, 14:08
Re: HBase Spark
Benjamin Kim   Re: HBase Spark Thu, 02 Feb, 18:28
Asher Krim     Re: HBase Spark Thu, 02 Feb, 19:06
Benjamin Kim       Re: HBase Spark Thu, 02 Feb, 22:43
Asher Krim         Re: HBase Spark Fri, 03 Feb, 16:16
Benjamin Kim           Re: HBase Spark Fri, 03 Feb, 16:57
Benjamin Kim           Re: HBase Spark Fri, 03 Feb, 17:33
Asher Krim             Re: HBase Spark Fri, 03 Feb, 18:50
Benjamin Kim               Re: HBase Spark Fri, 03 Feb, 19:03
Asher Krim                 Re: HBase Spark Fri, 03 Feb, 19:10
Benjamin Kim           Re: HBase Spark Fri, 03 Feb, 19:51
Re: Dynamic resource allocation to Spark on Mesos
Ji Yan   Re: Dynamic resource allocation to Spark on Mesos Thu, 02 Feb, 20:41
Michael Gummelt     Re: Dynamic resource allocation to Spark on Mesos Thu, 02 Feb, 20:56
Ji Yan       Re: Dynamic resource allocation to Spark on Mesos Thu, 02 Feb, 21:01
Michael Gummelt         Re: Dynamic resource allocation to Spark on Mesos Thu, 02 Feb, 21:02
Ji Yan           Re: Dynamic resource allocation to Spark on Mesos Thu, 02 Feb, 21:06
Michael Gummelt             Re: Dynamic resource allocation to Spark on Mesos Thu, 02 Feb, 21:30
Ji Yan               Re: Dynamic resource allocation to Spark on Mesos Thu, 02 Feb, 22:42
Michael Gummelt                 Re: Dynamic resource allocation to Spark on Mesos Thu, 02 Feb, 22:57
ji yan                   Re: Dynamic resource allocation to Spark on Mesos Fri, 03 Feb, 00:39
Sun Rui   Re: Dynamic resource allocation to Spark on Mesos Wed, 08 Feb, 03:36
Michael Gummelt     Re: Dynamic resource allocation to Spark on Mesos Wed, 08 Feb, 21:21
Sun Rui       Re: Dynamic resource allocation to Spark on Mesos Thu, 09 Feb, 01:50
Michael Gummelt         Re: Dynamic resource allocation to Spark on Mesos Thu, 09 Feb, 18:21
Don Drake Spark 2 - Creating datasets from dataframes with extra columns Thu, 02 Feb, 20:46
Don Drake   Re: Spark 2 - Creating datasets from dataframes with extra columns Mon, 06 Feb, 17:26
萝卜丝炒饭   Re: Spark 2 - Creating datasets from dataframes with extra columns Wed, 08 Feb, 12:51
Don Drake     Re: Spark 2 - Creating datasets from dataframes with extra columns Thu, 09 Feb, 01:22
Jean Georges Perrin Spark 2 + Java + UDF + unknown return type... Thu, 02 Feb, 21:05
Jörn Franke   Re: Spark 2 + Java + UDF + unknown return type... Thu, 02 Feb, 21:26
Koert Kuipers   Re: Spark 2 + Java + UDF + unknown return type... Sun, 05 Feb, 20:13
jimitkr Spark: Scala Shell Very Slow (Unresponsive) Thu, 02 Feb, 21:34
Irving Duran   Re: Spark: Scala Shell Very Slow (Unresponsive) Mon, 06 Feb, 16:18
Scott walent 4 days left to submit your abstract to Spark Summit SF Thu, 02 Feb, 22:28
Heji Kim persistence iops and throughput check? Re: Running a spark code on multiple machines using google cloud platform Fri, 03 Feb, 00:50
Koert Kuipers dataset algos slow because of too many shuffles Fri, 03 Feb, 05:49
shyla deshpande saveToCassandra issue. Please help Fri, 03 Feb, 08:45
shyla deshpande   Re: saveToCassandra issue. Please help Fri, 03 Feb, 18:26
shyla deshpande     Re: saveToCassandra issue. Please help Fri, 03 Feb, 18:39
balaji9058 Bipartite projection with Graphx Fri, 03 Feb, 10:24
Hamza HACHANI problem with the method JavaDStream.foreachRDD() SparkStreaming Fri, 03 Feb, 13:45
Alex Is DoubleWritable and DoubleObjectInspector doing the same thing in Hive UDF? Fri, 03 Feb, 14:49
Alex   Re: Is DoubleWritable and DoubleObjectInspector doing the same thing in Hive UDF? Sat, 04 Feb, 08:39
NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job
Dmitry Goldenberg   NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job Fri, 03 Feb, 18:10
Anastasios Zouzias     Re: NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job Fri, 03 Feb, 18:58
Jacek Laskowski       Re: NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job Sat, 04 Feb, 10:38
dgoldenberg   NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job Tue, 07 Feb, 18:44
Jacek Laskowski     Re: NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job Tue, 07 Feb, 19:02
☼ R Nair (रविशंकर नायर) sqlContext vs spark. Fri, 03 Feb, 18:48
Jacek Laskowski   Re: sqlContext vs spark. Fri, 03 Feb, 20:20
Shashank Mandil Spark submit on yarn does not return with exit code 1 on exception Fri, 03 Feb, 19:06
Jacek Laskowski   Re: Spark submit on yarn does not return with exit code 1 on exception Fri, 03 Feb, 21:22
Ali Gouta     Re: Spark submit on yarn does not return with exit code 1 on exception Fri, 03 Feb, 21:46
Jacek Laskowski       Re: Spark submit on yarn does not return with exit code 1 on exception Fri, 03 Feb, 21:56
Shashank Mandil         Re: Spark submit on yarn does not return with exit code 1 on exception Sat, 04 Feb, 00:35
Re: How do I dynamically add nodes to spark standalone cluster and be able to discover them?
kant kodali   Re: How do I dynamically add nodes to spark standalone cluster and be able to discover them? Sat, 04 Feb, 00:57
kant kodali     Re: How do I dynamically add nodes to spark standalone cluster and be able to discover them? Sat, 04 Feb, 01:09
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Box list
Jul 201998
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137