spark-user mailing list archives: August 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Tony Lane Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 12:14
ayan guha   Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 13:05
Tony Lane     Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 14:11
Sonal Goyal       Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 15:21
Mike Metzger       Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 15:45
Tony Lane         Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 15:55
Tony Lane           Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 16:07
janardhan shetty             Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 16:21
Mike Metzger               Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 16:37
Mike Metzger             Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 16:34
Mich Talebzadeh               Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 16:38
Mich Talebzadeh                 Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 16:58
Mike Metzger                 Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 19:26
Mich Talebzadeh         Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 16:33
Mike Metzger           Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 19:37
pseudo oduesp pyspark on pycharm on WINDOWS Fri, 05 Aug, 13:35
pseudo oduesp   Re: pyspark on pycharm on WINDOWS Fri, 05 Aug, 13:39
Aneela Saleem submitting spark job with kerberized Hadoop issue Fri, 05 Aug, 13:54
Jacek Laskowski   Re: submitting spark job with kerberized Hadoop issue Fri, 05 Aug, 19:34
Aneela Saleem     Re: submitting spark job with kerberized Hadoop issue Sat, 06 Aug, 09:03
Jacek Laskowski       Re: submitting spark job with kerberized Hadoop issue Sat, 06 Aug, 10:00
Wojciech Pituła   Re: submitting spark job with kerberized Hadoop issue Sat, 06 Aug, 13:29
Aneela Saleem     Re: submitting spark job with kerberized Hadoop issue Sun, 07 Aug, 16:05
Saisai Shao       Re: submitting spark job with kerberized Hadoop issue Mon, 08 Aug, 01:55
Ted Yu         Re: submitting spark job with kerberized Hadoop issue Mon, 08 Aug, 04:34
Aneela Saleem           Re: submitting spark job with kerberized Hadoop issue Mon, 08 Aug, 06:22
Aneela Saleem   Re: submitting spark job with kerberized Hadoop issue Tue, 16 Aug, 13:12
Aneela Saleem     Re: submitting spark job with kerberized Hadoop issue Sun, 21 Aug, 21:01
Andy Grove [Spark 2.0] Error during codegen for Java POJO Fri, 05 Aug, 14:28
Andy Grove   Re: [Spark 2.0] Error during codegen for Java POJO Fri, 05 Aug, 20:19
Carlo.Allocca ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 16:53
Ted Yu   Re: ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 16:58
Carlo.Allocca     Re: ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 17:10
Sean Owen       Re: ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 17:11
Carlo.Allocca         Re: ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 17:17
Carlo.Allocca           Re: ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 17:25
Ted Yu       Re: ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 17:11
Marcelo Vanzin   Re: ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 17:34
Carlo.Allocca     Re: ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 18:22
RK Aduri Question: collect action returning to driver Fri, 05 Aug, 17:12
Paschalis Veskos Avoid Cartesian product in calculating a distance matrix? Fri, 05 Aug, 17:20
Yann-Aël Le Borgne   Re: Avoid Cartesian product in calculating a distance matrix? Sat, 06 Aug, 08:54
Sonal Goyal   Re: Avoid Cartesian product in calculating a distance matrix? Sat, 06 Aug, 09:02
Saif.A.Ell...@wellsfargo.com Applying a limit after orderBy of big dataframe hangs spark Fri, 05 Aug, 18:54
Mich Talebzadeh   Re: Applying a limit after orderBy of big dataframe hangs spark Fri, 05 Aug, 19:33
Saif.A.Ell...@wellsfargo.com     RE: Applying a limit after orderBy of big dataframe hangs spark Fri, 05 Aug, 20:00
Bhupendra Mishra flume.thrift.queuesize Fri, 05 Aug, 19:25
Tony Lane Kmeans dataset initialization Fri, 05 Aug, 19:33
Tony Lane   Re: Kmeans dataset initialization Sat, 06 Aug, 14:50
Koert Kuipers spark historyserver backwards compatible Fri, 05 Aug, 21:14
Marcelo Vanzin   Re: spark historyserver backwards compatible Fri, 05 Aug, 21:21
Koert Kuipers     Re: spark historyserver backwards compatible Fri, 05 Aug, 21:23
Kiran Chitturi 2.0.0: AnalysisException when reading csv/json files with dots in periods Sat, 06 Aug, 00:33
Kiran Chitturi   Re: 2.0.0: AnalysisException when reading csv/json files with dots in periods Sat, 06 Aug, 00:49
Kiran Chitturi 2.0.0: Hive metastore uses a different version of derby than the Spark package Sat, 06 Aug, 00:45
Re: mapWithState handle timeout
jackerli   Re: mapWithState handle timeout Sat, 06 Aug, 07:57
李剑   mapWithState handle timeout Sat, 06 Aug, 08:00
jackerli   Re: mapWithState handle timeout Mon, 08 Aug, 08:13
Amit Sela Dropping late date in Structured Streaming Sat, 06 Aug, 13:40
Matei Zaharia   Re: Dropping late date in Structured Streaming Sun, 07 Aug, 01:55
Luciano Resende Help testing the Spark Extensions for the Apache Bahir 2.0.0 release Sat, 06 Aug, 17:18
Sivakumaran S   Re: Help testing the Spark Extensions for the Apache Bahir 2.0.0 release Sun, 07 Aug, 08:24
Luciano Resende     Re: Help testing the Spark Extensions for the Apache Bahir 2.0.0 release Sun, 07 Aug, 10:33
Deepak Sharma Long running tasks in stages Sat, 06 Aug, 17:31
Muthu Jayakumar Dataframe / Dataset partition size... Sat, 06 Aug, 19:56
Muthu Jayakumar   Re: Dataframe / Dataset partition size... Sat, 06 Aug, 22:50
Muhammad Haris Spark Application Counters Using Rest API Sat, 06 Aug, 20:44
Sumit Khanna spark df schema to hive schema converter func Sun, 07 Aug, 05:03
Sumit Khanna   Re: spark df schema to hive schema converter func Sun, 07 Aug, 05:05
Divya Gehlot [Spark1.6] Or (||) operator not working in DataFrame Sun, 07 Aug, 14:43
janardhan shetty   Re: [Spark1.6] Or (||) operator not working in DataFrame Sun, 07 Aug, 15:40
Mich Talebzadeh   Re: [Spark1.6] Or (||) operator not working in DataFrame Sun, 07 Aug, 15:53
Mich Talebzadeh     Re: [Spark1.6] Or (||) operator not working in DataFrame Sun, 07 Aug, 15:58
Chanh Le       Re: [Spark1.6] Or (||) operator not working in DataFrame Mon, 08 Aug, 03:12
Divya Gehlot         Re: [Spark1.6] Or (||) operator not working in DataFrame Mon, 08 Aug, 03:36
Mich Talebzadeh           Re: [Spark1.6] Or (||) operator not working in DataFrame Mon, 08 Aug, 07:25
Sorting a DStream and taking topN
Ahmed El-Gamal   Sorting a DStream and taking topN Sun, 07 Aug, 14:43
Ahmed El-Gamal   Sorting a DStream and taking topN Sun, 07 Aug, 14:46
Aneela Saleem Accessing HBase through Spark with Security enabled Sun, 07 Aug, 16:02
Jacek Laskowski   Re: Accessing HBase through Spark with Security enabled Sat, 13 Aug, 02:07
Aneela Saleem     Re: Accessing HBase through Spark with Security enabled Sat, 13 Aug, 06:30
Jacek Laskowski       Re: Accessing HBase through Spark with Security enabled Sat, 13 Aug, 15:36
Aneela Saleem         Re: Accessing HBase through Spark with Security enabled Mon, 15 Aug, 07:29
Steve Loughran           Re: Accessing HBase through Spark with Security enabled Mon, 15 Aug, 11:23
Aneela Saleem             Re: Accessing HBase through Spark with Security enabled Tue, 16 Aug, 10:04
Aneela Saleem               Re: Accessing HBase through Spark with Security enabled Sun, 21 Aug, 21:01
Hao Ren [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Sun, 07 Aug, 21:31
Muthu Jayakumar   Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 03:08
Hao Ren     Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 08:02
Reynold Xin       Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 20:00
Hao Ren         Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 21:05
Reynold Xin           Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 22:02
Jestin Ma Using Kyro for DataFrames (Dataset<Row>)? Sun, 07 Aug, 22:31
Javier Rey Random forest binary classification H20 difference Spark Mon, 08 Aug, 02:51
Yanbo Liang   Re: Random forest binary classification H20 difference Spark Wed, 10 Aug, 09:19
Bedrytski Aliaksandr     Re: Random forest binary classification H20 difference Spark Thu, 11 Aug, 06:00
Sumit Khanna silence the spark debug logs Mon, 08 Aug, 04:09
Sachin Janani   Re: silence the spark debug logs Mon, 08 Aug, 04:13
Hemalatha A Any exceptions during an action doesn't fail the Spark streaming batch in yarn-client mode Mon, 08 Aug, 04:44
ayan guha   Re: Any exceptions during an action doesn't fail the Spark streaming batch in yarn-client mode Mon, 08 Aug, 04:56
rtijoriwala map vs mapPartitions Mon, 08 Aug, 06:20
danellis Is Spark right for my use case? Mon, 08 Aug, 06:22
Deepak Sharma   Re: Is Spark right for my use case? Mon, 08 Aug, 07:36
Aseem Bansal Spark 2.0.0 - Broadcast variable - What is ClassTag? Mon, 08 Aug, 06:32
Holden Karau   Re: Spark 2.0.0 - Broadcast variable - What is ClassTag? Mon, 08 Aug, 06:39
Aseem Bansal     Re: Spark 2.0.0 - Broadcast variable - What is ClassTag? Mon, 08 Aug, 06:57
Holden Karau       Re: Spark 2.0.0 - Broadcast variable - What is ClassTag? Mon, 08 Aug, 07:05
Sumit Khanna hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 06:35
Chanh Le   Re: hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 06:41
Gourav Sengupta     Re: hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 06:46
Chanh Le       Re: hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 06:51
Gourav Sengupta         Re: hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 09:01
Devi P.V What are the configurations needs to connect spark and ms-sql server? Mon, 08 Aug, 07:44
Deepak Sharma   Re: What are the configurations needs to connect spark and ms-sql server? Mon, 08 Aug, 08:03
Pierre Villard Spark driver memory keeps growing Mon, 08 Aug, 08:17
Mich Talebzadeh why spark 2 shell console still sending warnings despite setting log4j.rootCategory=ERROR, console Mon, 08 Aug, 08:33
Mich Talebzadeh   Re: why spark 2 shell console still sending warnings despite setting log4j.rootCategory=ERROR, console Mon, 08 Aug, 09:28
MoTao how to generate a column using mapParition and then add it back to the df? Mon, 08 Aug, 09:00
ndj...@gmail.com   Re: how to generate a column using mapParition and then add it back to the df? Mon, 08 Aug, 09:16
莫涛     答复: how to generate a column using mapParition and then add it back to the df? Mon, 08 Aug, 09:44
ayan guha       Re: 答复: how to generate a column using mapParition and then add it back to the df? Mon, 08 Aug, 10:05
莫涛       答复: 答复: how to generate a column using mapParition and then add it back to the df? Tue, 09 Aug, 02:14
金国栋 Multiple Sources Found for Parquet Mon, 08 Aug, 09:34
Ted Yu   Re: Multiple Sources Found for Parquet Mon, 08 Aug, 10:38
Aseem Bansal     Re: Multiple Sources Found for Parquet Mon, 08 Aug, 11:35
Rohit Chaddha Machine learning question (suing spark)- removing redundant factors while doing clustering Mon, 08 Aug, 11:42
Tony Lane   Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Mon, 08 Aug, 14:01
Sivakumaran S     Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Mon, 08 Aug, 14:11
Tony Lane       Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Mon, 08 Aug, 15:10
Sean Owen         Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Mon, 08 Aug, 18:07
Rohit Chaddha           Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Tue, 09 Aug, 02:23
Peyman Mohajerian             Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Tue, 09 Aug, 03:19
Rohit Chaddha               Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Tue, 09 Aug, 05:02
Robin East               Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Tue, 09 Aug, 05:07
Sean Owen             Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Tue, 09 Aug, 07:25
Rohit Chaddha               Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Wed, 10 Aug, 11:46
Sean Owen                 Re: Machine learning question (suing spark)- removing redundant factors while doing clustering Wed, 10 Aug, 12:30
Mich Talebzadeh Spark 2 and existing code with sqlContext Mon, 08 Aug, 13:11
Jacek Laskowski   Re: Spark 2 and existing code with sqlContext Sat, 13 Aug, 04:01
Jacek Laskowski   Re: Spark 2 and existing code with sqlContext Sat, 13 Aug, 04:02
Koert Kuipers   Re: Spark 2 and existing code with sqlContext Sat, 13 Aug, 04:16
FW: Have I done everything correctly when subscribing to Spark User List
Chris Mattmann   FW: Have I done everything correctly when subscribing to Spark User List Mon, 08 Aug, 14:03
Sean Owen     Re: FW: Have I done everything correctly when subscribing to Spark User List Mon, 08 Aug, 18:10
Ovidiu-Cristian MARCU       Re: Have I done everything correctly when subscribing to Spark User List Mon, 08 Aug, 18:23
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Box list
Dec 202035
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137