spark-user mailing list archives: August 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Saif.A.Ell...@wellsfargo.com Applying a limit after orderBy of big dataframe hangs spark Fri, 05 Aug, 18:54
Bhupendra Mishra flume.thrift.queuesize Fri, 05 Aug, 19:25
Mike Metzger Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 19:26
Andy Grove Re: Java and SparkSession Fri, 05 Aug, 19:29
Mich Talebzadeh Re: Applying a limit after orderBy of big dataframe hangs spark Fri, 05 Aug, 19:33
Tony Lane Kmeans dataset initialization Fri, 05 Aug, 19:33
Jacek Laskowski Re: submitting spark job with kerberized Hadoop issue Fri, 05 Aug, 19:34
Mike Metzger Re: Generating unique id for a column in Row without breaking into RDD and joining back Fri, 05 Aug, 19:37
Jacek Laskowski Re: Spark 2.0.0 - Apply schema on few columns of dataset Fri, 05 Aug, 19:38
Saif.A.Ell...@wellsfargo.com RE: Applying a limit after orderBy of big dataframe hangs spark Fri, 05 Aug, 20:00
Andy Grove Re: [Spark 2.0] Error during codegen for Java POJO Fri, 05 Aug, 20:19
Koert Kuipers spark historyserver backwards compatible Fri, 05 Aug, 21:14
Marcelo Vanzin Re: spark historyserver backwards compatible Fri, 05 Aug, 21:21
Koert Kuipers Re: spark historyserver backwards compatible Fri, 05 Aug, 21:23
Kiran Chitturi 2.0.0: AnalysisException when reading csv/json files with dots in periods Sat, 06 Aug, 00:33
Kiran Chitturi 2.0.0: Hive metastore uses a different version of derby than the Spark package Sat, 06 Aug, 00:45
Kiran Chitturi Re: 2.0.0: AnalysisException when reading csv/json files with dots in periods Sat, 06 Aug, 00:49
Mohammed Guller RE: Explanation regarding Spark Streaming Sat, 06 Aug, 02:23
jackerli Re: mapWithState handle timeout Sat, 06 Aug, 07:57
李剑 mapWithState handle timeout Sat, 06 Aug, 08:00
Jacek Laskowski RE: Explanation regarding Spark Streaming Sat, 06 Aug, 08:53
Yann-Aël Le Borgne Re: Avoid Cartesian product in calculating a distance matrix? Sat, 06 Aug, 08:54
Sonal Goyal Re: Avoid Cartesian product in calculating a distance matrix? Sat, 06 Aug, 09:02
Aneela Saleem Re: submitting spark job with kerberized Hadoop issue Sat, 06 Aug, 09:03
Jacek Laskowski Re: submitting spark job with kerberized Hadoop issue Sat, 06 Aug, 10:00
Wojciech Pituła Re: submitting spark job with kerberized Hadoop issue Sat, 06 Aug, 13:29
Mich Talebzadeh Re: Explanation regarding Spark Streaming Sat, 06 Aug, 13:34
Amit Sela Dropping late date in Structured Streaming Sat, 06 Aug, 13:40
Tony Lane Re: Kmeans dataset initialization Sat, 06 Aug, 14:50
janardhan shetty Re: Symbol HasInputCol is inaccesible from this place Sat, 06 Aug, 16:49
Ted Yu Re: Symbol HasInputCol is inaccesible from this place Sat, 06 Aug, 17:07
Mohammed Guller RE: Explanation regarding Spark Streaming Sat, 06 Aug, 17:16
Luciano Resende Help testing the Spark Extensions for the Apache Bahir 2.0.0 release Sat, 06 Aug, 17:18
Deepak Sharma Long running tasks in stages Sat, 06 Aug, 17:31
janardhan shetty Re: Symbol HasInputCol is inaccesible from this place Sat, 06 Aug, 18:01
Mich Talebzadeh Re: Explanation regarding Spark Streaming Sat, 06 Aug, 19:24
Mohammed Guller RE: Explanation regarding Spark Streaming Sat, 06 Aug, 19:35
Mich Talebzadeh Re: Explanation regarding Spark Streaming Sat, 06 Aug, 19:51
Muthu Jayakumar Dataframe / Dataset partition size... Sat, 06 Aug, 19:56
Muhammad Haris Spark Application Counters Using Rest API Sat, 06 Aug, 20:44
Ted Yu Re: Symbol HasInputCol is inaccesible from this place Sat, 06 Aug, 20:56
Muthu Jayakumar Re: Dataframe / Dataset partition size... Sat, 06 Aug, 22:50
Matei Zaharia Re: Dropping late date in Structured Streaming Sun, 07 Aug, 01:55
Sumit Khanna spark df schema to hive schema converter func Sun, 07 Aug, 05:03
Sumit Khanna Re: spark df schema to hive schema converter func Sun, 07 Aug, 05:05
Sivakumaran S Re: Help testing the Spark Extensions for the Apache Bahir 2.0.0 release Sun, 07 Aug, 08:24
Luciano Resende Re: Help testing the Spark Extensions for the Apache Bahir 2.0.0 release Sun, 07 Aug, 10:33
Divya Gehlot [Spark1.6] Or (||) operator not working in DataFrame Sun, 07 Aug, 14:43
Ahmed El-Gamal Sorting a DStream and taking topN Sun, 07 Aug, 14:43
Ahmed El-Gamal Sorting a DStream and taking topN Sun, 07 Aug, 14:46
janardhan shetty Re: [Spark1.6] Or (||) operator not working in DataFrame Sun, 07 Aug, 15:40
Mich Talebzadeh Re: [Spark1.6] Or (||) operator not working in DataFrame Sun, 07 Aug, 15:53
Mich Talebzadeh Re: [Spark1.6] Or (||) operator not working in DataFrame Sun, 07 Aug, 15:58
Aneela Saleem Accessing HBase through Spark with Security enabled Sun, 07 Aug, 16:02
Aneela Saleem Re: submitting spark job with kerberized Hadoop issue Sun, 07 Aug, 16:05
Hao Ren [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Sun, 07 Aug, 21:31
Jestin Ma Using Kyro for DataFrames (Dataset<Row>)? Sun, 07 Aug, 22:31
Saisai Shao Re: submitting spark job with kerberized Hadoop issue Mon, 08 Aug, 01:55
Javier Rey Random forest binary classification H20 difference Spark Mon, 08 Aug, 02:51
Muthu Jayakumar Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 03:08
Chanh Le Re: [Spark1.6] Or (||) operator not working in DataFrame Mon, 08 Aug, 03:12
Divya Gehlot Re: [Spark1.6] Or (||) operator not working in DataFrame Mon, 08 Aug, 03:36
Sumit Khanna silence the spark debug logs Mon, 08 Aug, 04:09
Sachin Janani Re: silence the spark debug logs Mon, 08 Aug, 04:13
Ted Yu Re: submitting spark job with kerberized Hadoop issue Mon, 08 Aug, 04:34
Hemalatha A Any exceptions during an action doesn't fail the Spark streaming batch in yarn-client mode Mon, 08 Aug, 04:44
ayan guha Re: Any exceptions during an action doesn't fail the Spark streaming batch in yarn-client mode Mon, 08 Aug, 04:56
Aseem Bansal Re: Spark 2.0.0 - Apply schema on few columns of dataset Mon, 08 Aug, 05:10
Ewan Leith Re: Spark 2.0.0 - Apply schema on few columns of dataset Mon, 08 Aug, 05:56
rtijoriwala map vs mapPartitions Mon, 08 Aug, 06:20
danellis Is Spark right for my use case? Mon, 08 Aug, 06:22
Aneela Saleem Re: submitting spark job with kerberized Hadoop issue Mon, 08 Aug, 06:22
Aseem Bansal Spark 2.0.0 - Broadcast variable - What is ClassTag? Mon, 08 Aug, 06:32
Sumit Khanna hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 06:35
Aseem Bansal Re: Spark 2.0.0 - Apply schema on few columns of dataset Mon, 08 Aug, 06:37
Holden Karau Re: Spark 2.0.0 - Broadcast variable - What is ClassTag? Mon, 08 Aug, 06:39
Chanh Le Re: hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 06:41
Gourav Sengupta Re: hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 06:46
Chanh Le Re: hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 06:51
Aseem Bansal Re: Spark 2.0.0 - Broadcast variable - What is ClassTag? Mon, 08 Aug, 06:57
Holden Karau Re: Spark 2.0.0 - Broadcast variable - What is ClassTag? Mon, 08 Aug, 07:05
Mich Talebzadeh Re: [Spark1.6] Or (||) operator not working in DataFrame Mon, 08 Aug, 07:25
Deepak Sharma Re: Is Spark right for my use case? Mon, 08 Aug, 07:36
Devi P.V What are the configurations needs to connect spark and ms-sql server? Mon, 08 Aug, 07:44
Hao Ren Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 08:02
Deepak Sharma Re: What are the configurations needs to connect spark and ms-sql server? Mon, 08 Aug, 08:03
jackerli Re: mapWithState handle timeout Mon, 08 Aug, 08:13
Pierre Villard Spark driver memory keeps growing Mon, 08 Aug, 08:17
Mich Talebzadeh why spark 2 shell console still sending warnings despite setting log4j.rootCategory=ERROR, console Mon, 08 Aug, 08:33
MoTao how to generate a column using mapParition and then add it back to the df? Mon, 08 Aug, 09:00
Gourav Sengupta Re: hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 09:01
ndj...@gmail.com Re: how to generate a column using mapParition and then add it back to the df? Mon, 08 Aug, 09:16
Mich Talebzadeh Re: why spark 2 shell console still sending warnings despite setting log4j.rootCategory=ERROR, console Mon, 08 Aug, 09:28
金国栋 Multiple Sources Found for Parquet Mon, 08 Aug, 09:34
莫涛 答复: how to generate a column using mapParition and then add it back to the df? Mon, 08 Aug, 09:44
ayan guha Re: 答复: how to generate a column using mapParition and then add it back to the df? Mon, 08 Aug, 10:05
Ted Yu Re: Multiple Sources Found for Parquet Mon, 08 Aug, 10:38
Aseem Bansal Re: Multiple Sources Found for Parquet Mon, 08 Aug, 11:35
Rohit Chaddha Machine learning question (suing spark)- removing redundant factors while doing clustering Mon, 08 Aug, 11:42
Strange, Nick RE: Symbol HasInputCol is inaccesible from this place Mon, 08 Aug, 12:02
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
Jan 202198
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137