spark-user mailing list archives: November 2016

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
lxw SparkSQL with Hive got "java.lang.NullPointerException" Thu, 03 Nov, 10:20
余根茂(木艮) 回复:Structured Streaming with Kafka source,, does it work?????? Mon, 07 Nov, 03:08
涂小刚 Why active tasks is bigger than cores? Tue, 08 Nov, 07:14
颜发才(Yan Facai) Addition of two SparseVector Tue, 01 Nov, 08:04
颜发才(Yan Facai) How to return a case class in map function? Wed, 02 Nov, 07:01
颜发才(Yan Facai) Re: How to return a case class in map function? Thu, 03 Nov, 10:22
颜发才(Yan Facai) Re: How to return a case class in map function? Thu, 03 Nov, 10:51
颜发才(Yan Facai) Vector is not found in case class after import Fri, 04 Nov, 08:43
颜发才(Yan Facai) Re: Spark joins using row id Sun, 13 Nov, 10:51
颜发才(Yan Facai) Best practice for preprocessing feature with DataFrame Thu, 17 Nov, 04:08
颜发才(Yan Facai) Re: Best practice for preprocessing feature with DataFrame Thu, 17 Nov, 09:37
颜发才(Yan Facai) Re: Best practice for preprocessing feature with DataFrame Wed, 23 Nov, 04:09
Kürşat Kurt RE: Out Of Memory issue Tue, 01 Nov, 04:20
Kürşat Kurt RE: Out of memory at 60GB free memory. Mon, 07 Nov, 07:57
Kürşat Kurt RE: Out of memory at 60GB free memory. Mon, 07 Nov, 11:51
Kürşat Kurt RE: Out of memory at 60GB free memory. Mon, 07 Nov, 18:37
Jörn Franke Re: Possible DR solution Sat, 12 Nov, 11:17
Shashikant Kulkarni (शशिकांत कुलकर्णी) unsubscribe Fri, 04 Nov, 02:08
Andrés Ivaldi Aggregation Calculation Thu, 03 Nov, 18:29
Andrés Ivaldi Re: Aggregation Calculation Thu, 03 Nov, 20:17
Andrés Ivaldi Re: Aggregation Calculation Fri, 04 Nov, 13:23
Andrés Ivaldi DataSet toJson Tue, 08 Nov, 13:06
Andrés Ivaldi Re: DataSet toJson Tue, 08 Nov, 13:40
Andrés Ivaldi Grouping Set Mon, 14 Nov, 15:20
Andrés Ivaldi Re: Grouping Set Thu, 17 Nov, 17:05
Jorge Sánchez Re: how to merge dataframe write output files Fri, 11 Nov, 07:45
Kristoffer Sjögren DataFrame select non-existing column Fri, 18 Nov, 14:32
Kristoffer Sjögren Re: DataFrame select non-existing column Fri, 18 Nov, 19:18
Kristoffer Sjögren Re: DataFrame select non-existing column Sat, 19 Nov, 14:56
Kristoffer Sjögren Re: DataFrame select non-existing column Sun, 20 Nov, 14:13
Mikael Ståldal Load whole ALS MatrixFactorizationModel into memory Wed, 02 Nov, 16:53
Mikael Ståldal WARN 1 block locks were not released with MLlib ALS Fri, 04 Nov, 13:09
Zsolt Tóth Delegation Token renewal in yarn-cluster Thu, 03 Nov, 14:22
Zsolt Tóth Re: Delegation Token renewal in yarn-cluster Thu, 03 Nov, 20:29
Zsolt Tóth Re: Delegation Token renewal in yarn-cluster Thu, 03 Nov, 21:02
Zsolt Tóth Re: Delegation Token renewal in yarn-cluster Thu, 03 Nov, 22:47
Zsolt Tóth Re: Delegation Token renewal in yarn-cluster Fri, 04 Nov, 08:57
Zsolt Tóth Map and MapParitions with partition-local variable Wed, 16 Nov, 11:59
Zsolt Tóth Map and MapParitions with partition-local variable Thu, 17 Nov, 20:57
母延年(YDB技术支持) why visitCreateFileFormat doesn`t support hive STORED BY ,just support store as Sat, 05 Nov, 12:27
Kürşat Kurt Out of memory at 60GB free memory. Mon, 07 Nov, 05:32
Kürşat Kurt java.lang.OutOfMemoryError: Java heap space Sat, 19 Nov, 00:47
吴 郎 Re: GraphX Pregel not update vertex state properly, cause messages loss Thu, 24 Nov, 15:04
谭 成灶 multiple Spark Thrift Servers running in the same machine throws org.apache.hadoop.security.AccessControlException Thu, 24 Nov, 14:27
Kürşat Kurt RE: Out Of Memory issue Tue, 01 Nov, 06:24
Kürşat Kurt RE: Out Of Memory issue Fri, 04 Nov, 22:17
Kürşat Kurt RE: java.lang.OutOfMemoryError: Java heap space Sun, 20 Nov, 23:30
wyj Streaming performance would be better with input than without Tue, 01 Nov, 09:32
Jörn Franke Re: importing data into hdfs/spark using Informatica ETL tool Wed, 09 Nov, 21:26
Jörn Franke Re: Joining to a large, pre-sorted file Fri, 11 Nov, 01:33
Jörn Franke Re: AVRO File size when caching in-memory Mon, 14 Nov, 09:36
Jörn Franke Re: Handling windows characters with Spark CSV on Linux Thu, 17 Nov, 13:20
Jörn Franke Re: How to write a custom file system? Mon, 21 Nov, 17:49
Jörn Franke Re: RDD Partitions on HDFS file in Hive on Spark Query Mon, 21 Nov, 22:59
Jörn Franke Re: Apache Spark SQL is taking forever to count billion rows from Cassandra? Thu, 24 Nov, 21:44
Aakash Basu Join Query Thu, 17 Nov, 09:47
Aakash Basu HDPCD SPARK Certification Queries Thu, 17 Nov, 10:11
Abhishek Anand Insert a JavaPairDStream into multiple cassandra table on the basis of key. Thu, 03 Nov, 06:28
Adam Smith HPC with Spark? Simultaneous, parallel one to one mapping of partition to vcore Sun, 20 Nov, 00:44
Aditya Unsubscribe Wed, 30 Nov, 08:21
Ajay Chander Access_Remote_Kerberized_Cluster_Through_Spark Mon, 07 Nov, 21:37
Ajay Chander Re: Access_Remote_Kerberized_Cluster_Through_Spark Tue, 08 Nov, 02:42
Ajay Chander Re: Access_Remote_Kerberized_Cluster_Through_Spark Thu, 10 Nov, 01:44
Aleksander Eskilson [SQL/Catalyst] Janino Generated Code Debugging Wed, 16 Nov, 18:59
Alexis Seigneurin Application remains in WAITING state after Master election Tue, 01 Nov, 15:46
Alexis Seigneurin Re: Long-running job OOMs driver process Fri, 18 Nov, 02:50
Alexis Seigneurin Re: Long-running job OOMs driver process Fri, 18 Nov, 15:17
Amit Sela Fault-tolerant Accumulators in stateful operators. Tue, 22 Nov, 20:49
Amit Sela Does MapWithState follow with a shuffle ? Tue, 29 Nov, 21:16
Amit Sela Fault-tolerant Accumulators in a DStream-only transformations. Tue, 29 Nov, 22:42
Anastasios Zouzias Re: Apache Spark SQL is taking forever to count billion rows from Cassandra? Thu, 24 Nov, 08:48
Anastasios Zouzias Re: Apache Spark or Spark-Cassandra-Connector doesnt look like it is reading multiple partitions in parallel. Sat, 26 Nov, 18:09
Andrew Holway Python - Spark Cassandra Connector on DC/OS Tue, 01 Nov, 09:04
Andrew Holway Re: Python - Spark Cassandra Connector on DC/OS Tue, 01 Nov, 09:32
Andrew Holway Re: sanboxing spark executors Fri, 04 Nov, 13:31
Andrew Holway Live data visualisations with Spark Tue, 08 Nov, 16:13
Andrew Holway Re: Save a spark RDD to disk Tue, 08 Nov, 22:14
Andrew Holway javac - No such file or directory Wed, 09 Nov, 13:43
Andrew Holway createDataFrame causing a strange error. Sun, 27 Nov, 19:32
Andrew Holway Re: createDataFrame causing a strange error. Sun, 27 Nov, 19:33
Andrew Holway Re: createDataFrame causing a strange error. Mon, 28 Nov, 14:48
Andrew Holway Re: createDataFrame causing a strange error. Tue, 29 Nov, 14:53
Andrew Holway python environments with "local" and "yarn-client" - Boto failing on HDP2.5 Tue, 29 Nov, 15:08
Aniket Bhatnagar RuntimeException: Null value appeared in non-nullable field when holding Optional Case Class Wed, 02 Nov, 21:12
Aniket Bhatnagar Re: RuntimeException: Null value appeared in non-nullable field when holding Optional Case Class Thu, 03 Nov, 21:52
Aniket Bhatnagar Improvement proposal | Dynamic disk allocation Sun, 06 Nov, 13:06
Aniket Bhatnagar Re: Improvement proposal | Dynamic disk allocation Sun, 06 Nov, 13:13
Aniket Bhatnagar Re: Very long pause/hang at end of execution Sun, 06 Nov, 13:36
Aniket Bhatnagar Re: Very long pause/hang at end of execution Sun, 06 Nov, 15:02
Aniket Bhatnagar Dataset API | Setting number of partitions during join/groupBy Fri, 11 Nov, 17:22
Aniket Bhatnagar Re: Dataset API | Setting number of partitions during join/groupBy Fri, 11 Nov, 18:35
Aniket Bhatnagar Re: Very long pause/hang at end of execution Wed, 16 Nov, 10:44
Aniket Bhatnagar Re: Very long pause/hang at end of execution Wed, 16 Nov, 10:48
Aniket Bhatnagar Re: RDD Partitions on HDFS file in Hive on Spark Query Mon, 21 Nov, 22:44
Aniket Bhatnagar OS killing Executor due to high (possibly off heap) memory usage Thu, 24 Nov, 16:16
Aniket Bhatnagar Re: OS killing Executor due to high (possibly off heap) memory usage Fri, 25 Nov, 17:14
Anil Langote DataSet is not able to handle 50,000 columns to sum Fri, 11 Nov, 17:57
Anil Langote Re: DataSet is not able to handle 50,000 columns to sum Sat, 12 Nov, 03:33
Anirudh Perugu toDebugString is clipped Sun, 13 Nov, 01:56
Anjali Gautam Issue in application deployment on spark cluster Fri, 18 Nov, 15:16
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Box list
Sep 2019137
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137