spark-user mailing list archives: November 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · Next »Thread · Author · Date
Kevin Jung spark code style Fri, 21 Nov, 09:20
Gerard Maas   Re: spark code style Fri, 21 Nov, 09:46
Is there a way to turn on spark eventLog on the worker node?
Xuelin Cao   Is there a way to turn on spark eventLog on the worker node? Fri, 21 Nov, 09:30
Xuelin Cao   Is there a way to turn on spark eventLog on the worker node? Tue, 25 Nov, 03:46
Marcelo Vanzin     Re: Is there a way to turn on spark eventLog on the worker node? Tue, 25 Nov, 04:13
Harihar Nahak     Re: Is there a way to turn on spark eventLog on the worker node? Tue, 25 Nov, 04:19
Daniel Haviv short-circuit local reads cannot be used Fri, 21 Nov, 09:47
Jianshi Huang How to deal with BigInt in my case class for RDD => SchemaRDD convertion Fri, 21 Nov, 10:11
Yin Huai   Re: How to deal with BigInt in my case class for RDD => SchemaRDD convertion Fri, 21 Nov, 15:30
Jianshi Huang     Re: How to deal with BigInt in my case class for RDD => SchemaRDD convertion Fri, 21 Nov, 23:56
rzykov Spark: Simple local test failed depending on memory settings Fri, 21 Nov, 10:25
Hao Ren EC2 cluster with SSD ebs Fri, 21 Nov, 10:30
Hao Ren   Re: EC2 cluster with SSD ebs Mon, 24 Nov, 12:39
EH Setup Remote HDFS for Spark Fri, 21 Nov, 14:28
Akhil Das   Re: Setup Remote HDFS for Spark Fri, 21 Nov, 14:40
EH     Re: Setup Remote HDFS for Spark Fri, 21 Nov, 15:13
Akhil Das       Re: Setup Remote HDFS for Spark Sat, 22 Nov, 08:41
Tobias Pfeiffer       Re: Setup Remote HDFS for Spark Tue, 25 Nov, 01:21
Naveen Kumar Pokala Execute Spark programs from local machine on Yarn-hadoop cluster Fri, 21 Nov, 14:39
Prannoy   Re: Execute Spark programs from local machine on Yarn-hadoop cluster Fri, 21 Nov, 15:10
Matt Narrell     Re: Execute Spark programs from local machine on Yarn-hadoop cluster Mon, 24 Nov, 01:50
Re: RDD data checkpoint cleaning
Luis Ángel Vicente Sánchez   Re: RDD data checkpoint cleaning Fri, 21 Nov, 15:17
Luis Ángel Vicente Sánchez     Re: RDD data checkpoint cleaning Fri, 28 Nov, 10:31
YaoPau Error: Unrecognized option '--conf' (trying to set auto.offset.reset) Fri, 21 Nov, 15:58
Akhil Das   Re: Error: Unrecognized option '--conf' (trying to set auto.offset.reset) Sat, 22 Nov, 08:53
Sean Owen   Re: Error: Unrecognized option '--conf' (trying to set auto.offset.reset) Sat, 22 Nov, 22:17
Pat Ferrel Lots of small input files Fri, 21 Nov, 16:19
Akhil Das   Re: Lots of small input files Sat, 22 Nov, 09:17
Shixiong Zhu     Re: Lots of small input files Mon, 24 Nov, 02:33
Re: driver memory
Gen   Re: driver memory Fri, 21 Nov, 16:52
pthai JVM Memory Woes Fri, 21 Nov, 17:44
Peter Thai   Re: JVM Memory Woes Fri, 21 Nov, 19:09
Brett Meyer Many retries for Python job Fri, 21 Nov, 17:47
Sandy Ryza   Re: Many retries for Python job Fri, 21 Nov, 18:41
Brett Meyer     Re: Many retries for Python job Fri, 21 Nov, 19:24
Sadhan Sood SparkSQL - can we add new column(s) to parquet files Fri, 21 Nov, 18:03
Evan Chan   Re: SparkSQL - can we add new column(s) to parquet files Fri, 21 Nov, 22:51
whitebread SparkSQL Timestamp query failure Fri, 21 Nov, 18:39
Akhil Das   Re: SparkSQL Timestamp query failure Sat, 22 Nov, 09:32
whitebread     Re: SparkSQL Timestamp query failure Sat, 22 Nov, 16:10
Wang, Daoyuan       RE: SparkSQL Timestamp query failure Mon, 24 Nov, 02:10
Alessandro Panebianco         Re: SparkSQL Timestamp query failure Mon, 24 Nov, 03:12
Cheng, Hao           RE: SparkSQL Timestamp query failure Mon, 24 Nov, 05:09
whitebread             Re: SparkSQL Timestamp query failure Mon, 24 Nov, 05:41
Sameer Tilak MLLib: LinearRegressionWithSGD performance Fri, 21 Nov, 19:18
Jayant Shekhar   Re: MLLib: LinearRegressionWithSGD performance Fri, 21 Nov, 20:02
Jayant Shekhar     Re: MLLib: LinearRegressionWithSGD performance Fri, 21 Nov, 20:12
Yanbo   Re: MLLib: LinearRegressionWithSGD performance Mon, 24 Nov, 15:57
Alaa Ali Spark SQL with Apache Phoenix lower and upper Bound Fri, 21 Nov, 21:14
Josh Mahonin   Re: Spark SQL with Apache Phoenix lower and upper Bound Fri, 21 Nov, 21:34
Alaa Ali     Re: Spark SQL with Apache Phoenix lower and upper Bound Fri, 21 Nov, 22:12
Josh Mahonin       Re: Spark SQL with Apache Phoenix lower and upper Bound Mon, 24 Nov, 14:31
Alex Kamil     Re: Spark SQL with Apache Phoenix lower and upper Bound Fri, 21 Nov, 22:26
Alaa Ali       Re: Spark SQL with Apache Phoenix lower and upper Bound Sat, 22 Nov, 16:25
Andreas Koch Running Spark application from Tomcat Fri, 21 Nov, 22:09
Joanne Contact Persist kafka streams to text file Fri, 21 Nov, 22:32
Joanne Contact Persist kafka streams to text file, tachyon error? Fri, 21 Nov, 22:48
Haoyuan Li   Re: Persist kafka streams to text file, tachyon error? Sun, 23 Nov, 06:35
Emaasit Book: Data Analysis with SparkR Fri, 21 Nov, 23:48
Zongheng Yang   Re: Book: Data Analysis with SparkR Fri, 21 Nov, 23:57
YaoPau Missing parents for stage (Spark Streaming) Fri, 21 Nov, 23:57
Sean Owen   Re: Missing parents for stage (Spark Streaming) Sat, 22 Nov, 17:01
tridib allocating different memory to different executor for same application Sat, 22 Nov, 01:34
tridib spark-sql broken Sat, 22 Nov, 02:39
Cheng Lian   Re: spark-sql broken Sat, 22 Nov, 11:25
Judy Nash latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Sat, 22 Nov, 03:05
Cheng Lian   Re: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Sat, 22 Nov, 04:02
Judy Nash     RE: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Mon, 24 Nov, 22:25
Cheng Lian       Re: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Tue, 25 Nov, 04:23
Judy Nash         RE: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Tue, 25 Nov, 07:49
Judy Nash           RE: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Tue, 25 Nov, 08:25
Cheng Lian             Re: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Tue, 25 Nov, 09:50
Judy Nash               RE: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Wed, 26 Nov, 01:41
Denny Lee                 Re: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Wed, 26 Nov, 01:46
Judy Nash                   RE: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Wed, 26 Nov, 06:45
Patrick Wendell                     Re: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Wed, 26 Nov, 16:08
Patrick Wendell                       Re: latest Spark 1.2 thrift server fail with NoClassDefFoundError on Guava Wed, 26 Nov, 16:16
pankaj channe Spark streaming job failing after some time. Sat, 22 Nov, 03:09
Akhil Das   Re: Spark streaming job failing after some time. Sat, 22 Nov, 09:38
Sean Owen     Re: Spark streaming job failing after some time. Sat, 22 Nov, 17:00
pankaj channe       Re: Spark streaming job failing after some time. Sat, 22 Nov, 17:05
pankaj channe         Re: Spark streaming job failing after some time. Mon, 24 Nov, 18:51
Guillermo Ortiz Spark or MR, Scala or Java? Sat, 22 Nov, 15:34
Ashic Mahtab   RE: Spark or MR, Scala or Java? Sat, 22 Nov, 16:05
Denny Lee   Re: Spark or MR, Scala or Java? Sat, 22 Nov, 16:15
Sean Owen   Re: Spark or MR, Scala or Java? Sat, 22 Nov, 16:26
Krishna Sankar     Re: Spark or MR, Scala or Java? Sun, 23 Nov, 00:53
Sanjay Subramanian       Re: Spark or MR, Scala or Java? Sun, 23 Nov, 16:35
Ashish Rangole         Re: Spark or MR, Scala or Java? Sun, 23 Nov, 19:03
Ognen Duzlevski           Re: Spark or MR, Scala or Java? Sun, 23 Nov, 19:44
Krishna Sankar             Re: Spark or MR, Scala or Java? Mon, 24 Nov, 03:16
Krishna Sankar               Re: Spark or MR, Scala or Java? Mon, 24 Nov, 03:16
Sanjay Subramanian           Re: Spark or MR, Scala or Java? Mon, 24 Nov, 05:39
Soumya Simanta     Re: Spark or MR, Scala or Java? Sun, 23 Nov, 02:42
vdiwakar.malladi Getting exception on JavaSchemaRDD; org.apache.spark.SparkException: Task not serializable Sat, 22 Nov, 16:32
Akhil Das   Re: Getting exception on JavaSchemaRDD; org.apache.spark.SparkException: Task not serializable Sat, 22 Nov, 17:05
vdiwakar.malladi     Re: Getting exception on JavaSchemaRDD; org.apache.spark.SparkException: Task not serializable Sat, 22 Nov, 17:23
Sean Owen       Re: Getting exception on JavaSchemaRDD; org.apache.spark.SparkException: Task not serializable Sat, 22 Nov, 18:11
vdiwakar.malladi         Re: Getting exception on JavaSchemaRDD; org.apache.spark.SparkException: Task not serializable Sat, 22 Nov, 19:08
insperatum RDD with object shared across elements within a partition. Magic number 200? Sat, 22 Nov, 16:56
insperatum   Re: RDD with object shared across elements within a partition. Magic number 200? Sat, 22 Nov, 23:51
Bill Jay Error when Spark streaming consumes from Kafka Sat, 22 Nov, 20:43
Dibyendu Bhattacharya   Re: Error when Spark streaming consumes from Kafka Sun, 23 Nov, 05:15
Bill Jay     Re: Error when Spark streaming consumes from Kafka Sun, 23 Nov, 21:02
Slim Baltagi SparkBigData.com: The Apache Spark Knowledge Base Sat, 22 Nov, 20:51
riginos Spark SQL Programming Guide - registerTempTable Error Sun, 23 Nov, 18:59
Denny Lee   Re: Spark SQL Programming Guide - registerTempTable Error Sun, 23 Nov, 19:08
riginos     Re: Spark SQL Programming Guide - registerTempTable Error Sun, 23 Nov, 19:27
Denny Lee       Re: Spark SQL Programming Guide - registerTempTable Error Sun, 23 Nov, 19:49
riginos         Re: Spark SQL Programming Guide - registerTempTable Error Mon, 24 Nov, 11:33
Rishi Yadav           Re: Spark SQL Programming Guide - registerTempTable Error Mon, 24 Nov, 14:57
Venkat, Ankam Spark Streaming with Python Sun, 23 Nov, 19:04
Venkat, Ankam   RE: Spark Streaming with Python Tue, 25 Nov, 15:23
Nicholas Chammas     Re: Spark Streaming with Python Thu, 27 Nov, 06:06
Venkat, Ankam Python Logistic Regression error Sun, 23 Nov, 19:38
Xiangrui Meng   Re: Python Logistic Regression error Mon, 24 Nov, 19:09
Daniel Haviv Converting a column to a map Sun, 23 Nov, 20:01
Yanbo   Re: Converting a column to a map Mon, 24 Nov, 15:31
Alaa Ali Creating a front-end for output from Spark/PySpark Sun, 23 Nov, 20:37
Alex Kamil   Re: Creating a front-end for output from Spark/PySpark Sun, 23 Nov, 21:06
Mohammed Guller   RE: Creating a front-end for output from Spark/PySpark Wed, 26 Nov, 01:05
critikaled How to insert complex types like map<string,map<string,int>> in spark sql Sun, 23 Nov, 23:00
Michael Armbrust   Re: How to insert complex types like map<string,map<string,int>> in spark sql Mon, 24 Nov, 21:33
critikaled     Re: How to insert complex types like map<string,map<string,int>> in spark sql Tue, 25 Nov, 07:42
critikaled       Re: How to insert complex types like map<string,map<string,int>> in spark sql Tue, 25 Nov, 08:04
Cheng Lian         Re: How to insert complex types like map<string,map<string,int>> in spark sql Tue, 25 Nov, 09:37
Takuya UESHIN           Re: How to insert complex types like map<string,map<string,int>> in spark sql Wed, 26 Nov, 17:35
Cheng Lian             Re: How to insert complex types like map<string,map<string,int>> in spark sql Thu, 27 Nov, 04:51
critikaled       Re: How to insert complex types like map<string,map<string,int>> in spark sql Tue, 25 Nov, 08:28
zh8788 How to keep a local variable in each cluster? Mon, 24 Nov, 01:41
Yanbo   Re: How to keep a local variable in each cluster? Mon, 24 Nov, 16:17
zh8788     Re: How to keep a local variable in each cluster? Tue, 25 Nov, 16:41
Simon Hafner wholeTextFiles on 20 nodes Mon, 24 Nov, 02:10
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · Next »Thread · Author · Date
Box list
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137