spark-user mailing list archives: June 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
ram kumar spark streaming - checkpoint Fri, 26 Jun, 13:05
Tathagata Das   Re: spark streaming - checkpoint Sat, 27 Jun, 07:37
ram kumar     Re: spark streaming - checkpoint Mon, 29 Jun, 06:37
ram kumar       Re: spark streaming - checkpoint Mon, 29 Jun, 07:54
Caio Cesar Trucolo Time series data Fri, 26 Jun, 13:07
tog   Re: Time series data Mon, 29 Jun, 09:22
RedOakMark Spark 1.4.0 - Using SparkR on EC2 Instance Fri, 26 Jun, 13:27
Shivaram Venkataraman   Re: Spark 1.4.0 - Using SparkR on EC2 Instance Fri, 26 Jun, 16:46
Mark Stephenson     Re: Spark 1.4.0 - Using SparkR on EC2 Instance Fri, 26 Jun, 16:59
Shivaram Venkataraman       Re: Spark 1.4.0 - Using SparkR on EC2 Instance Fri, 26 Jun, 17:13
m...@redoakstrategic.com         Re: Spark 1.4.0 - Using SparkR on EC2 Instance Fri, 26 Jun, 17:21
Shivaram Venkataraman           Re: Spark 1.4.0 - Using SparkR on EC2 Instance Sat, 27 Jun, 00:04
Shivaram Venkataraman             Re: Spark 1.4.0 - Using SparkR on EC2 Instance Tue, 30 Jun, 15:56
Shivaram Venkataraman               Re: Spark 1.4.0 - Using SparkR on EC2 Instance Tue, 30 Jun, 20:53
RedOakMark   Re: Spark 1.4.0 - Using SparkR on EC2 Instance Sat, 27 Jun, 19:23
Shivaram Venkataraman     Re: Spark 1.4.0 - Using SparkR on EC2 Instance Sat, 27 Jun, 23:56
Amit Assudani How to recover in case user errors in streaming Fri, 26 Jun, 14:05
Cody Koeninger   Re: How to recover in case user errors in streaming Fri, 26 Jun, 15:16
Amit Assudani     Re: How to recover in case user errors in streaming Fri, 26 Jun, 15:21
Cody Koeninger       Re: How to recover in case user errors in streaming Fri, 26 Jun, 15:27
Amit Assudani       Re: How to recover in case user errors in streaming Fri, 26 Jun, 15:28
Cody Koeninger         Re: How to recover in case user errors in streaming Fri, 26 Jun, 15:32
Amit Assudani           Re: How to recover in case user errors in streaming Fri, 26 Jun, 15:41
Amit Assudani             Re: How to recover in case user errors in streaming Fri, 26 Jun, 16:56
Tathagata Das               Re: How to recover in case user errors in streaming Sat, 27 Jun, 09:14
Amit Assudani                 Re: How to recover in case user errors in streaming Mon, 29 Jun, 13:55
Amit Assudani                   Re: How to recover in case user errors in streaming Mon, 29 Jun, 15:44
Tathagata Das                     Re: How to recover in case user errors in streaming Mon, 29 Jun, 21:24
Sea                       回复: How to recover in case user errors in streaming Tue, 30 Jun, 02:23
Tathagata Das                         Re: How to recover in case user errors in streaming Tue, 30 Jun, 20:34
Re: Master dies after program finishes normally
Yifan LI   Re: Master dies after program finishes normally Fri, 26 Jun, 14:22
Akhil Das     Re: Master dies after program finishes normally Mon, 29 Jun, 06:40
Re: hadoop input/output format advanced control
ÐΞ...@Ҝ (๏̯͡๏)   Re: hadoop input/output format advanced control Fri, 26 Jun, 14:37
Re: Kryo serialization of classes in additional jars
patcharee   Re: Kryo serialization of classes in additional jars Fri, 26 Jun, 15:35
Dave Ariens Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 15:49
Timothy Chen   Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 16:49
Dave Ariens     RE: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 19:16
Olivier Girardot       Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 19:23
Tim Chen         Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 20:13
Marcelo Vanzin           Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 20:20
Tim Chen             Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 21:08
Marcelo Vanzin               Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 21:28
Dave Ariens                 Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 22:09
Marcelo Vanzin                   Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 22:20
Dave Ariens                     Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 22:44
Marcelo Vanzin                       Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 22:51
Tim Chen                         Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Sat, 27 Jun, 06:56
Steve Loughran                           Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Sun, 28 Jun, 14:34
Dave Ariens                             RE: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Mon, 29 Jun, 13:18
Steve Loughran                               Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Mon, 29 Jun, 14:32
Dave Ariens                                 RE: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Mon, 29 Jun, 14:38
Iulian Dragoș                       Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Sun, 28 Jun, 12:12
Dave Ariens           Re: Accessing Kerberos Secured HDFS Resources from Spark on Mesos Fri, 26 Jun, 20:55
Bahubali Jain Multiple dir support : newApiHadoopFile Fri, 26 Jun, 16:43
Ted Yu   Re: Multiple dir support : newApiHadoopFile Fri, 26 Jun, 16:54
Eugen Cepoi     Re: Multiple dir support : newApiHadoopFile Fri, 26 Jun, 16:56
Eugen Cepoi       Re: Multiple dir support : newApiHadoopFile Fri, 26 Jun, 16:56
igor.berman spilling in-memory map of 5.1 MB to disk (272 times so far) Fri, 26 Jun, 17:07
Akhil Das   Re: spilling in-memory map of 5.1 MB to disk (272 times so far) Mon, 29 Jun, 06:46
Re: Unable to specify multiple directories as input
ÐΞ...@Ҝ (๏̯͡๏)   Re: Unable to specify multiple directories as input Fri, 26 Jun, 17:18
Kumaran Mani Spark SQL - Setting YARN Classpath for primordial class loader Fri, 26 Jun, 17:29
Tarun Garg YARN worker out of disk memory Fri, 26 Jun, 17:41
Rex X HOw to concatenate two csv files into one RDD? Fri, 26 Jun, 18:00
Sujit Pal   Re: HOw to concatenate two csv files into one RDD? Fri, 26 Jun, 23:28
Wang, Ningjun (LNG-NPV) Cannot iterate items in rdd.mapPartition() Fri, 26 Jun, 18:52
Mark Hamstra   Re: Cannot iterate items in rdd.mapPartition() Fri, 26 Jun, 19:03
Ashish Nigam spark streaming job fails to restart after checkpointing due to DStream initialization errors Fri, 26 Jun, 20:45
Cody Koeninger   Re: spark streaming job fails to restart after checkpointing due to DStream initialization errors Fri, 26 Jun, 21:05
Ashish Nigam     Re: spark streaming job fails to restart after checkpointing due to DStream initialization errors Fri, 26 Jun, 21:45
Tathagata Das       Re: spark streaming job fails to restart after checkpointing due to DStream initialization errors Sat, 27 Jun, 07:41
Manoj Samel Spark 1.4 - memory bloat in group by/aggregate??? Fri, 26 Jun, 21:13
ÐΞ...@Ҝ (๏̯͡๏) Unable to start Pi (hello world) application on Spark 1.4 Fri, 26 Jun, 21:27
ÐΞ...@Ҝ (๏̯͡๏)   Re: Unable to start Pi (hello world) application on Spark 1.4 Sun, 28 Jun, 19:55
ÐΞ...@Ҝ (๏̯͡๏)     Re: Unable to start Pi (hello world) application on Spark 1.4 Mon, 29 Jun, 03:43
dataframe left joins are not working as expected in pyspark
Axel Dahl   dataframe left joins are not working as expected in pyspark Sat, 27 Jun, 03:00
ayan guha     Re: dataframe left joins are not working as expected in pyspark Sat, 27 Jun, 04:51
Axel Dahl       Re: dataframe left joins are not working as expected in pyspark Sat, 27 Jun, 06:49
Nicholas Chammas         Re: dataframe left joins are not working as expected in pyspark Sat, 27 Jun, 16:09
Axel Dahl           Re: dataframe left joins are not working as expected in pyspark Sat, 27 Jun, 16:28
Nicholas Chammas             Re: dataframe left joins are not working as expected in pyspark Sat, 27 Jun, 18:29
Yin Huai               Re: dataframe left joins are not working as expected in pyspark Sat, 27 Jun, 20:56
Axel Dahl                 Re: dataframe left joins are not working as expected in pyspark Sun, 28 Jun, 03:11
Guillermo Ortiz Uncaught exception in thread delete Spark local dirs Sat, 27 Jun, 07:35
Tathagata Das   Re: Uncaught exception in thread delete Spark local dirs Sat, 27 Jun, 07:39
Guillermo Ortiz     Re: Uncaught exception in thread delete Spark local dirs Sat, 27 Jun, 08:00
Tathagata Das       Re: Uncaught exception in thread delete Spark local dirs Sat, 27 Jun, 09:21
Guillermo Ortiz         Re: Uncaught exception in thread delete Spark local dirs Sat, 27 Jun, 09:25
Guillermo Ortiz           Re: Uncaught exception in thread delete Spark local dirs Sat, 27 Jun, 09:32
Tathagata Das             Re: Uncaught exception in thread delete Spark local dirs Sat, 27 Jun, 09:36
Guillermo Ortiz               Re: Uncaught exception in thread delete Spark local dirs Sat, 27 Jun, 10:02
Sea               回复: Uncaught exception in thread delete Spark local dirs Sat, 27 Jun, 14:34
Ted Yu             Re: Uncaught exception in thread delete Spark local dirs Sat, 27 Jun, 13:26
Bahubali Jain JavaRDD and saveAsNewAPIHadoopFile() Sat, 27 Jun, 10:42
Ted Yu   Re: JavaRDD and saveAsNewAPIHadoopFile() Sat, 27 Jun, 13:59
Evo Eftimov R "on spark" Sat, 27 Jun, 11:33
wasauce How to timeout a task? Sat, 27 Jun, 15:33
Ted Yu   Re: How to timeout a task? Sat, 27 Jun, 16:26
Pat Ferrel rdd.saveAsSequenceFile(path) Sat, 27 Jun, 21:46
Ashish Soni Spark-Submit / Spark-Shell Error Standalone cluster Sun, 28 Jun, 02:53
Wojciech Pituła   Re: Spark-Submit / Spark-Shell Error Standalone cluster Sun, 28 Jun, 07:19
Tomas Hudik     Re: Spark-Submit / Spark-Shell Error Standalone cluster Sun, 28 Jun, 12:53
Ashish Soni       Re: Spark-Submit / Spark-Shell Error Standalone cluster Sun, 28 Jun, 14:40
Tomas Hudik         Re: Spark-Submit / Spark-Shell Error Standalone cluster Mon, 29 Jun, 07:02
Ashish Soni           Re: Spark-Submit / Spark-Shell Error Standalone cluster Mon, 29 Jun, 12:57
郭谦 problem for submitting job Sun, 28 Jun, 07:56
Akhil Das   Re: problem for submitting job Mon, 29 Jun, 07:24
Akhil Das     Re: problem for submitting job Mon, 29 Jun, 16:05
Arthur Chan required: org.apache.spark.streaming.dstream.DStream[org.apache.spark.mllib.linalg.Vector] Sun, 28 Jun, 12:49
Ted Yu   Re: required: org.apache.spark.streaming.dstream.DStream[org.apache.spark.mllib.linalg.Vector] Sun, 28 Jun, 14:53
Arthur Chan     Re: required: org.apache.spark.streaming.dstream.DStream[org.apache.spark.mllib.linalg.Vector] Mon, 29 Jun, 01:02
Arthur Chan       Re: required: org.apache.spark.streaming.dstream.DStream[org.apache.spark.mllib.linalg.Vector] Mon, 29 Jun, 01:03
Feynman Liang         Re: required: org.apache.spark.streaming.dstream.DStream[org.apache.spark.mllib.linalg.Vector] Mon, 29 Jun, 01:16
YaoPau What does "Spark is not just MapReduce" mean? Isn't every Spark job a form of MapReduce? Sun, 28 Jun, 16:13
Ashic Mahtab   RE: What does "Spark is not just MapReduce" mean? Isn't every Spark job a form of MapReduce? Sun, 28 Jun, 16:51
prajod.vettiyat...@wipro.com     RE: What does "Spark is not just MapReduce" mean? Isn't every Spark job a form of MapReduce? Mon, 29 Jun, 12:58
Michael Malak   RE: What does "Spark is not just MapReduce" mean? Isn't every Spark job a form of MapReduce? Sun, 28 Jun, 18:50
Koert Kuipers   Re: What does "Spark is not just MapReduce" mean? Isn't every Spark job a form of MapReduce? Sun, 28 Jun, 20:44
Stephen Boesch     Re: What does "Spark is not just MapReduce" mean? Isn't every Spark job a form of MapReduce? Sun, 28 Jun, 21:23
Mario Pastorelli Use logback instead of log4j in a Spark job Sun, 28 Jun, 17:10
hishamm spark-submit in deployment mode with the "--jars" option Sun, 28 Jun, 17:44
Hisham Mohamed   RE: spark-submit in deployment mode with the "--jars" option Mon, 29 Jun, 11:59
ÐΞ...@Ҝ (๏̯͡๏) Share your cluster & run details Sun, 28 Jun, 18:59
ÐΞ...@Ҝ (๏̯͡๏) Fine control with sc.sequenceFile Mon, 29 Jun, 04:23
Ted Yu   Re: Fine control with sc.sequenceFile Mon, 29 Jun, 04:32
ÐΞ...@Ҝ (๏̯͡๏)     Re: Fine control with sc.sequenceFile Mon, 29 Jun, 04:34
Ted Yu       Re: Fine control with sc.sequenceFile Mon, 29 Jun, 04:46
ÐΞ...@Ҝ (๏̯͡๏)         Re: Fine control with sc.sequenceFile Mon, 29 Jun, 04:48
Koert Kuipers           Re: Fine control with sc.sequenceFile Mon, 29 Jun, 14:02
V Dineshkumar Spark SQL parallel query submission via single HiveContext Mon, 29 Jun, 06:20
bit1...@163.com How to find how many cores are allocated to Executor Mon, 29 Jun, 08:29
Akhil Das   Re: How to find how many cores are allocated to Executor Tue, 30 Jun, 07:03
bit1...@163.com   Re: Re: How to find how many cores are allocated to Executor Tue, 30 Jun, 07:24
Hao Ren SparkContext and JavaSparkContext Mon, 29 Jun, 09:15
Hao Ren   Re: SparkContext and JavaSparkContext Mon, 29 Jun, 09:29
Re: kmeans broadcast
Himanshu Mehra   Re: kmeans broadcast Mon, 29 Jun, 09:30
luohui20...@sina.com got "java.lang.reflect.UndeclaredThrowableException" when running multiply APPs in spark Mon, 29 Jun, 09:38
Akhil Das   Re: got "java.lang.reflect.UndeclaredThrowableException" when running multiply APPs in spark Tue, 30 Jun, 07:11
Re: Scala problem when using g.vertices.map "not a member of type parameter"
Robineast   Re: Scala problem when using g.vertices.map "not a member of type parameter" Mon, 29 Jun, 10:12
summerdaway Spark Streaming-Receiver drops data Mon, 29 Jun, 10:17
Spark Enthusiast Serialization Exception Mon, 29 Jun, 12:14
Tathagata Das   Re: Serialization Exception Tue, 30 Jun, 21:40
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
Box list
Oct 2020212
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137