spark-user mailing list archives: December 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · Next »Thread · Author · Date
Sean McKibben Updating RDD used in DStream transform Tue, 23 Dec, 22:12
Sean Owen Re: ensuring RDD indices remain immutable Mon, 01 Dec, 15:22
Sean Owen Re: hdfs streaming context Mon, 01 Dec, 22:50
Sean Owen Re: hdfs streaming context Mon, 01 Dec, 23:06
Sean Owen Re: Is it possible to just change the value of the items in RDD without making a full copy? Tue, 02 Dec, 12:10
Sean Owen Re: converting DStream[String] into RDD[String] in spark streaming Wed, 03 Dec, 13:59
Sean Owen Re: Does filter on an RDD scan every data item ? Wed, 03 Dec, 14:47
Sean Owen Re: MLlib Naive Bayes classifier confidence Wed, 03 Dec, 15:09
Sean Owen Re: Efficient way to get top K values per key in (key, value) RDD? Thu, 04 Dec, 15:34
Sean Owen Re: Market Basket Analysis Fri, 05 Dec, 13:21
Sean Owen Re: Why my default partition size is set to 52 ? Fri, 05 Dec, 15:15
Sean Owen Re: Why KMeans with mllib is so slow ? Fri, 05 Dec, 15:56
Sean Owen Re: Java RDD Union Fri, 05 Dec, 20:22
Sean Owen Re: Market Basket Analysis Fri, 05 Dec, 20:25
Sean Owen Re: Java RDD Union Fri, 05 Dec, 20:58
Sean Owen Re: How to incrementally compile spark examples using mvn Sat, 06 Dec, 00:47
Sean Owen Re: Transfer from RDD to JavaRDD Sat, 06 Dec, 00:49
Sean Owen Re: Java RDD Union Sat, 06 Dec, 12:39
Sean Owen Re: run JavaAPISuite with mavem Sun, 07 Dec, 23:25
Sean Owen Re: spark 1.1.1 Maven dependency Tue, 09 Dec, 12:49
Sean Owen Re: Saving Data only if Dstream is not empty Tue, 09 Dec, 12:56
Sean Owen Re: flatMap and spilling of output to disk Wed, 10 Dec, 12:43
Sean Owen Re: DIMSUM and ColumnSimilarity use case ? Wed, 10 Dec, 15:39
Sean Owen Re: Decision Tree with libsvmtools datasets Thu, 11 Dec, 09:17
Sean Owen Re: why is spark + scala code so slow, compared to python? Thu, 11 Dec, 19:39
Sean Owen Re: Spark CDH5 packages Fri, 12 Dec, 12:34
Sean Owen Re: Spark 1.1.1, Hadoop 2.6 - Protobuf conflict Fri, 12 Dec, 14:11
Sean Owen Re: SVMWithSGD.run source code Sat, 13 Dec, 00:55
Sean Owen Re: Serialize mllib's MatrixFactorizationModel Mon, 15 Dec, 16:58
Sean Owen Re: Serialize mllib's MatrixFactorizationModel Mon, 15 Dec, 18:38
Sean Owen Re: NumberFormatException Mon, 15 Dec, 23:07
Sean Owen Re: Executor memory Tue, 16 Dec, 03:00
Sean Owen Re: Spark 1.2 + Avro does not work in HDP2.2 Tue, 16 Dec, 16:49
Sean Owen Re: Unable to start Spark 1.3 after building:java.lang. NoClassDefFoundError: org/codehaus/jackson/map/deser/std/StdDeserializer Wed, 17 Dec, 10:54
Sean Owen Re: weird bytecode incompatability issue between spark-core jar from mvn repo and official spark prebuilt binary Wed, 17 Dec, 12:39
Sean Owen Re: building with Hadoop 1.0.4 / where is hadoop-yarn-common:1.0.4 ? Thu, 18 Dec, 00:41
Sean Owen Re: Unable to start Spark 1.3 after building:java.lang. NoClassDefFoundError: org/codehaus/jackson/map/deser/std/StdDeserializer Thu, 18 Dec, 09:17
Sean Owen Re: weird bytecode incompatability issue between spark-core jar from mvn repo and official spark prebuilt binary Thu, 18 Dec, 09:22
Sean Owen Re: Can Spark 1.0.2 run on CDH-4.3.0 with yarn? And Will Spark 1.2.0 support CDH5.1.2 with yarn? Thu, 18 Dec, 09:38
Sean Owen Re: weird bytecode incompatability issue between spark-core jar from mvn repo and official spark prebuilt binary Thu, 18 Dec, 09:46
Sean Owen Re: SPARK-2243 Support multiple SparkContexts in the same JVM Thu, 18 Dec, 10:04
Sean Owen Re: Incorrect results when calling collect() ? Thu, 18 Dec, 10:25
Sean Owen Re: Incorrect results when calling collect() ? Thu, 18 Dec, 10:50
Sean Owen Re: Effects problems in logistic regression Thu, 18 Dec, 17:21
Sean Owen Re: Creating a smaller, derivative RDD from an RDD Thu, 18 Dec, 22:41
Sean Owen Re: Can we specify driver running on a specific machine of the cluster on yarn-cluster mode? Fri, 19 Dec, 09:47
Sean Owen Re: UNION two RDDs Fri, 19 Dec, 09:50
Sean Owen Re: Announcing Spark 1.2! Fri, 19 Dec, 09:55
Sean Owen Re: java.lang.ExceptionInInitializerError/Unable to load YARN support Fri, 19 Dec, 10:03
Sean Owen Re: Does Spark 1.2.0 support Scala 2.11? Fri, 19 Dec, 11:05
Sean Owen Re: How to run an action and get output?‏ Fri, 19 Dec, 11:06
Sean Owen Re: reading files recursively using spark Fri, 19 Dec, 11:20
Sean Owen Re: Scala Lazy values and partitions Fri, 19 Dec, 11:51
Sean Owen Re: Batch timestamp in spark streaming Fri, 19 Dec, 12:42
Sean Owen Re: Can Spark 1.1.0 save checkpoint to HDFS 2.5.1? Fri, 19 Dec, 15:53
Sean Owen Re: spark-shell bug with RDDs and case classes? Fri, 19 Dec, 19:29
Sean Owen RE: Can Spark 1.1.0 save checkpoint to HDFS 2.5.1? Sat, 20 Dec, 00:11
Sean Owen Re: Hadoop 2.6 compatibility? Sat, 20 Dec, 08:31
Sean Owen Re: spark-repl_1.2.0 was not uploaded to central maven repository. Sun, 21 Dec, 10:34
Sean Owen Re: Possible problems in packaging mlllib Mon, 22 Dec, 10:23
Sean Owen Re: Using more cores on machines Mon, 22 Dec, 10:57
Sean Owen Re: MLlib, classification label problem Mon, 22 Dec, 17:29
Sean Owen Re: spark-repl_1.2.0 was not uploaded to central maven repository. Mon, 22 Dec, 21:57
Sean Owen Re: Interpreting MLLib's linear regression o/p Tue, 23 Dec, 09:05
Sean Owen Re: Spark Installation Maven PermGen OutOfMemoryException Tue, 23 Dec, 15:04
Sean Owen Re: Spark Installation Maven PermGen OutOfMemoryException Tue, 23 Dec, 15:39
Sean Owen Re: retry in combineByKey at BinaryClassificationMetrics.scala Tue, 23 Dec, 20:09
Sean Owen Re: Spark Installation Maven PermGen OutOfMemoryException Wed, 24 Dec, 10:02
Sean Owen Re: Why does consuming a RESTful web service (using javax.ws.rs.* and Jsersey) work in unit test but not when submitted to Spark? Wed, 24 Dec, 12:46
Sean Owen Re: Why does consuming a RESTful web service (using javax.ws.rs.* and Jsersey) work in unit test but not when submitted to Spark? Wed, 24 Dec, 14:38
Sean Owen Re: How to identify erroneous input record ? Wed, 24 Dec, 16:56
Sean Owen RE: unable to do group by with 1st column Fri, 26 Dec, 08:48
Sean Owen Re: Discourse: A proposed alternative to the Spark User list Fri, 26 Dec, 08:56
Sean Owen Re: unable to do group by with 1st column Fri, 26 Dec, 20:23
Sean Owen Re: How to build Spark against the latest Sat, 27 Dec, 09:31
Sean Owen Re: How to build Spark against the latest Sat, 27 Dec, 15:14
Sean Owen Re: Can't submit the SparkPi example to local Yarn 2.6.0 installed by ambari 1.7.0 Sat, 27 Dec, 19:08
Sean Owen Re: Spark core maven error Sun, 28 Dec, 07:50
Sean Owen Re: init / shutdown for complex map job? Sun, 28 Dec, 08:54
Sean Owen Re: unable to check whether an item is present in RDD Sun, 28 Dec, 08:57
Sean Owen Re: init / shutdown for complex map job? Sun, 28 Dec, 20:17
Sean Owen Re: Spark core maven error Sun, 28 Dec, 20:25
Sean Owen Re: unable to do group by with 1st column Sun, 28 Dec, 21:14
Sean Owen Re: sample is not a member of org.apache.spark.streaming.dstream.DStream Sun, 28 Dec, 23:03
Sean Owen Re: recent join/iterator fix Mon, 29 Dec, 09:42
Sean Owen Re: Using TF-IDF from MLlib Mon, 29 Dec, 10:29
Sean Owen Re: Clustering text data with MLlib Mon, 29 Dec, 11:25
Sean Owen Re: recent join/iterator fix Mon, 29 Dec, 16:02
Sean Owen Re: Can we say 1 RDD is generated every batch interval? Tue, 30 Dec, 10:42
Sean Owen Re: How to collect() each partition in scala ? Tue, 30 Dec, 12:16
Sean Owen Re: building spark1.2 meet error Tue, 30 Dec, 12:32
Sean Owen Re: building spark1.2 meet error Wed, 31 Dec, 06:49
Sean Owen Re: Exception in thread "main" org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4 Wed, 31 Dec, 10:54
Sean Owen Re: FlatMapValues Wed, 31 Dec, 15:46
Sean Owen Re: Big performance difference between "client" and "cluster" deployment mode; is this expected? Wed, 31 Dec, 18:21
Shao, Saisai RE: Low Level Kafka Consumer for Spark Wed, 03 Dec, 01:34
Shao, Saisai RE: Spark Streaming empty RDD issue Thu, 04 Dec, 13:25
Shao, Saisai RE: Spark streaming for v1.1.1 - unable to start application Fri, 05 Dec, 09:20
Shao, Saisai RE: Spark Streaming Python APIs? Mon, 15 Dec, 02:56
Shao, Saisai RE: KafkaUtils explicit acks Mon, 15 Dec, 06:09
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · Next »Thread · Author · Date
Box list
Sep 202081
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137