spark-user mailing list archives: January 2015

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · Next »Thread · Author · Date
1esha Mathematical functions in spark sql Tue, 27 Jan, 04:29
老赵 how to split key from RDD for compute UV Tue, 27 Jan, 12:14
曹雪林 Re: Spark SQL: The cached columnar table is not columnar? Thu, 08 Jan, 01:34
曹雪林 When will spark support "push" style shuffle? Thu, 08 Jan, 01:47
逸君曹 Anyway to make RDD preserve input directories structures? Fri, 16 Jan, 02:15
Jörn Franke Re: Spark for core business-logic? - Replacing: MongoDB? Mon, 05 Jan, 05:24
Jörn Franke Re: Did anyone tried overcommit of CPU cores? Fri, 09 Jan, 06:57
Jörn Franke Re: How to integrate Spark with OpenCV? Wed, 14 Jan, 11:50
Jörn Franke Re: Join DStream With Other Datasets Sat, 17 Jan, 18:12
Jörn Franke Re: spark streaming with checkpoint Thu, 22 Jan, 16:59
Jörn Franke Re: processing large dataset Fri, 23 Jan, 06:33
Jörn Franke Re: Eclipse on spark Mon, 26 Jan, 06:51
Jörn Franke Re: Spark (Streaming?) holding on to Mesos Resources Mon, 26 Jan, 22:23
Capitão Spark SQL - Unable to use Hive UDF because of ClassNotFoundException Fri, 30 Jan, 17:17
Håkan Jonsson Re: No AMI for Spark 1.2 using ec2 scripts Mon, 26 Jan, 09:47
Håkan Jonsson Re: No AMI for Spark 1.2 using ec2 scripts Mon, 26 Jan, 12:26
Iulian Dragoș Re: NPE in Parquet Tue, 20 Jan, 16:43
Luis Ángel Vicente Sánchez NullPointer when access rdd.sparkContext (Spark 1.1.1) Wed, 21 Jan, 12:35
Luis Ángel Vicente Sánchez Re: NullPointer when access rdd.sparkContext (Spark 1.1.1) Wed, 21 Jan, 12:49
Luis Ángel Vicente Sánchez Re: NullPointer when access rdd.sparkContext (Spark 1.1.1) Wed, 21 Jan, 14:31
Stéphane Verlet Re: Does Spark automatically run different stages concurrently when possible? Sat, 10 Jan, 21:39
Zsolt Tóth [mllib] Decision Tree - prediction probabilites of label classes Wed, 21 Jan, 15:36
Padmanabhan, Mahesh (contractor) Custom receiver runtime Kryo exception Mon, 05 Jan, 17:57
정재부 Re: Shuffle write increases in spark 1.2 Mon, 05 Jan, 05:07
瀬川 卓也 Data are partial to a specific partition after sort Thu, 29 Jan, 02:57
guxiaobo1982 Is cluster mode is supported by the submit command for standalone clusters? Sat, 17 Jan, 13:01
guxiaobo1982 How to get the master URL at runtime inside driver program? Sun, 18 Jan, 02:08
guxiaobo1982 How to create distributed matrixes from hive tables. Sun, 18 Jan, 12:07
guxiaobo1982 Can't access remote Hive table from spark Sun, 25 Jan, 08:18
guxiaobo1982 Re: Can't access remote Hive table from spark Sun, 25 Jan, 08:26
txw Is spark suitable for large scale pagerank, such as 200 million nodes, 2 billion edges? Thu, 15 Jan, 17:29
txw Re: Is spark suitable for large scale pagerank, such as 200 millionnodes, 2 billion edges? Sun, 18 Jan, 06:18
Aaron Spark Driver "behind" NAT Mon, 05 Jan, 12:41
Aaron Re: Spark Driver "behind" NAT Mon, 05 Jan, 14:02
Aaron Re: Spark Driver "behind" NAT Tue, 06 Jan, 15:45
Aaron Re: Spark Driver "behind" NAT Tue, 06 Jan, 15:47
Aaron Davidson Re: ERROR ConnectionManager: Corresponding SendingConnection to ConnectionManagerId Thu, 08 Jan, 20:36
Aaron Davidson Re: FileNotFoundException in appcache shuffle files Sat, 10 Jan, 21:15
Aaron Davidson Re: use netty shuffle for network cause high gc time Wed, 14 Jan, 06:24
Aaron Davidson Re: Serializability: for vs. while loops Thu, 15 Jan, 08:05
Aaron Davidson Re: Spark 1.2 - com/google/common/base/Preconditions java.lang.NoClassDefFoundErro Wed, 21 Jan, 02:26
Aaron Davidson Re: Spark 1.2 – How to change Default (Random) port …. Mon, 26 Jan, 05:34
Aaron Davidson Re: Lost task - connection closed Mon, 26 Jan, 07:08
Aaron Davidson Re: Lost task - connection closed Mon, 26 Jan, 17:49
Aaron Davidson Re: performance of saveAsTextFile moving files from _temporary Wed, 28 Jan, 02:24
Aaron Davidson Re: performance of saveAsTextFile moving files from _temporary Wed, 28 Jan, 09:28
Aaron Davidson Re: Duplicate key when sorting BytesWritable with Kryo? Fri, 30 Jan, 19:59
Abhi Basu SparkSQL Thu, 08 Jan, 22:24
Abhi Basu unsubscribe Wed, 28 Jan, 22:16
Abhideep Chakravarty Performance degrade Sun, 04 Jan, 16:12
Abhideep Chakravarty Spark 1.2.0 not getting connected Wed, 14 Jan, 06:03
Abhideep Chakravarty RE: Spark 1.2.0 not getting connected Wed, 14 Jan, 06:09
Abhideep Chakravarty RE: Spark 1.2.0 not getting connected Wed, 14 Jan, 09:19
Adam Bordelon Re: Spark (Streaming?) holding on to Mesos Resources Tue, 27 Jan, 08:23
Adam Diaz Re: Large number of pyspark.daemon processes Sat, 24 Jan, 06:04
Adam Gilmore Re: Parquet schema changes Mon, 05 Jan, 05:44
Adam Gilmore Re: Issue with Parquet on Spark 1.2 and Amazon EMR Mon, 05 Jan, 05:45
Adam Gilmore Parquet predicate pushdown Mon, 05 Jan, 23:38
Adam Gilmore Re: Parquet predicate pushdown Wed, 07 Jan, 01:09
Adam Gilmore Re: Parquet schema changes Wed, 07 Jan, 01:23
Adam Gilmore Re: Parquet schema changes Wed, 07 Jan, 09:00
Adrian Mocanu RE: RowMatrix.multiply() ? Fri, 09 Jan, 19:13
Adrian Mocanu reconciling best effort real time with delayed aggregation Wed, 14 Jan, 16:19
Adrian Mocanu Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions Thu, 22 Jan, 15:57
Adrian Mocanu RE: Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions Thu, 22 Jan, 20:47
Adrian Mocanu RE: Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions Thu, 22 Jan, 20:50
Ajay Srivastava Creating RDD from only few columns of a Parquet file Tue, 13 Jan, 06:20
Ajay Srivastava Re: Creating RDD from only few columns of a Parquet file Tue, 13 Jan, 08:51
Ajay Srivastava Some tasks are taking long time Thu, 15 Jan, 13:42
Ajay Srivastava Re: Some tasks are taking long time Thu, 15 Jan, 14:49
Ajay Srivastava Re: Some tasks are taking long time Fri, 16 Jan, 04:42
Akhil Re: disable log4j for spark-shell Wed, 07 Jan, 08:39
Akhil Das Re: Trying to make spark-jobserver work with yarn Thu, 01 Jan, 08:22
Akhil Das Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream Thu, 01 Jan, 08:28
Akhil Das Re: spark stream + cassandra (execution on event) Thu, 01 Jan, 08:32
Akhil Das Re: Spark app performance Thu, 01 Jan, 08:35
Akhil Das Re: Compile error from Spark 1.2.0 Fri, 02 Jan, 06:45
Akhil Das Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream Fri, 02 Jan, 11:27
Akhil Das Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream Fri, 02 Jan, 11:50
Akhil Das Re: getting number of partition per topic in kafka Sat, 03 Jan, 17:28
Akhil Das Re: Repartition Memory Leak Mon, 05 Jan, 06:16
Akhil Das Re: a vague question, but perhaps it might ring a bell Mon, 05 Jan, 06:21
Akhil Das Re: stopping streaming context Mon, 05 Jan, 10:14
Akhil Das Re: Spark Driver "behind" NAT Mon, 05 Jan, 13:28
Akhil Das Re: Saving partial (top 10) DStream windows to hdfs Tue, 06 Jan, 08:03
Akhil Das Re: Timeout Exception in standalone cluster Tue, 06 Jan, 08:14
Akhil Das Re: Set EXTRA_JAR environment variable for spark-jobserver Tue, 06 Jan, 12:53
Akhil Das Re: Pyspark Interactive shell Tue, 06 Jan, 15:50
Akhil Das Re: Problem getting Spark running on a Yarn cluster Wed, 07 Jan, 06:47
Akhil Das Re: Reading Data Using TextFileStream Wed, 07 Jan, 10:46
Akhil Das Re: max receiving rate in spark streaming Wed, 07 Jan, 11:16
Akhil Das Re: Reading Data Using TextFileStream Wed, 07 Jan, 11:19
Akhil Das Re: Reading Data Using TextFileStream Wed, 07 Jan, 12:22
Akhil Das Re: Saving partial (top 10) DStream windows to hdfs Wed, 07 Jan, 16:23
Akhil Das Re: skipping header from each file Fri, 09 Jan, 06:48
Akhil Das Re: Getting Output From a Cluster Fri, 09 Jan, 07:23
Akhil Das Re: Cannot save RDD as text file to local file system Fri, 09 Jan, 07:25
Akhil Das Re: Join RDDs with DStreams Fri, 09 Jan, 07:33
Akhil Das Re: Is It Feasible for Spark 1.1 Broadcast to Fully Utilize the Ethernet Card Throughput? Fri, 09 Jan, 10:21
Akhil Das Re: Play Scala Spark Exmaple Sun, 11 Jan, 06:01
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · Next »Thread · Author · Date
Box list
Aug 2019131
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137