spark-user mailing list archives: January 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Ganon Pierce Using ec2 launch script with locally built version of spark? Tue, 06 Jan, 22:51
gen tang   Re: Using ec2 launch script with locally built version of spark? Wed, 07 Jan, 00:42
riginos How to replace user.id to user.names in a file Wed, 07 Jan, 00:53
Tobias Pfeiffer   Re: How to replace user.id to user.names in a file Wed, 07 Jan, 01:34
Tobias Pfeiffer     Re: How to replace user.id to user.names in a file Wed, 07 Jan, 02:06
Tobias Pfeiffer       Re: How to replace user.id to user.names in a file Wed, 07 Jan, 02:15
Manoj Samel Cannot see RDDs in Spark UI Wed, 07 Jan, 02:48
Andrew Ash   Re: Cannot see RDDs in Spark UI Wed, 07 Jan, 03:25
Nathan McCarthy SparkSQL schemaRDD & MapPartitions calls - performance issues - columnar formats? Wed, 07 Jan, 03:53
Nathan McCarthy   Re: SparkSQL schemaRDD & MapPartitions calls - performance issues - columnar formats? Fri, 09 Jan, 07:37
Cheng Lian   Re: SparkSQL schemaRDD & MapPartitions calls - performance issues - columnar formats? Fri, 09 Jan, 14:59
Michael Armbrust     Re: SparkSQL schemaRDD & MapPartitions calls - performance issues - columnar formats? Fri, 09 Jan, 16:41
Nathan McCarthy       Re: SparkSQL schemaRDD & MapPartitions calls - performance issues - columnar formats? Sun, 11 Jan, 05:40
Cheng Lian         Re: SparkSQL schemaRDD & MapPartitions calls - performance issues - columnar formats? Sun, 11 Jan, 14:21
Nathan McCarthy           Re: SparkSQL schemaRDD & MapPartitions calls - performance issues - columnar formats? Fri, 16 Jan, 07:26
Michael Armbrust             Re: SparkSQL schemaRDD & MapPartitions calls - performance issues - columnar formats? Fri, 16 Jan, 20:34
Cheng Lian             Re: SparkSQL schemaRDD & MapPartitions calls - performance issues - columnar formats? Tue, 20 Jan, 20:59
Re: How to merge a RDD of RDDs into one uber RDD
k.tham   Re: How to merge a RDD of RDDs into one uber RDD Wed, 07 Jan, 05:17
rkgurram     Re: How to merge a RDD of RDDs into one uber RDD Wed, 07 Jan, 08:59
Raghavendra Pandey       Re: How to merge a RDD of RDDs into one uber RDD Wed, 07 Jan, 09:51
Sean Owen         Re: How to merge a RDD of RDDs into one uber RDD Wed, 07 Jan, 10:49
Raghavendra Pandey           Re: How to merge a RDD of RDDs into one uber RDD Wed, 07 Jan, 15:16
Re: Spark SQL implementation error
Pankaj Narang   Re: Spark SQL implementation error Wed, 07 Jan, 06:02
Xuelin Cao Why Parquet Predicate Pushdown doesn't work? Wed, 07 Jan, 06:18
Daniel Haviv   Re: Why Parquet Predicate Pushdown doesn't work? Wed, 07 Jan, 06:42
Cody Koeninger     Re: Why Parquet Predicate Pushdown doesn't work? Wed, 07 Jan, 14:14
Xuelin Cao       Re: Why Parquet Predicate Pushdown doesn't work? Thu, 08 Jan, 06:40
Yana Kadiyska         Re: Why Parquet Predicate Pushdown doesn't work? Sat, 17 Jan, 14:33
Jerry Lam         Re: Why Parquet Predicate Pushdown doesn't work? Mon, 19 Jan, 19:41
Aniket Bhatnagar spark-network-yarn 2.11 depends on spark-network-shuffle 2.10 Wed, 07 Jan, 08:25
Marcelo Vanzin   Re: spark-network-yarn 2.11 depends on spark-network-shuffle 2.10 Wed, 07 Jan, 18:14
Aniket Bhatnagar     Re: spark-network-yarn 2.11 depends on spark-network-shuffle 2.10 Thu, 08 Jan, 10:16
Niranda Perera example insert statement in Spark SQL Wed, 07 Jan, 09:13
Cheng Lian   Re: example insert statement in Spark SQL Thu, 08 Jan, 13:38
Xuelin Cao Spark SQL: The cached columnar table is not columnar? Wed, 07 Jan, 09:37
Michael Armbrust   Re: Spark SQL: The cached columnar table is not columnar? Wed, 07 Jan, 22:04
曹雪林     Re: Spark SQL: The cached columnar table is not columnar? Thu, 08 Jan, 01:34
Cheng Lian   Re: Spark SQL: The cached columnar table is not columnar? Thu, 08 Jan, 10:40
Xuelin Cao     Re: Spark SQL: The cached columnar table is not columnar? Thu, 08 Jan, 11:43
Cheng Lian       Re: Spark SQL: The cached columnar table is not columnar? Thu, 08 Jan, 13:36
Xuelin Cao         Re: Spark SQL: The cached columnar table is not columnar? Thu, 08 Jan, 14:13
Cheng Lian           Re: Spark SQL: The cached columnar table is not columnar? Thu, 08 Jan, 14:42
Antony Mayi spark 1.2 defaults to MR1 class when calling newAPIHadoopRDD Wed, 07 Jan, 09:38
Sean Owen   Re: spark 1.2 defaults to MR1 class when calling newAPIHadoopRDD Wed, 07 Jan, 10:55
Antony Mayi     Re: spark 1.2 defaults to MR1 class when calling newAPIHadoopRDD Wed, 07 Jan, 13:46
Sean Owen       Re: spark 1.2 defaults to MR1 class when calling newAPIHadoopRDD Wed, 07 Jan, 15:56
Antony Mayi         Re: spark 1.2 defaults to MR1 class when calling newAPIHadoopRDD Wed, 07 Jan, 16:30
Shixiong Zhu           Re: spark 1.2 defaults to MR1 class when calling newAPIHadoopRDD Thu, 08 Jan, 07:51
Shixiong Zhu             Re: spark 1.2 defaults to MR1 class when calling newAPIHadoopRDD Fri, 09 Jan, 10:22
Re: Reading Data Using TextFileStream
Akhil Das   Re: Reading Data Using TextFileStream Wed, 07 Jan, 10:46
Akhil Das     Re: Reading Data Using TextFileStream Wed, 07 Jan, 11:19
Akhil Das       Re: Reading Data Using TextFileStream Wed, 07 Jan, 12:22
Nicolas Colson [GraphX] Integration with TinkerPop3/Gremlin Wed, 07 Jan, 11:03
Nicolas Colson   Re: [GraphX] Integration with TinkerPop3/Gremlin Mon, 26 Jan, 10:27
Hafiz Mujadid max receiving rate in spark streaming Wed, 07 Jan, 11:11
Akhil Das   Re: max receiving rate in spark streaming Wed, 07 Jan, 11:16
Enno Shioji TestSuiteBase based unit test using a sliding window join timesout Wed, 07 Jan, 11:16
FW: No APPLICATION_COMPLETE file created in history server log location upon pyspark job success
michael.engl...@nomura.com   FW: No APPLICATION_COMPLETE file created in history server log location upon pyspark job success Wed, 07 Jan, 11:38
Andrew Ash     Re: FW: No APPLICATION_COMPLETE file created in history server log location upon pyspark job success Wed, 07 Jan, 15:25
michael.engl...@nomura.com       RE: FW: No APPLICATION_COMPLETE file created in history server log location upon pyspark job success Wed, 07 Jan, 15:39
Christophe Billiard akka.actor.ActorNotFound In Spark Streaming on Mesos (using ssc.actorStream) Wed, 07 Jan, 13:30
Mukesh Jha KafkaUtils not consuming all the data from all partitions Wed, 07 Jan, 14:00
francois.garil...@typesafe.com   Re: KafkaUtils not consuming all the data from all partitions Wed, 07 Jan, 14:43
Gerard Maas     Re: KafkaUtils not consuming all the data from all partitions Wed, 07 Jan, 14:51
Mukesh Jha       Re: KafkaUtils not consuming all the data from all partitions Wed, 07 Jan, 15:05
francois.garil...@typesafe.com         Re: KafkaUtils not consuming all the data from all partitions Wed, 07 Jan, 15:43
Gerard Maas           Re: KafkaUtils not consuming all the data from all partitions Wed, 07 Jan, 16:06
Corey Nolet Strange DAG scheduling behavior on currently dependent RDDs Wed, 07 Jan, 14:12
Corey Nolet   Re: Strange DAG scheduling behavior on currently dependent RDDs Wed, 07 Jan, 15:42
Saurabh Agrawal Spark Trainings/ Professional certifications Wed, 07 Jan, 14:38
Sean Owen   Re: Spark Trainings/ Professional certifications Wed, 07 Jan, 16:39
Paco Nathan   Re: Spark Trainings/ Professional certifications Wed, 07 Jan, 17:18
gen tang     Re: Spark Trainings/ Professional certifications Wed, 07 Jan, 18:56
Paco Nathan       Re: Spark Trainings/ Professional certifications Wed, 07 Jan, 19:17
cedric.artigue About logistic regression sample codes in pyspark Wed, 07 Jan, 14:49
Re: Understanding RDD.GroupBy OutOfMemory Exceptions
asimjalis   Re: Understanding RDD.GroupBy OutOfMemory Exceptions Wed, 07 Jan, 14:56
gen tang Spark on teradata? Wed, 07 Jan, 15:14
Reynold Xin   Re: Spark on teradata? Thu, 08 Jan, 18:39
gen tang     Re: Spark on teradata? Thu, 08 Jan, 18:53
Evan R. Sparks       Re: Spark on teradata? Thu, 08 Jan, 20:01
michael.engl...@nomura.com Spark History Server can't read event logs Wed, 07 Jan, 15:45
Marcelo Vanzin   Re: Spark History Server can't read event logs Wed, 07 Jan, 18:09
michael.engl...@nomura.com     RE: Spark History Server can't read event logs Thu, 08 Jan, 09:22
Marcelo Vanzin       Re: Spark History Server can't read event logs Thu, 08 Jan, 17:46
Marcelo Vanzin         Re: Spark History Server can't read event logs Thu, 08 Jan, 18:32
Marcelo Vanzin           Re: Spark History Server can't read event logs Thu, 08 Jan, 19:23
michael.engl...@nomura.com             RE: Spark History Server can't read event logs Fri, 09 Jan, 09:03
jamborta Spark with Hive cluster dependencies Wed, 07 Jan, 16:27
Michael Armbrust   Re: Spark with Hive cluster dependencies Wed, 07 Jan, 20:51
Somnath Pandeya     RE: Spark with Hive cluster dependencies Thu, 08 Jan, 04:16
Max Xu streaming application throws IOException due to Log directory already exists during checkpoint recovery Wed, 07 Jan, 16:55
paja Join stucks in the last stage step Wed, 07 Jan, 17:27
paja   Re: Join stucks in the last stage step Thu, 08 Jan, 08:41
rok calculating the mean of SparseVector RDD Wed, 07 Jan, 17:42
Xiangrui Meng   Re: calculating the mean of SparseVector RDD Wed, 07 Jan, 18:30
Rok Roskar     Re: calculating the mean of SparseVector RDD Fri, 09 Jan, 11:46
Xiangrui Meng       Re: calculating the mean of SparseVector RDD Sat, 10 Jan, 06:04
Rok Roskar         Re: calculating the mean of SparseVector RDD Mon, 12 Jan, 12:42
Xiangrui Meng           Re: calculating the mean of SparseVector RDD Mon, 12 Jan, 22:34
Corey Nolet What does (### skipped) mean in the Spark UI? Wed, 07 Jan, 20:08
Ted Yu   Re: What does (### skipped) mean in the Spark UI? Wed, 07 Jan, 20:28
Corey Nolet     Re: What does (### skipped) mean in the Spark UI? Wed, 07 Jan, 20:32
Shivaram Venkataraman       Re: What does (### skipped) mean in the Spark UI? Wed, 07 Jan, 20:52
Mark Hamstra       Re: What does (### skipped) mean in the Spark UI? Wed, 07 Jan, 22:00
Shivaram Venkataraman         Re: What does (### skipped) mean in the Spark UI? Wed, 07 Jan, 22:10
Ankur Srivastava Spark with Cassandra - Shuffle opening to many files Wed, 07 Jan, 21:06
Cody Koeninger   Re: Spark with Cassandra - Shuffle opening to many files Wed, 07 Jan, 21:20
Ankur Srivastava     Re: Spark with Cassandra - Shuffle opening to many files Wed, 07 Jan, 21:56
figpope ScalaReflectionException when using saveAsParquetFile in sbt Wed, 07 Jan, 21:54
Shing Hing Man   Re: ScalaReflectionException when using saveAsParquetFile in sbt Sun, 11 Jan, 12:43
Pierre B   Re: ScalaReflectionException when using saveAsParquetFile in sbt Thu, 15 Jan, 09:14
gangli72 Spark Streaming with Listening Server Socket Wed, 07 Jan, 22:34
Christopher Thom [MLlib] Scoring GBTs with a variable number of trees Wed, 07 Jan, 23:01
freedafeng spark 1.1 got error when working with cdh5.3.0 standalone mode Thu, 08 Jan, 00:45
Marcelo Vanzin   Re: spark 1.1 got error when working with cdh5.3.0 standalone mode Thu, 08 Jan, 00:57
曹雪林 When will spark support "push" style shuffle? Thu, 08 Jan, 01:47
Eclipse flags error on KafkaUtils.createStream()
Kah-Chan Low   Eclipse flags error on KafkaUtils.createStream() Thu, 08 Jan, 03:25
kc66   Eclipse flags error on KafkaUtils.createStream() Thu, 08 Jan, 13:24
Tao Li [Spare Core] function SparkContext.cancelJobGroup(groupId) doesn't work Thu, 08 Jan, 03:44
Re: MatrixFactorizationModel serialization
wanbo   Re: MatrixFactorizationModel serialization Thu, 08 Jan, 03:53
Ganelin, Ilya     RE: MatrixFactorizationModel serialization Thu, 08 Jan, 04:38
Tobias Pfeiffer Create DStream consisting of HDFS and (then) Kafka data Thu, 08 Jan, 04:53
rekt...@voodoowarez.com   Re: Create DStream consisting of HDFS and (then) Kafka data Thu, 08 Jan, 05:19
Tobias Pfeiffer     Re: Create DStream consisting of HDFS and (then) Kafka data Thu, 08 Jan, 05:33
rekt...@voodoowarez.com       Re: Create DStream consisting of HDFS and (then) Kafka data Thu, 08 Jan, 07:01
Xuelin Cao Can spark supports task level resource management? Thu, 08 Jan, 06:55
Sandy Ryza   Re: Can spark supports task level resource management? Thu, 08 Jan, 07:00
Tim Chen   Re: Can spark supports task level resource management? Thu, 08 Jan, 07:07
Xuelin Cao     Re: Can spark supports task level resource management? Thu, 08 Jan, 07:19
Tim Chen       Re: Can spark supports task level resource management? Thu, 08 Jan, 07:30
Xuelin Cao         Re: Can spark supports task level resource management? Thu, 08 Jan, 07:34
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
Aug 2019100
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137