spark-user mailing list archives: January 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
mingyu How to make spark partition sticky, i.e. stay with node? Thu, 22 Jan, 19:32
davidkl   Re: How to make spark partition sticky, i.e. stay with node? Thu, 22 Jan, 23:11
mingyu   Re: How to make spark partition sticky, i.e. stay with node? Fri, 23 Jan, 00:28
mingyu     Re: How to make spark partition sticky, i.e. stay with node? Fri, 23 Jan, 16:23
Tathagata Das       Re: How to make spark partition sticky, i.e. stay with node? Fri, 23 Jan, 18:47
Wang, Daniel Durablility of Spark Streaming Applications Thu, 22 Jan, 19:44
Zijing Guo Apache Spark broadcast error: Error sending message as driverActor is null [message = UpdateBlockInfo(BlockManagerId(4) Thu, 22 Jan, 20:02
Kane Kim Large dataset, reduceByKey - java heap space error Thu, 22 Jan, 22:12
Sean McNamara   Re: Large dataset, reduceByKey - java heap space error Thu, 22 Jan, 22:38
Kane Kim reducing number of output files Thu, 22 Jan, 22:46
Sean Owen   Re: reducing number of output files Thu, 22 Jan, 23:26
DEVAN M.S.     Re: reducing number of output files Fri, 23 Jan, 01:32
Sean Owen     Re: reducing number of output files Fri, 23 Jan, 10:18
Nishant Sinha Exception in parsley pyspark cassandra hadoop connector Thu, 22 Jan, 23:47
SK save a histogram to a file Fri, 23 Jan, 00:07
madhu phatak   Re: save a histogram to a file Fri, 23 Jan, 09:23
Sean Owen   Re: save a histogram to a file Fri, 23 Jan, 10:04
Nicolas Mai Missing output partition file in S3 Fri, 23 Jan, 01:32
Harihar Nahak Results never return to driver | Spark Custom Reader Fri, 23 Jan, 03:54
Yana Kadiyska   Re: Results never return to driver | Spark Custom Reader Fri, 23 Jan, 17:37
Harihar Nahak     Re: Results never return to driver | Spark Custom Reader Sun, 25 Jan, 20:50
Greg Temchenko Streaming: getting data from Cassandra based on input stream values Fri, 23 Jan, 04:42
madhu phatak   Re: Streaming: getting data from Cassandra based on input stream values Sat, 24 Jan, 07:55
Kane Kim processing large dataset Fri, 23 Jan, 04:52
Jörn Franke   Re: processing large dataset Fri, 23 Jan, 06:33
Russell Jurney     Re: processing large dataset Fri, 23 Jan, 07:05
Sean Owen   Re: processing large dataset Fri, 23 Jan, 09:49
Re: Got java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s when running job from intellij Idea
Marco   Re: Got java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s when running job from intellij Idea Fri, 23 Jan, 10:57
Sean Owen     Re: Got java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s when running job from intellij Idea Fri, 23 Jan, 11:07
Marco       Re: Got java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s when running job from intellij Idea Wed, 28 Jan, 09:08
Nishant Patel java.io.NotSerializableException: org.apache.spark.streaming.StreamingContext Fri, 23 Jan, 10:59
Sean Owen   Re: java.io.NotSerializableException: org.apache.spark.streaming.StreamingContext Fri, 23 Jan, 11:05
matthes Can't access nested types with sql Fri, 23 Jan, 15:02
Michael Armbrust   Re: Can't access nested types with sql Sat, 24 Jan, 19:39
Boromir Widas GroupBy multiple attributes Fri, 23 Jan, 16:03
Sven Krasser Large number of pyspark.daemon processes Fri, 23 Jan, 17:36
Sandy Ryza   Re: Large number of pyspark.daemon processes Sat, 24 Jan, 00:51
Adam Diaz     Re: Large number of pyspark.daemon processes Sat, 24 Jan, 06:04
Sven Krasser       Re: Large number of pyspark.daemon processes Sat, 24 Jan, 07:45
Davies Liu         Re: Large number of pyspark.daemon processes Sat, 24 Jan, 07:52
Sven Krasser           Re: Large number of pyspark.daemon processes Sat, 24 Jan, 08:27
Sven Krasser             Re: Large number of pyspark.daemon processes Wed, 28 Jan, 01:58
Sven Krasser     Re: Large number of pyspark.daemon processes Sat, 24 Jan, 07:38
Chen Song Spark Streaming action not triggered with Kafka inputs Fri, 23 Jan, 19:25
Akhil Das   Re: Spark Streaming action not triggered with Kafka inputs Sat, 24 Jan, 07:37
Manoj Samel spark 1.2 - Writing parque fails for timestamp with "Unsupported datatype TimestampType" Fri, 23 Jan, 19:40
Manoj Samel   Re: spark 1.2 - Writing parque fails for timestamp with "Unsupported datatype TimestampType" Fri, 23 Jan, 20:08
Michael Armbrust     Re: spark 1.2 - Writing parque fails for timestamp with "Unsupported datatype TimestampType" Sat, 24 Jan, 19:47
Manoj Samel       Re: spark 1.2 - Writing parque fails for timestamp with "Unsupported datatype TimestampType" Mon, 26 Jan, 23:05
Michael Armbrust         Re: spark 1.2 - Writing parque fails for timestamp with "Unsupported datatype TimestampType" Mon, 26 Jan, 23:18
Manoj Samel           Re: spark 1.2 - Writing parque fails for timestamp with "Unsupported datatype TimestampType" Tue, 27 Jan, 00:14
Darin McBeath Problems saving a large RDD (1 TB) to S3 as a sequence file Fri, 23 Jan, 20:04
Sven Krasser   Re: Problems saving a large RDD (1 TB) to S3 as a sequence file Fri, 23 Jan, 22:12
Darin McBeath     Re: Problems saving a large RDD (1 TB) to S3 as a sequence file Fri, 23 Jan, 22:28
Akhil Das       Re: Problems saving a large RDD (1 TB) to S3 as a sequence file Sat, 24 Jan, 07:23
Ashic Mahtab Starting a spark streaming app in init.d Fri, 23 Jan, 20:27
Akhil Das   Re: Starting a spark streaming app in init.d Sat, 24 Jan, 07:30
Ashic Mahtab   RE: Starting a spark streaming app in init.d Sat, 24 Jan, 10:31
olegshirokikh Apache Spark standalone mode: number of cores Fri, 23 Jan, 22:44
Boromir Widas   Re: Apache Spark standalone mode: number of cores Fri, 23 Jan, 23:12
Deep Pradhan While Loop Sat, 24 Jan, 05:02
Ted Yu   Re: While Loop Sat, 24 Jan, 05:07
Ted Yu     Re: While Loop Sat, 24 Jan, 10:09
kundan kumar summary for all columns (numeric, strings) in a dataset Sat, 24 Jan, 10:32
Analyzing data from non-standard data sources (e.g. AWS Redshift)
Denis Mikhalkin   Analyzing data from non-standard data sources (e.g. AWS Redshift) Sat, 24 Jan, 11:43
Nicholas Chammas     Re: Analyzing data from non-standard data sources (e.g. AWS Redshift) Sat, 24 Jan, 16:06
Denis Mikhalkin       Re: Analyzing data from non-standard data sources (e.g. AWS Redshift) Sun, 25 Jan, 09:19
Charles Feduke         Re: Analyzing data from non-standard data sources (e.g. AWS Redshift) Sun, 25 Jan, 14:39
Charles Feduke           Re: Analyzing data from non-standard data sources (e.g. AWS Redshift) Mon, 26 Jan, 06:34
mickdelaney SparkException: Task not serializable - Jackson Json Sat, 24 Jan, 15:34
Kartheek.R java.io.IOException: connection closed. Sat, 24 Jan, 16:00
Kartheek.R   Re: java.io.IOException: connection closed. Sat, 24 Jan, 16:17
Rory Douglas Checksum validation failed pulling spark 1.2.0 from Maven Central Sat, 24 Jan, 18:33
Sean Owen   Re: Checksum validation failed pulling spark 1.2.0 from Maven Central Sat, 24 Jan, 18:39
Rory Douglas     Re: Checksum validation failed pulling spark 1.2.0 from Maven Central Sat, 24 Jan, 19:00
riginos Eclipse on spark Sat, 24 Jan, 18:33
Harihar Nahak   Re: Eclipse on spark Sun, 25 Jan, 23:59
Jörn Franke   Re: Eclipse on spark Mon, 26 Jan, 06:51
Luke Wilson-Mawer   Re: Eclipse on spark Mon, 26 Jan, 10:22
vaquar khan     Re: Eclipse on spark Mon, 26 Jan, 11:47
Akhil Das       Re: Eclipse on spark Mon, 26 Jan, 15:09
shrenik Project ideas for spark Sat, 24 Jan, 19:52
Joseph Lust cannot run spark-shell interactively against cluster from remote host - confusing memory warnings Sat, 24 Jan, 21:10
Akhil Das   Re: cannot run spark-shell interactively against cluster from remote host - confusing memory warnings Mon, 26 Jan, 15:15
Matan Safriel Full per node replication level (architecture question) Sat, 24 Jan, 21:34
Ashic Mahtab   RE: Full per node replication level (architecture question) Sat, 24 Jan, 22:50
Charles Feduke JDBC sharded solution Sat, 24 Jan, 23:15
Re: Integrerate Spark Streaming and Kafka, but get bad symbolic reference error
mykidong   Re: Integrerate Spark Streaming and Kafka, but get bad symbolic reference error Sun, 25 Jan, 01:28
Subacini B Improve performance using spark streaming + sparksql Sun, 25 Jan, 01:38
guxiaobo1982 Can't access remote Hive table from spark Sun, 25 Jan, 08:18
guxiaobo1982   Re: Can't access remote Hive table from spark Sun, 25 Jan, 08:26
Skanda Prasad   RE: Can't access remote Hive table from spark Sun, 25 Jan, 23:11
Larry Liu where storagelevel DISK_ONLY persists RDD to Sun, 25 Jan, 08:36
Charles Feduke   Re: where storagelevel DISK_ONLY persists RDD to Sun, 25 Jan, 14:26
Larry Liu     Re: where storagelevel DISK_ONLY persists RDD to Mon, 26 Jan, 07:08
Shao, Saisai       RE: where storagelevel DISK_ONLY persists RDD to Mon, 26 Jan, 07:27
Larry Liu Shuffle to HDFS Sun, 25 Jan, 08:45
Shao, Saisai   RE: Shuffle to HDFS Mon, 26 Jan, 05:44
Larry Liu     Re: Shuffle to HDFS Mon, 26 Jan, 07:03
Shao, Saisai       RE: Shuffle to HDFS Mon, 26 Jan, 07:23
bit1...@163.com         Re: RE: Shuffle to HDFS Mon, 26 Jan, 10:01
Sean Owen           Re: RE: Shuffle to HDFS Mon, 26 Jan, 10:08
scharissis graph.inDegrees including zero values Sun, 25 Jan, 13:52
Ankur Dave   Re: graph.inDegrees including zero values Sun, 25 Jan, 20:51
kundan kumar foreachActive functionality Sun, 25 Jan, 16:18
Reza Zadeh   Re: foreachActive functionality Sun, 25 Jan, 20:25
DB Tsai     Re: foreachActive functionality Mon, 26 Jan, 02:26
Andreas Rhode SVD in pyspark ? Sun, 25 Jan, 19:12
Chip Senkbeil   Re: SVD in pyspark ? Sun, 25 Jan, 19:32
Joseph Bradley     Re: SVD in pyspark ? Mon, 26 Jan, 20:23
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
Jul 2019144
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137