spark-user mailing list archives: June 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
bipin BigDecimal problem in parquet file Tue, 09 Jun, 12:18
Cheng Lian   Re: BigDecimal problem in parquet file Tue, 09 Jun, 15:14
Bipin Nag     Re: BigDecimal problem in parquet file Wed, 10 Jun, 12:53
Cheng Lian       Re: BigDecimal problem in parquet file Fri, 12 Jun, 09:27
Bipin Nag         Re: BigDecimal problem in parquet file Fri, 12 Jun, 12:38
Davies Liu           Re: BigDecimal problem in parquet file Sat, 13 Jun, 01:01
Bipin Nag             Re: BigDecimal problem in parquet file Mon, 15 Jun, 12:48
Cheng Lian               Re: BigDecimal problem in parquet file Wed, 17 Jun, 22:31
Bipin Nag                 Re: BigDecimal problem in parquet file Thu, 18 Jun, 10:44
Needham, Guy Spark 1.3.1 SparkSQL metastore exceptions Tue, 09 Jun, 12:28
Cheng Lian   Re: Spark 1.3.1 SparkSQL metastore exceptions Tue, 09 Jun, 15:17
Needham, Guy     RE: Spark 1.3.1 SparkSQL metastore exceptions Fri, 12 Jun, 08:28
Cheng Lian       Re: Spark 1.3.1 SparkSQL metastore exceptions Fri, 12 Jun, 09:12
Needham, Guy         RE: Spark 1.3.1 SparkSQL metastore exceptions Mon, 15 Jun, 09:13
Pa Rö append file on hdfs Tue, 09 Jun, 13:34
Pa Rö   Re: append file on hdfs Wed, 10 Jun, 08:44
Richard Marscher     Re: append file on hdfs Wed, 10 Jun, 14:00
Ilove Data Join between DStream and Periodically-Changing-RDD Tue, 09 Jun, 14:07
Akhil Das   Re: Join between DStream and Periodically-Changing-RDD Wed, 10 Jun, 07:36
Evo Eftimov     RE: Join between DStream and Periodically-Changing-RDD Wed, 10 Jun, 16:08
Tathagata Das       Re: Join between DStream and Periodically-Changing-RDD Fri, 12 Jun, 01:14
Ilove Data         Re: Join between DStream and Periodically-Changing-RDD Mon, 15 Jun, 04:19
Evo Eftimov           RE: Join between DStream and Periodically-Changing-RDD Mon, 15 Jun, 07:37
Evo Eftimov           RE: Join between DStream and Periodically-Changing-RDD Mon, 15 Jun, 08:04
Issue running Spark 1.4 on Yarn
Matt Kapilevich   Issue running Spark 1.4 on Yarn Tue, 09 Jun, 14:56
Marcelo Vanzin     Re: Issue running Spark 1.4 on Yarn Tue, 09 Jun, 16:32
Matt Kapilevich       Re: Issue running Spark 1.4 on Yarn Tue, 09 Jun, 18:31
Marcelo Vanzin         Re: Issue running Spark 1.4 on Yarn Tue, 09 Jun, 20:01
Marcelo Vanzin           Re: Issue running Spark 1.4 on Yarn Tue, 09 Jun, 20:12
Matt Kapilevich             Re: Issue running Spark 1.4 on Yarn Tue, 09 Jun, 20:21
Marcelo Vanzin               Re: Issue running Spark 1.4 on Yarn Tue, 09 Jun, 20:25
Matt Kapilevich                 Re: Issue running Spark 1.4 on Yarn Tue, 09 Jun, 20:30
Matt Kapilevich                   Re: Issue running Spark 1.4 on Yarn Tue, 09 Jun, 20:45
Matt Kapilevich                     Re: Issue running Spark 1.4 on Yarn Tue, 09 Jun, 22:15
Matt Kapilevich                       Re: Issue running Spark 1.4 on Yarn Wed, 24 Jun, 01:16
nsalian   Re: Issue running Spark 1.4 on Yarn Wed, 10 Jun, 00:13
matvey14     Re: Issue running Spark 1.4 on Yarn Wed, 10 Jun, 15:25
nsalian       Re: Issue running Spark 1.4 on Yarn Wed, 10 Jun, 18:35
matvey14         Re: Issue running Spark 1.4 on Yarn Thu, 11 Jun, 11:53
nsalian           Re: Issue running Spark 1.4 on Yarn Thu, 11 Jun, 18:50
MA2 traverse a graph based on edge properties whilst counting matching vertex attributes Tue, 09 Jun, 15:29
Vijayasarathy Kannan Costs of transformations Tue, 09 Jun, 15:43
raggy Implementing top() using treeReduce() Tue, 09 Jun, 17:09
DB Tsai   Re: Implementing top() using treeReduce() Wed, 10 Jun, 02:41
Raghav Shankar     Re: Implementing top() using treeReduce() Thu, 18 Jun, 00:11
DB Tsai       Re: Implementing top() using treeReduce() Thu, 18 Jun, 00:13
Raghav Shankar         Re: Implementing top() using treeReduce() Thu, 18 Jun, 00:15
DB Tsai           Re: Implementing top() using treeReduce() Thu, 18 Jun, 00:16
karma243 Kafka Spark Streaming: ERROR EndpointWriter: dropping message Tue, 09 Jun, 17:43
nsalian   Re: Kafka Spark Streaming: ERROR EndpointWriter: dropping message Tue, 09 Jun, 23:09
karma243     Re: Kafka Spark Streaming: ERROR EndpointWriter: dropping message Wed, 10 Jun, 06:22
Dibyendu Bhattacharya       Re: Kafka Spark Streaming: ERROR EndpointWriter: dropping message Wed, 10 Jun, 06:45
Shuai Zheng [SPARK-6330] 1.4.0/1.5.0 Bug to access S3 -- AWS Access Key ID and Secret Access Key must be specified as the username or password (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or fs.s3.awsSecretAccessKey properties (respectively). Tue, 09 Jun, 19:45
Neera spark on yarn Tue, 09 Jun, 20:46
Stephen Carman   Linear Regression with SGD Tue, 09 Jun, 21:05
Robin East     Re: Linear Regression with SGD Tue, 09 Jun, 22:22
DB Tsai       Re: Linear Regression with SGD Wed, 10 Jun, 02:25
Debasish Das         Re: Linear Regression with SGD Wed, 10 Jun, 14:57
Re: spark-submit working differently than pyspark when trying to find external jars
Walt Schlender   Re: spark-submit working differently than pyspark when trying to find external jars Tue, 09 Jun, 21:56
Richard Catlin Can a Spark App run with spark-submit write pdf files to HDFS Tue, 09 Jun, 21:57
nsalian   Re: Can a Spark App run with spark-submit write pdf files to HDFS Wed, 10 Jun, 00:16
William Briggs   Re: Can a Spark App run with spark-submit write pdf files to HDFS Wed, 10 Jun, 01:18
Re: Determining number of executors within RDD
maxdml   Re: Determining number of executors within RDD Tue, 09 Jun, 23:04
Himanshu Mehra   Re: Determining number of executors within RDD Wed, 10 Jun, 07:46
maxdml     Re: Determining number of executors within RDD Wed, 10 Jun, 14:11
maxdml       Re: Determining number of executors within RDD Wed, 10 Jun, 18:56
Evo Eftimov   Re: Determining number of executors within RDD Wed, 10 Jun, 19:24
Sandy Ryza     Re: Determining number of executors within RDD Wed, 10 Jun, 20:31
Evo Eftimov   Re: Determining number of executors within RDD Wed, 10 Jun, 20:35
Nishkam Ravi     Re: Determining number of executors within RDD Wed, 10 Jun, 21:56
Robert Towne how to clear state in Spark Streaming based on emitting Wed, 10 Jun, 00:36
James Pirz spark-submit does not use hive-site.xml Wed, 10 Jun, 02:19
Cheng Lian   Re: spark-submit does not use hive-site.xml Wed, 10 Jun, 08:17
James Pirz     Re: spark-submit does not use hive-site.xml Wed, 10 Jun, 17:18
Cheng Lian       Re: spark-submit does not use hive-site.xml Wed, 10 Jun, 18:06
Chandrashekhar Kotekar Spark's Scala shell killing itself Wed, 10 Jun, 05:34
Akhil Das   Re: Spark's Scala shell killing itself Wed, 10 Jun, 07:23
mahesht How to use Apache spark mllib Model output in C++ component Wed, 10 Jun, 06:20
Akhil Das   Re: How to use Apache spark mllib Model output in C++ component Wed, 10 Jun, 07:15
Xiangrui Meng     Re: How to use Apache spark mllib Model output in C++ component Wed, 17 Jun, 23:45
homar how to maintain huge dataset while using spark streaming Wed, 10 Jun, 07:53
Re: Met OOM when fetching more than 1,000,000 rows.
Cheng Lian   Re: Met OOM when fetching more than 1,000,000 rows. Wed, 10 Jun, 08:11
Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows.
Cheng Lian   Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows. Wed, 10 Jun, 08:33
Cheng Lian   Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows. Wed, 10 Jun, 08:35
luohui20...@sina.com 回复:Re: Re: Re: How to decrease the time of storing block in memory Wed, 10 Jun, 08:36
bkapukaranov DataFrame.save with SaveMode.Overwrite produces 3x higher data size Wed, 10 Jun, 09:22
bkapukaranov   Re: DataFrame.save with SaveMode.Overwrite produces 3x higher data size Wed, 10 Jun, 10:30
mrm cannot access port 4040 Wed, 10 Jun, 10:21
Himanshu Mehra   Re: cannot access port 4040 Wed, 10 Jun, 10:25
Akhil Das   Re: cannot access port 4040 Wed, 10 Jun, 11:08
mrm   Re: cannot access port 4040 Wed, 10 Jun, 11:17
mrm     Re: cannot access port 4040 Wed, 10 Jun, 11:40
Akhil Das       Re: cannot access port 4040 Wed, 10 Jun, 11:57
mrm       Re: cannot access port 4040 Thu, 11 Jun, 09:07
Re: 回复: Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows.
Cheng Lian   Re: 回复: Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows. Wed, 10 Jun, 11:55
Kostas Kougios spark uses too much memory maybe (binaryFiles() with more than 1 million files in HDFS), groupBy or reduceByKey() Wed, 10 Jun, 12:24
Kostas Kougios   Re: spark uses too much memory maybe (binaryFiles() with more than 1 million files in HDFS), groupBy or reduceByKey() Wed, 10 Jun, 14:13
Kostas Kougios     Re: spark uses too much memory maybe (binaryFiles() with more than 1 million files in HDFS), groupBy or reduceByKey() Wed, 10 Jun, 15:34
Marcelo Vanzin     Re: spark uses too much memory maybe (binaryFiles() with more than 1 million files in HDFS), groupBy or reduceByKey() Wed, 10 Jun, 16:14
Konstantinos Kougios       Re: spark uses too much memory maybe (binaryFiles() with more than 1 million files in HDFS), groupBy or reduceByKey() Thu, 11 Jun, 10:25
Konstantinos Kougios       Re: spark uses too much memory maybe (binaryFiles() with more than 1 million files in HDFS), groupBy or reduceByKey() Thu, 11 Jun, 12:01
Konstantinos Kougios         Re: spark uses too much memory maybe (binaryFiles() with more than 1 million files in HDFS), groupBy or reduceByKey() Thu, 11 Jun, 12:30
Konstantinos Kougios       Re: spark uses too much memory maybe (binaryFiles() with more than 1 million files in HDFS), groupBy or reduceByKey() Thu, 11 Jun, 13:18
Roberto Coluccio [Spark 1.3.1 on YARN on EMR] Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient Wed, 10 Jun, 12:32
Andrew Lee   RE: [Spark 1.3.1 on YARN on EMR] Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient Sat, 20 Jun, 14:23
Bozeman, Christopher   Re: [Spark 1.3.1 on YARN on EMR] Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient Sat, 20 Jun, 17:25
Roberto Coluccio     Re: [Spark 1.3.1 on YARN on EMR] Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient Sat, 20 Jun, 17:53
huangzheng learning rpc about spark core source code Wed, 10 Jun, 12:33
Shixiong Zhu   Re: learning rpc about spark core source code Wed, 10 Jun, 13:04
dgoldenberg Split RDD based on criteria Wed, 10 Jun, 12:56
Chad Urso McDaniel   Re: Split RDD based on criteria Wed, 10 Jun, 16:35
Sean Owen   Re: Split RDD based on criteria Wed, 10 Jun, 16:44
kazeborja Spark standalone mode and kerberized cluster Wed, 10 Jun, 13:19
Akhil Das   Re: Spark standalone mode and kerberized cluster Thu, 11 Jun, 05:47
Steve Loughran     Re: Spark standalone mode and kerberized cluster Thu, 11 Jun, 08:22
Borja Garrido Bear       Re: Spark standalone mode and kerberized cluster Mon, 15 Jun, 14:43
Steve Loughran         Re: Spark standalone mode and kerberized cluster Tue, 16 Jun, 10:10
Borja Garrido Bear           Re: Spark standalone mode and kerberized cluster Tue, 16 Jun, 13:24
Re: PostgreSQL JDBC Classpath Issue
shahab   Re: PostgreSQL JDBC Classpath Issue Wed, 10 Jun, 13:24
Cheng Lian     Re: PostgreSQL JDBC Classpath Issue Wed, 10 Jun, 13:41
Corey Nolet Fully in-memory shuffles Wed, 10 Jun, 14:08
Josh Rosen   Re: Fully in-memory shuffles Wed, 10 Jun, 14:11
Corey Nolet     Re: Fully in-memory shuffles Thu, 11 Jun, 00:06
Patrick Wendell       Re: Fully in-memory shuffles Thu, 11 Jun, 01:17
Corey Nolet         Re: Fully in-memory shuffles Thu, 11 Jun, 03:43
Davies Liu           Re: Fully in-memory shuffles Thu, 11 Jun, 04:50
Patrick Wendell             Re: Fully in-memory shuffles Thu, 11 Jun, 23:33
Mark Hamstra               Re: Fully in-memory shuffles Fri, 12 Jun, 00:01
Bob Corsaro PYTHONPATH on worker nodes Wed, 10 Jun, 15:15
Marcelo Vanzin   Re: PYTHONPATH on worker nodes Wed, 10 Jun, 16:28
Eran Medan Spark not working on windows 7 64 bit Wed, 10 Jun, 15:16
Jörn Franke   Re: Spark not working on windows 7 64 bit Wed, 10 Jun, 16:18
Ashish Nigam spark streaming - checkpointing - looking at old application directory and failure to start streaming context Wed, 10 Jun, 16:14
Akhil Das   Re: spark streaming - checkpointing - looking at old application directory and failure to start streaming context Wed, 10 Jun, 16:18
Ashish Nigam     Re: spark streaming - checkpointing - looking at old application directory and failure to start streaming context Wed, 10 Jun, 16:26
Ashish Nigam       Re: spark streaming - checkpointing - looking at old application directory and failure to start streaming context Thu, 11 Jun, 20:05
Neal Yin How to build spark with Hive 1.x ? Wed, 10 Jun, 16:16
Ted Yu   Re: How to build spark with Hive 1.x ? Wed, 10 Jun, 16:26
Rick Moritz Re: Spark Maven Test error Wed, 10 Jun, 16:39
Shuai Zheng RE: [SPARK-6330] 1.4.0/1.5.0 Bug to access S3 -- AWS Access Key ID and Secret Access Key must be specified as the username or password (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or fs.s3.awsSecretAccessKey properties (respectively) Wed, 10 Jun, 18:38
Ashwin Shankar Problem with pyspark on Docker talking to YARN cluster Wed, 10 Jun, 20:43
Ashwin Shankar   Re: Problem with pyspark on Docker talking to YARN cluster Thu, 11 Jun, 05:09
Re: Efficient way to get top K values per key in (key, value) RDD?
erisa   Re: Efficient way to get top K values per key in (key, value) RDD? Wed, 10 Jun, 20:53
Xiangrui Meng     Re: Efficient way to get top K values per key in (key, value) RDD? Wed, 17 Jun, 23:46
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
Box list
Dec 202124
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137