spark-user mailing list archives: November 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · Next »Thread · Author · Date
very slow parquet file write
Rok Roskar   very slow parquet file write Thu, 05 Nov, 10:08
Davies Liu     Re: very slow parquet file write Fri, 13 Nov, 23:38
Rok Roskar       Re: very slow parquet file write Fri, 13 Nov, 23:50
Sabarish Sasidharan         Re: very slow parquet file write Sat, 14 Nov, 15:49
rok   very slow parquet file write Thu, 05 Nov, 23:34
Cheng Lian     Re: very slow parquet file write Fri, 06 Nov, 08:26
Rok Roskar       Re: very slow parquet file write Fri, 06 Nov, 14:53
Cheng Lian         Re: very slow parquet file write Fri, 06 Nov, 15:41
Davies Liu         Re: very slow parquet file write Fri, 13 Nov, 18:42
Jörn Franke     Re: very slow parquet file write Fri, 06 Nov, 08:51
aecc Spark task hangs infinitely when accessing S3 from AWS Thu, 05 Nov, 10:39
aecc   Re: Spark task hangs infinitely when accessing S3 from AWS Mon, 09 Nov, 09:34
aecc     Re: Spark task hangs infinitely when accessing S3 from AWS Thu, 12 Nov, 08:38
Michael Cutler       Re: Spark task hangs infinitely when accessing S3 from AWS Thu, 12 Nov, 09:58
Alessandro Chacón         Re: Spark task hangs infinitely when accessing S3 from AWS Thu, 12 Nov, 10:59
aecc       Re: Spark task hangs infinitely when accessing S3 from AWS Thu, 12 Nov, 11:00
Fwd: UnresolvedException - lag, window
Jiří Syrový   Fwd: UnresolvedException - lag, window Thu, 05 Nov, 11:13
Yogesh Vyas JMX with Spark Thu, 05 Nov, 12:08
Romi Kuntsman   Re: JMX with Spark Thu, 05 Nov, 12:24
Yogesh Vyas     Re: JMX with Spark Thu, 05 Nov, 13:20
Liu shen   RE: JMX with Spark Thu, 05 Nov, 13:44
Re: Spark standalone: zookeeper timeout configuration
yueqianzhu   Re: Spark standalone: zookeeper timeout configuration Thu, 05 Nov, 12:11
Priya Ch Subtract on rdd2 is throwing below exception Thu, 05 Nov, 13:32
Yana Kadiyska   Re: Subtract on rdd2 is throwing below exception Thu, 05 Nov, 17:42
Kay-Uwe Moosheimer How to use data from Database and reload every hour Thu, 05 Nov, 13:33
Adrian Tanase   Re: How to use data from Database and reload every hour Thu, 05 Nov, 14:43
Sabarish Sasidharan   Re: How to use data from Database and reload every hour Fri, 06 Nov, 01:48
Madabhattula Rajesh Kumar Spark sql jdbc fails for Oracle NUMBER type columns Thu, 05 Nov, 13:51
Richard Hillegas   Re: Spark sql jdbc fails for Oracle NUMBER type columns Thu, 05 Nov, 17:16
Richard Hillegas     Re: Spark sql jdbc fails for Oracle NUMBER type columns Thu, 05 Nov, 17:27
Madabhattula Rajesh Kumar       Re: Spark sql jdbc fails for Oracle NUMBER type columns Fri, 06 Nov, 02:35
Richard Hillegas         Re: Spark sql jdbc fails for Oracle NUMBER type columns Fri, 06 Nov, 16:40
Madabhattula Rajesh Kumar           Re: Spark sql jdbc fails for Oracle NUMBER type columns Fri, 06 Nov, 17:02
cartesian in the loop, runtime grows
Faerman Evgeniy   cartesian in the loop, runtime grows Thu, 05 Nov, 15:47
efa   cartesian in the loop, runtime grows Fri, 06 Nov, 08:40
Krzysztof Zarzycki Spark using Yarn timelineserver - High CPU usage Thu, 05 Nov, 15:57
Christian Spark EC2 script on Large clusters Thu, 05 Nov, 16:12
Shivaram Venkataraman   Re: Spark EC2 script on Large clusters Thu, 05 Nov, 17:30
Nicholas Chammas     Re: Spark EC2 script on Large clusters Thu, 05 Nov, 17:48
Jonathan Kelly       Re: Spark EC2 script on Large clusters Thu, 05 Nov, 18:30
Christian         Re: Spark EC2 script on Large clusters Thu, 05 Nov, 18:50
Christian           Re: Spark EC2 script on Large clusters Thu, 05 Nov, 18:51
Sabarish Sasidharan             Re: Spark EC2 script on Large clusters Fri, 06 Nov, 02:02
Jerry Lam               Re: Spark EC2 script on Large clusters Fri, 06 Nov, 03:01
Sabarish Sasidharan                 Re: Spark EC2 script on Large clusters Fri, 06 Nov, 03:07
Yana Kadiyska 101 question on external metastore Thu, 05 Nov, 17:32
Re: Building scaladoc using "build/sbt unidoc" failure
vectorijk   Re: Building scaladoc using "build/sbt unidoc" failure Thu, 05 Nov, 18:12
Jaydeep Vishwakarma Spark SQL supports operating on a thrift data sources Thu, 05 Nov, 19:21
Michael Armbrust   Re: Spark SQL supports operating on a thrift data sources Thu, 05 Nov, 20:25
Bryan Jeffrey Spark Dynamic Partitioning Bug Thu, 05 Nov, 21:15
Andrés Ivaldi Spark Analytics Thu, 05 Nov, 21:38
Hster Geguri Kinesis connection timeout setting on Spark Streaming Kinesis ASL Thu, 05 Nov, 22:13
Re: Spark SQL "SELECT ... LIMIT" scans the entire Hive table?
Jon Gregg   Re: Spark SQL "SELECT ... LIMIT" scans the entire Hive table? Thu, 05 Nov, 23:02
Joey Paskhay Guava ClassLoading Issue When Using Different Hive Metastore Version Thu, 05 Nov, 23:41
Marcelo Vanzin   Re: Guava ClassLoading Issue When Using Different Hive Metastore Version Thu, 05 Nov, 23:51
Michael Armbrust     Re: Guava ClassLoading Issue When Using Different Hive Metastore Version Fri, 06 Nov, 01:08
أنس الليثي Spark Slave always fails to connect to master Thu, 05 Nov, 23:42
Deepak Sharma Spark RDD cache persistence Fri, 06 Nov, 01:17
Christian   Re: Spark RDD cache persistence Fri, 06 Nov, 03:04
Deepak Sharma     Re: Spark RDD cache persistence Fri, 06 Nov, 04:21
Christian       Re: Spark RDD cache persistence Fri, 06 Nov, 05:50
r7raul1...@163.com         Re: Re: Spark RDD cache persistence Fri, 06 Nov, 05:56
Deenar Toraskar           Re: Re: Spark RDD cache persistence Fri, 06 Nov, 06:29
Khaled Ammar "Master: got disassociated, removing it." Fri, 06 Nov, 05:18
Re: Failed to save RDD as text file to local file system
Hitoshi Ozawa   Re: Failed to save RDD as text file to local file system Fri, 06 Nov, 05:36
Rishabh Bhardwaj Unable to register UDF with StructType Fri, 06 Nov, 05:53
Michael Armbrust   Re: Unable to register UDF with StructType Fri, 06 Nov, 06:50
Rishabh Bhardwaj     Re: Unable to register UDF with StructType Fri, 06 Nov, 09:28
Michael Armbrust       Re: Unable to register UDF with StructType Fri, 06 Nov, 21:06
Terry Hoo [Streaming] Long time to catch up when streaming application restarts from checkpoint Fri, 06 Nov, 08:14
Jacek Laskowski ResultStage's parent stages only ShuffleMapStages? Fri, 06 Nov, 08:15
Jeff Zhang   Re: ResultStage's parent stages only ShuffleMapStages? Fri, 06 Nov, 08:36
Todd [Spark R]could not allocate memory (2048 Mb) in C function 'R_AllocStringBuffer' Fri, 06 Nov, 09:00
Sun, Rui   RE: [Spark R]could not allocate memory (2048 Mb) in C function 'R_AllocStringBuffer' Fri, 06 Nov, 12:02
Re: Dynamic Allocation & Spark Streaming
Kyle Lin   Re: Dynamic Allocation & Spark Streaming Fri, 06 Nov, 09:48
Adrian Tanase     Re: Dynamic Allocation & Spark Streaming Fri, 06 Nov, 10:15
Kathi Stutz Checkpointing an InputDStream from Kafka Fri, 06 Nov, 09:59
Cody Koeninger   Re: Checkpointing an InputDStream from Kafka Fri, 06 Nov, 14:49
Sandip Mehta     Re: Checkpointing an InputDStream from Kafka Sun, 08 Nov, 03:53
Re: Get complete row with latest timestamp after a groupBy?
bghit   Re: Get complete row with latest timestamp after a groupBy? Fri, 06 Nov, 10:07
bghit     Re: Get complete row with latest timestamp after a groupBy? Fri, 06 Nov, 10:42
mpals Spark Streaming : minimum cores for a Receiver Fri, 06 Nov, 10:42
Gideon   Re: Spark Streaming : minimum cores for a Receiver Sun, 08 Nov, 07:42
Iker Perez de Albeniz Serializers problems maping RDDs to objects again Fri, 06 Nov, 12:44
Iker Perez de Albeniz   Re: Serializers problems maping RDDs to objects again Fri, 06 Nov, 14:10
TheGeorge1918 . spark 1.5.0 mllib lda eats up all the disk space Fri, 06 Nov, 14:43
Dhaval Patel [sparkR] Any insight on java.lang.OutOfMemoryError: GC overhead limit exceeded Fri, 06 Nov, 16:26
Sun, Rui   RE: [sparkR] Any insight on java.lang.OutOfMemoryError: GC overhead limit exceeded Sat, 07 Nov, 08:02
Wei Chen Is there anyway to do partition discovery without 'field=' in folder names? Fri, 06 Nov, 16:44
Jerry Lam [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 16:53
Ted Yu   Re: [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 17:12
Jerry Lam     Re: [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 17:18
Jerry Lam     Re: [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 18:43
Zhan Zhang       Re: [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 22:28
Jerry Lam         Re: [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 22:40
Zhan Zhang           Re: [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 22:50
Ted Yu             Re: [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 22:53
Jerry Lam               Re: [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 23:01
Zhan Zhang                 Re: [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 23:08
Zhan Zhang               Re: [Spark-SQL]: Disable HiveContext from instantiating in spark-shell Fri, 06 Nov, 23:02
Re: creating a distributed index
swetha kasireddy   Re: creating a distributed index Fri, 06 Nov, 17:02
Hien Luu Spark Streaming updateStateByKey Implementation Fri, 06 Nov, 17:25
Zoltán Zvara   Re: Spark Streaming updateStateByKey Implementation Sun, 08 Nov, 10:42
Hien Luu     Re: Spark Streaming updateStateByKey Implementation Mon, 09 Nov, 17:30
Anthony Rose Spark SQL 'explode' command failing on AWS EC2 but succeeding locally Fri, 06 Nov, 18:27
Kayode Odeyemi Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher Fri, 06 Nov, 21:32
Ted Yu   Re: Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher Fri, 06 Nov, 21:46
Kayode Odeyemi     Re: Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher Fri, 06 Nov, 23:27
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · Next »Thread · Author · Date
Box list
Dec 20216
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137