spark-user mailing list archives: July 2015

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · Next »Thread · Author · Date
barge.nilesh Re: run reduceByKey on huge data in spark Wed, 01 Jul, 00:26
Ted Yu Re: Retrieve hadoop conf object from Python API Wed, 01 Jul, 00:52
Exie 1.4.0 Wed, 01 Jul, 01:20
nkd output folder structure not getting commited and remains as _temporary Wed, 01 Jul, 01:28
Exie Spark 1.4.0: Parquet partitions / folder hierarchy changed from 1.3.1 Wed, 01 Jul, 01:33
yana RE: 1.4.0 Wed, 01 Jul, 01:39
luohui20...@sina.com 回复:Re: got "java.lang.reflect.UndeclaredThrowableException" when running multiply APPs in spark Wed, 01 Jul, 01:58
Eric Pederson Re: Subsecond queries possible? Wed, 01 Jul, 02:29
Exie Re: Spark 1.4.0: read.df() causes excessive IO Wed, 01 Jul, 03:27
Exie Re: s3 bucket access/read file Wed, 01 Jul, 03:31
Exie Re: Spark run errors on Raspberry Pi Wed, 01 Jul, 03:40
Aaron Davidson Re: s3 bucket access/read file Wed, 01 Jul, 03:46
Pooja Jain Issue with parquet write after join (Spark 1.4.0) Wed, 01 Jul, 04:50
Suraj Shetiya Re: Spark Dataframe 1.4 (GroupBy partial match) Wed, 01 Jul, 05:30
Akhil Das Re: Difference between spark-defaults.conf and SparkConf.set Wed, 01 Jul, 06:27
Himanshu Mehra Re: How to stop making Multiple copies in memory when running multiple Spark jobs? Wed, 01 Jul, 06:28
Nirmal Fernando Run multiple Spark jobs concurrently Wed, 01 Jul, 06:31
Akhil Das Re: Issues in reading a CSV file from local file system using spark-shell Wed, 01 Jul, 06:44
Tomer Benyamini question about resource allocation on the spark standalone cluster Wed, 01 Jul, 06:45
Akhil Das Re: output folder structure not getting commited and remains as _temporary Wed, 01 Jul, 07:07
igor.berman upload to s3, UI Total Duration and Sum of Job Durations Wed, 01 Jul, 07:14
Hafiz Mujadid coalesce on dataFrame Wed, 01 Jul, 07:22
Akhil Das Re: Spark run errors on Raspberry Pi Wed, 01 Jul, 07:24
Akhil Das Re: Issue with parquet write after join (Spark 1.4.0) Wed, 01 Jul, 07:36
Spark Enthusiast Can I do Joins across Event Streams ? Wed, 01 Jul, 07:36
SLiZn Liu Re: Can Dependencies Be Resolved on Spark Cluster? Wed, 01 Jul, 07:37
Akhil Das Re: Run multiple Spark jobs concurrently Wed, 01 Jul, 07:38
Akhil Das Re: Can I do Joins across Event Streams ? Wed, 01 Jul, 07:48
Ladle Spark program running infinitely Wed, 01 Jul, 07:55
Nirmal Fernando Re: Run multiple Spark jobs concurrently Wed, 01 Jul, 08:01
prajod.vettiyat...@wipro.com RE: Spark streaming on standalone cluster Wed, 01 Jul, 08:30
Borja Garrido Bear Re: Spark streaming on standalone cluster Wed, 01 Jul, 09:25
Wojciech Pituła Re: Spark streaming on standalone cluster Wed, 01 Jul, 09:45
Ewan Leith RE: coalesce on dataFrame Wed, 01 Jul, 10:01
Olivier Girardot Re: coalesce on dataFrame Wed, 01 Jul, 10:05
Olivier Girardot Re: Check for null in PySpark DataFrame Wed, 01 Jul, 10:07
Steve Loughran Re: s3 bucket access/read file Wed, 01 Jul, 10:48
David Sabater Dinter Issues when saving dataframe in Spark 1.4 with parquet format Wed, 01 Jul, 10:57
Spark Enthusiast Can a Spark Driver Program be a REST Service by itself? Wed, 01 Jul, 11:02
Chaudhary, Umesh Json Dataframe formation and Querying Wed, 01 Jul, 11:45
yana Re: Difference between spark-defaults.conf and SparkConf.set Wed, 01 Jul, 12:27
yana RE: 1.4.0 Wed, 01 Jul, 12:30
Pooja Jain Re: Issue with parquet write after join (Spark 1.4.0) Wed, 01 Jul, 12:42
Arush Kharbanda Re: Can a Spark Driver Program be a REST Service by itself? Wed, 01 Jul, 12:56
Ramprakash Ramamoorthy Illegal access error when initializing SparkConf Wed, 01 Jul, 13:37
Sourav Mazumder Passing name of package in sparkR.init() Wed, 01 Jul, 13:38
Jem Tucker Making Unpersist Lazy Wed, 01 Jul, 14:18
Shushant Arora custom RDD in java Wed, 01 Jul, 14:19
Silvio Fiorito Re: custom RDD in java Wed, 01 Jul, 14:59
ÐΞ...@Ҝ (๏̯͡๏) StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:01
Koert Kuipers Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:11
ÐΞ...@Ҝ (๏̯͡๏) Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:18
Raghavendra Pandey Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:28
Srikanth BroadcastHashJoin when RDD is not cached Wed, 01 Jul, 15:30
Raghavendra Pandey Re: Can a Spark Driver Program be a REST Service by itself? Wed, 01 Jul, 15:31
Raghavendra Pandey Re: Issue with parquet write after join (Spark 1.4.0) Wed, 01 Jul, 15:34
ÐΞ...@Ҝ (๏̯͡๏) Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:43
Raghavendra Pandey Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:46
Aaron Davidson Re: s3 bucket access/read file Wed, 01 Jul, 15:52
ÐΞ...@Ҝ (๏̯͡๏) Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:55
Raghavendra Pandey Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 16:00
Konstantinos Kougios binaryFiles() for 1 million files, too much memory required Wed, 01 Jul, 16:06
Debasish Das Re: Subsecond queries possible? Wed, 01 Jul, 16:47
Stefan Panayotov import errors with Eclipse Scala Wed, 01 Jul, 16:57
Ashish Soni Convert CSV lines to List of Objects Wed, 01 Jul, 17:00
Sourav Mazumder Re: sparkR could not find function "textFile" Wed, 01 Jul, 17:03
Ted Yu Re: import errors with Eclipse Scala Wed, 01 Jul, 17:04
Burak Yavuz Re: coalesce on dataFrame Wed, 01 Jul, 17:04
Alex Gittens Re: breeze.linalg.DenseMatrix not found Wed, 01 Jul, 17:07
Shivaram Venkataraman Re: sparkR could not find function "textFile" Wed, 01 Jul, 17:21
Mick Davies Custom order by in Spark SQL Wed, 01 Jul, 17:25
Laeeq Ahmed spark.streaming.receiver.maxRate Not taking effect Wed, 01 Jul, 17:27
Ted Yu Re: spark.streaming.receiver.maxRate Not taking effect Wed, 01 Jul, 17:32
Amit Assudani Re: How to recover in case user errors in streaming Wed, 01 Jul, 17:35
Alex Gittens Re: Need clarification on spark on cluster set up instruction Wed, 01 Jul, 17:38
Shushant Arora Re: custom RDD in java Wed, 01 Jul, 17:44
Neil Mayo Re: Spark driver using Spark Streaming shows increasing memory/CPU usage Wed, 01 Jul, 17:51
Hafiz Mujadid making dataframe for different types using spark-csv Wed, 01 Jul, 18:03
Shiyao Ma Task InputSize source code location Wed, 01 Jul, 18:04
Ashish Soni BroadCast Multiple DataFrame ( JDBC Tables ) Wed, 01 Jul, 18:14
Stefan Panayotov RE: import errors with Eclipse Scala Wed, 01 Jul, 18:14
Jem Tucker Re: import errors with Eclipse Scala Wed, 01 Jul, 18:20
rshyam Spark Standalone Cluster - Slave not connecting to Master Wed, 01 Jul, 18:35
Stefan Panayotov RE: import errors with Eclipse Scala Wed, 01 Jul, 18:44
Silvio Fiorito Re: custom RDD in java Wed, 01 Jul, 19:00
Michael Armbrust Re: Custom order by in Spark SQL Wed, 01 Jul, 19:10
Michael Armbrust Re: Issue with parquet write after join (Spark 1.4.0) Wed, 01 Jul, 19:12
Michael Armbrust Re: BroadcastHashJoin when RDD is not cached Wed, 01 Jul, 19:13
Michael Armbrust Re: Check for null in PySpark DataFrame Wed, 01 Jul, 19:18
Michael Armbrust Re: Spark Dataframe 1.4 (GroupBy partial match) Wed, 01 Jul, 19:19
Feynman Liang Re: custom RDD in java Wed, 01 Jul, 19:29
Shushant Arora Re: custom RDD in java Wed, 01 Jul, 19:46
Sourav Mazumder Re: sparkR could not find function "textFile" Wed, 01 Jul, 19:49
Feynman Liang Re: custom RDD in java Wed, 01 Jul, 19:52
Galkowski, Jan Use of Apache Spark with R package SNOW, or perhaps Hadoop YARN with same SNOW? Wed, 01 Jul, 19:57
Cheng Lian Re: How to disable parquet schema merging in 1.4? Wed, 01 Jul, 20:13
Neil Mayo Re: Spark driver using Spark Streaming shows increasing memory/CPU usage Wed, 01 Jul, 20:41
Ted Yu Re: Retrieve hadoop conf object from Python API Wed, 01 Jul, 21:22
Krishna Sankar Re: making dataframe for different types using spark-csv Wed, 01 Jul, 22:09
Eric Pederson Re: Subsecond queries possible? Wed, 01 Jul, 23:02
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · Next »Thread · Author · Date
Box list
Aug 2019139
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137