spark-user mailing list archives: July 2015

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · Next »Thread · Author · Date
Re: run reduceByKey on huge data in spark
barge.nilesh   Re: run reduceByKey on huge data in spark Wed, 01 Jul, 00:26
Re: Retrieve hadoop conf object from Python API
Ted Yu   Re: Retrieve hadoop conf object from Python API Wed, 01 Jul, 00:52
Ted Yu     Re: Retrieve hadoop conf object from Python API Wed, 01 Jul, 21:22
Exie 1.4.0 Wed, 01 Jul, 01:20
yana   RE: 1.4.0 Wed, 01 Jul, 01:39
yana   RE: 1.4.0 Wed, 01 Jul, 12:30
nkd output folder structure not getting commited and remains as _temporary Wed, 01 Jul, 01:28
Akhil Das   Re: output folder structure not getting commited and remains as _temporary Wed, 01 Jul, 07:07
Exie Spark 1.4.0: Parquet partitions / folder hierarchy changed from 1.3.1 Wed, 01 Jul, 01:33
luohui20...@sina.com 回复:Re: got "java.lang.reflect.UndeclaredThrowableException" when running multiply APPs in spark Wed, 01 Jul, 01:58
Re: Subsecond queries possible?
Eric Pederson   Re: Subsecond queries possible? Wed, 01 Jul, 02:29
Debasish Das     Re: Subsecond queries possible? Wed, 01 Jul, 16:47
Eric Pederson       Re: Subsecond queries possible? Wed, 01 Jul, 23:02
Re: Spark 1.4.0: read.df() causes excessive IO
Exie   Re: Spark 1.4.0: read.df() causes excessive IO Wed, 01 Jul, 03:27
Re: s3 bucket access/read file
Exie   Re: s3 bucket access/read file Wed, 01 Jul, 03:31
Aaron Davidson     Re: s3 bucket access/read file Wed, 01 Jul, 03:46
Steve Loughran       Re: s3 bucket access/read file Wed, 01 Jul, 10:48
Aaron Davidson         Re: s3 bucket access/read file Wed, 01 Jul, 15:52
Re: Spark run errors on Raspberry Pi
Exie   Re: Spark run errors on Raspberry Pi Wed, 01 Jul, 03:40
Akhil Das     Re: Spark run errors on Raspberry Pi Wed, 01 Jul, 07:24
Pooja Jain Issue with parquet write after join (Spark 1.4.0) Wed, 01 Jul, 04:50
Akhil Das   Re: Issue with parquet write after join (Spark 1.4.0) Wed, 01 Jul, 07:36
Pooja Jain     Re: Issue with parquet write after join (Spark 1.4.0) Wed, 01 Jul, 12:42
Raghavendra Pandey       Re: Issue with parquet write after join (Spark 1.4.0) Wed, 01 Jul, 15:34
Michael Armbrust       Re: Issue with parquet write after join (Spark 1.4.0) Wed, 01 Jul, 19:12
Re: Spark Dataframe 1.4 (GroupBy partial match)
Suraj Shetiya   Re: Spark Dataframe 1.4 (GroupBy partial match) Wed, 01 Jul, 05:30
Michael Armbrust     Re: Spark Dataframe 1.4 (GroupBy partial match) Wed, 01 Jul, 19:19
Suraj Shetiya       Re: Spark Dataframe 1.4 (GroupBy partial match) Thu, 02 Jul, 09:47
Salih Oztop         Re: Spark Dataframe 1.4 (GroupBy partial match) Thu, 02 Jul, 20:32
Suraj Shetiya           Re: Spark Dataframe 1.4 (GroupBy partial match) Fri, 03 Jul, 06:12
Re: Difference between spark-defaults.conf and SparkConf.set
Akhil Das   Re: Difference between spark-defaults.conf and SparkConf.set Wed, 01 Jul, 06:27
yana   Re: Difference between spark-defaults.conf and SparkConf.set Wed, 01 Jul, 12:27
Re: How to stop making Multiple copies in memory when running multiple Spark jobs?
Himanshu Mehra   Re: How to stop making Multiple copies in memory when running multiple Spark jobs? Wed, 01 Jul, 06:28
Haoyuan Li     Re: How to stop making Multiple copies in memory when running multiple Spark jobs? Sun, 05 Jul, 18:12
Nirmal Fernando Run multiple Spark jobs concurrently Wed, 01 Jul, 06:31
Akhil Das   Re: Run multiple Spark jobs concurrently Wed, 01 Jul, 07:38
Nirmal Fernando     Re: Run multiple Spark jobs concurrently Wed, 01 Jul, 08:01
Re: Issues in reading a CSV file from local file system using spark-shell
Akhil Das   Re: Issues in reading a CSV file from local file system using spark-shell Wed, 01 Jul, 06:44
Tomer Benyamini question about resource allocation on the spark standalone cluster Wed, 01 Jul, 06:45
igor.berman upload to s3, UI Total Duration and Sum of Job Durations Wed, 01 Jul, 07:14
Hafiz Mujadid coalesce on dataFrame Wed, 01 Jul, 07:22
Ewan Leith   RE: coalesce on dataFrame Wed, 01 Jul, 10:01
Olivier Girardot     Re: coalesce on dataFrame Wed, 01 Jul, 10:05
Burak Yavuz       Re: coalesce on dataFrame Wed, 01 Jul, 17:04
Spark Enthusiast Can I do Joins across Event Streams ? Wed, 01 Jul, 07:36
Akhil Das   Re: Can I do Joins across Event Streams ? Wed, 01 Jul, 07:48
Re: Can Dependencies Be Resolved on Spark Cluster?
SLiZn Liu   Re: Can Dependencies Be Resolved on Spark Cluster? Wed, 01 Jul, 07:37
Ladle Spark program running infinitely Wed, 01 Jul, 07:55
RE: Spark streaming on standalone cluster
prajod.vettiyat...@wipro.com   RE: Spark streaming on standalone cluster Wed, 01 Jul, 08:30
Borja Garrido Bear     Re: Spark streaming on standalone cluster Wed, 01 Jul, 09:25
Wojciech Pituła       Re: Spark streaming on standalone cluster Wed, 01 Jul, 09:45
Re: Check for null in PySpark DataFrame
Olivier Girardot   Re: Check for null in PySpark DataFrame Wed, 01 Jul, 10:07
Michael Armbrust     Re: Check for null in PySpark DataFrame Wed, 01 Jul, 19:18
Pedro Rodriguez       Re: Check for null in PySpark DataFrame Thu, 02 Jul, 18:16
David Sabater Dinter Issues when saving dataframe in Spark 1.4 with parquet format Wed, 01 Jul, 10:57
Spark Enthusiast Can a Spark Driver Program be a REST Service by itself? Wed, 01 Jul, 11:02
Arush Kharbanda   Re: Can a Spark Driver Program be a REST Service by itself? Wed, 01 Jul, 12:56
Raghavendra Pandey     Re: Can a Spark Driver Program be a REST Service by itself? Wed, 01 Jul, 15:31
Chaudhary, Umesh Json Dataframe formation and Querying Wed, 01 Jul, 11:45
Ramprakash Ramamoorthy Illegal access error when initializing SparkConf Wed, 01 Jul, 13:37
Ramprakash Ramamoorthy   Re: Illegal access error when initializing SparkConf Thu, 02 Jul, 06:17
Sourav Mazumder Passing name of package in sparkR.init() Wed, 01 Jul, 13:38
Jem Tucker Making Unpersist Lazy Wed, 01 Jul, 14:18
Akhil Das   Re: Making Unpersist Lazy Thu, 02 Jul, 07:18
Jem Tucker     Re: Making Unpersist Lazy Thu, 02 Jul, 08:05
Ganelin, Ilya       RE: Making Unpersist Lazy Thu, 02 Jul, 11:50
Shushant Arora custom RDD in java Wed, 01 Jul, 14:19
Silvio Fiorito   Re: custom RDD in java Wed, 01 Jul, 14:59
Shushant Arora     Re: custom RDD in java Wed, 01 Jul, 17:44
Silvio Fiorito       Re: custom RDD in java Wed, 01 Jul, 19:00
Feynman Liang         Re: custom RDD in java Wed, 01 Jul, 19:29
Shushant Arora           Re: custom RDD in java Wed, 01 Jul, 19:46
Feynman Liang             Re: custom RDD in java Wed, 01 Jul, 19:52
ÐΞ...@Ҝ (๏̯͡๏) StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:01
Koert Kuipers   Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:11
ÐΞ...@Ҝ (๏̯͡๏)     Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:18
Raghavendra Pandey       Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:28
ÐΞ...@Ҝ (๏̯͡๏)         Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:43
Raghavendra Pandey           Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:46
ÐΞ...@Ҝ (๏̯͡๏)             Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 15:55
Raghavendra Pandey               Re: StorageLevel.MEMORY_AND_DISK_SER Wed, 01 Jul, 16:00
Srikanth BroadcastHashJoin when RDD is not cached Wed, 01 Jul, 15:30
Michael Armbrust   Re: BroadcastHashJoin when RDD is not cached Wed, 01 Jul, 19:13
Srikanth     Re: BroadcastHashJoin when RDD is not cached Thu, 02 Jul, 11:55
binaryFiles() for 1 million files, too much memory required
Konstantinos Kougios   binaryFiles() for 1 million files, too much memory required Wed, 01 Jul, 16:06
Kostas Kougios   binaryFiles() for 1 million files, too much memory required Thu, 02 Jul, 15:23
Stefan Panayotov import errors with Eclipse Scala Wed, 01 Jul, 16:57
Ted Yu   Re: import errors with Eclipse Scala Wed, 01 Jul, 17:04
Stefan Panayotov     RE: import errors with Eclipse Scala Wed, 01 Jul, 18:44
Stefan Panayotov   RE: import errors with Eclipse Scala Wed, 01 Jul, 18:14
Jem Tucker     Re: import errors with Eclipse Scala Wed, 01 Jul, 18:20
Ashish Soni Convert CSV lines to List of Objects Wed, 01 Jul, 17:00
Akhil Das   Re: Convert CSV lines to List of Objects Thu, 02 Jul, 07:23
Re: sparkR could not find function "textFile"
Sourav Mazumder   Re: sparkR could not find function "textFile" Wed, 01 Jul, 17:03
Shivaram Venkataraman     Re: sparkR could not find function "textFile" Wed, 01 Jul, 17:21
Sourav Mazumder       Re: sparkR could not find function "textFile" Wed, 01 Jul, 19:49
Re: breeze.linalg.DenseMatrix not found
Alex Gittens   Re: breeze.linalg.DenseMatrix not found Wed, 01 Jul, 17:07
Mick Davies Custom order by in Spark SQL Wed, 01 Jul, 17:25
Michael Armbrust   Re: Custom order by in Spark SQL Wed, 01 Jul, 19:10
Laeeq Ahmed spark.streaming.receiver.maxRate Not taking effect Wed, 01 Jul, 17:27
Ted Yu   Re: spark.streaming.receiver.maxRate Not taking effect Wed, 01 Jul, 17:32
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · Next »Thread · Author · Date
Box list
May 2019283
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137