spark-user mailing list archives: November 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · Next »Thread · Author · Date
Khaled Ammar What does "write time" means exactly in Spark UI? Wed, 04 Nov, 06:21
vimal dinakaran Checkpoint not working after driver restart Wed, 04 Nov, 06:57
vimal dinakaran   Re: Checkpoint not working after driver restart Sat, 07 Nov, 10:12
gen tang dataframe slow down with tungsten turn on Wed, 04 Nov, 07:54
Rick Moritz   Re: dataframe slow down with tungsten turn on Wed, 04 Nov, 08:05
gen tang     Re: dataframe slow down with tungsten turn on Wed, 04 Nov, 08:33
Wojciech Pituła Dynamic (de)allocation with Spark Streaming Wed, 04 Nov, 08:05
牛兆捷 Codegen In Shuffle Wed, 04 Nov, 08:21
Reynold Xin   Re: Codegen In Shuffle Wed, 04 Nov, 08:25
牛兆捷     Re: Codegen In Shuffle Wed, 04 Nov, 13:36
Zhiliang Zhu spark filter function Wed, 04 Nov, 08:34
Hitoshi Ozawa Running Apache Spark 1.5.1 on console2 Wed, 04 Nov, 08:40
amit tewari Avoid RDD.saveAsTextFile() generating empty part-* and .crc files Wed, 04 Nov, 10:05
Adrian Tanase Custom application.conf on spark executor nodes? Wed, 04 Nov, 12:39
Mustafa Elbehery SparkSQL JDBC to PostGIS Wed, 04 Nov, 12:46
Stefano Baghino   Re: SparkSQL JDBC to PostGIS Wed, 04 Nov, 12:50
Mustafa Elbehery     Re: SparkSQL JDBC to PostGIS Thu, 05 Nov, 09:27
Re: Parsing a large XML file using Spark
Jin   Re: Parsing a large XML file using Spark Wed, 04 Nov, 12:50
Priya Ch Allow multiple SparkContexts in Unit Testing Wed, 04 Nov, 12:59
Ted Yu   Re: Allow multiple SparkContexts in Unit Testing Wed, 04 Nov, 14:49
Bryan Jeffrey     Re: Allow multiple SparkContexts in Unit Testing Wed, 04 Nov, 19:06
Priya Ch       Re: Allow multiple SparkContexts in Unit Testing Thu, 05 Nov, 06:36
Tóth Zoltán Looking for the method executors uses to write to HDFS Wed, 04 Nov, 13:11
Reynold Xin   Re: Looking for the method executors uses to write to HDFS Fri, 06 Nov, 16:42
Praveen Chundi Distributing Python code packaged as tar balls Wed, 04 Nov, 13:40
Davies Liu   Re: Distributing Python code packaged as tar balls Fri, 13 Nov, 23:40
Praveen Chundi     Re: Distributing Python code packaged as tar balls Tue, 17 Nov, 10:26
Problem using BlockMatrix.add
Kareem Sorathia   Problem using BlockMatrix.add Wed, 04 Nov, 15:22
ksorat   Problem using BlockMatrix.add Wed, 04 Nov, 15:55
Spark 1.5.1 Dynamic Resource Allocation
tstewart   Spark 1.5.1 Dynamic Resource Allocation Wed, 04 Nov, 16:10
tstewart     Re: Spark 1.5.1 Dynamic Resource Allocation Wed, 04 Nov, 20:19
Akhil Das   Re: Spark 1.5.1 Dynamic Resource Allocation Mon, 09 Nov, 14:08
Jonathan Kelly     Re: Spark 1.5.1 Dynamic Resource Allocation Mon, 09 Nov, 16:19
Andrew Or       Re: Spark 1.5.1 Dynamic Resource Allocation Mon, 09 Nov, 18:46
Bryan Jeffrey Cassandra via SparkSQL/Hive JDBC Wed, 04 Nov, 16:16
Bryan   RE: Cassandra via SparkSQL/Hive JDBC Wed, 11 Nov, 03:42
Mohammed Guller     RE: Cassandra via SparkSQL/Hive JDBC Thu, 12 Nov, 02:34
Bryan Jeffrey       Re: Cassandra via SparkSQL/Hive JDBC Thu, 12 Nov, 17:11
Mohammed Guller         RE: Cassandra via SparkSQL/Hive JDBC Thu, 12 Nov, 17:20
Bryan Jeffrey           Re: Cassandra via SparkSQL/Hive JDBC Thu, 12 Nov, 17:54
Bryan Jeffrey             Re: Cassandra via SparkSQL/Hive JDBC Thu, 12 Nov, 18:13
Bryan Jeffrey               Re: Cassandra via SparkSQL/Hive JDBC Thu, 12 Nov, 18:26
Mohammed Guller                 RE: Cassandra via SparkSQL/Hive JDBC Thu, 12 Nov, 18:57
Bryan Jeffrey                   Re: Cassandra via SparkSQL/Hive JDBC Thu, 12 Nov, 19:19
Mohammed Guller                     RE: Cassandra via SparkSQL/Hive JDBC Thu, 12 Nov, 19:35
java8964   RE: Cassandra via SparkSQL/Hive JDBC Wed, 11 Nov, 14:51
PHELIPOT, REMY Spark driver, Docker, and Mesos Wed, 04 Nov, 16:24
Timothy Chen   Re: Spark driver, Docker, and Mesos Wed, 04 Nov, 17:20
Aliaksei Tsyvunchyk DataFrame.toJavaRDD cause fetching data to driver, is it expected ? Wed, 04 Nov, 16:51
Romi Kuntsman   Re: DataFrame.toJavaRDD cause fetching data to driver, is it expected ? Wed, 04 Nov, 17:34
Aliaksei Tsyvunchyk     Re: DataFrame.toJavaRDD cause fetching data to driver, is it expected ? Wed, 04 Nov, 17:54
Romi Kuntsman       Re: DataFrame.toJavaRDD cause fetching data to driver, is it expected ? Wed, 04 Nov, 18:05
Aliaksei Tsyvunchyk         Re: DataFrame.toJavaRDD cause fetching data to driver, is it expected ? Wed, 04 Nov, 18:39
Nisrina Luthfiyati Is the resources specified in configuration shared by all jobs? Wed, 04 Nov, 17:24
Marcelo Vanzin   Re: Is the resources specified in configuration shared by all jobs? Wed, 04 Nov, 17:32
Sandy Ryza   Re: Is the resources specified in configuration shared by all jobs? Wed, 04 Nov, 17:32
Nisrina Luthfiyati     Re: Is the resources specified in configuration shared by all jobs? Wed, 04 Nov, 18:48
Re: Prevent possible out of memory when using read/union
Sujit Pal   Re: Prevent possible out of memory when using read/union Wed, 04 Nov, 18:03
Kayode Odeyemi SPARK_SSH_FOREGROUND format Wed, 04 Nov, 18:36
Kayode Odeyemi Executor app-20151104202102-0000 finished with state EXITED Wed, 04 Nov, 18:47
Ted Yu   Re: Executor app-20151104202102-0000 finished with state EXITED Wed, 04 Nov, 19:04
Kayode Odeyemi     Re: Executor app-20151104202102-0000 finished with state EXITED Wed, 04 Nov, 19:08
Ted Yu       Re: Executor app-20151104202102-0000 finished with state EXITED Wed, 04 Nov, 19:28
Kayode Odeyemi         Re: Executor app-20151104202102-0000 finished with state EXITED Wed, 04 Nov, 19:53
Shuai Zheng [Spark 1.5]: Exception in thread "broadcast-hash-join-2" java.lang.OutOfMemoryError: Java heap space Wed, 04 Nov, 20:21
pratik khadloya PairRDD from SQL Wed, 04 Nov, 20:44
Stéphane Verlet   Re: PairRDD from SQL Wed, 04 Nov, 23:06
Shuai Zheng RE: [Spark 1.5]: Exception in thread "broadcast-hash-join-2" java.lang.OutOfMemoryError: Java heap space -- Work in 1.4, but 1.5 doesn't Wed, 04 Nov, 22:55
swetha Efficient approach to store an RDD as a file in HDFS and read it back as an RDD? Wed, 04 Nov, 23:09
Stefano Baghino   Re: Efficient approach to store an RDD as a file in HDFS and read it back as an RDD? Thu, 05 Nov, 07:52
swetha kasireddy     Re: Efficient approach to store an RDD as a file in HDFS and read it back as an RDD? Thu, 05 Nov, 17:10
Igor Berman   Re: Efficient approach to store an RDD as a file in HDFS and read it back as an RDD? Thu, 05 Nov, 18:02
swetha kasireddy     Re: Efficient approach to store an RDD as a file in HDFS and read it back as an RDD? Thu, 05 Nov, 19:13
Igor Berman       Re: Efficient approach to store an RDD as a file in HDFS and read it back as an RDD? Thu, 05 Nov, 20:48
swetha kasireddy         Re: Efficient approach to store an RDD as a file in HDFS and read it back as an RDD? Thu, 05 Nov, 22:14
swetha kasireddy           Re: Efficient approach to store an RDD as a file in HDFS and read it back as an RDD? Thu, 05 Nov, 22:46
Kayode Odeyemi Futures timed out after [120 seconds]. Wed, 04 Nov, 23:53
surbhi.mungre ExecutorId in JAVA_OPTS Wed, 04 Nov, 23:55
William Li Memory are not used according to setting Wed, 04 Nov, 23:55
Shixiong Zhu   Re: Memory are not used according to setting Thu, 05 Nov, 00:45
Cassa L Protobuff 3.0 for Spark Thu, 05 Nov, 00:07
Lan Jiang   Re: Protobuff 3.0 for Spark Thu, 05 Nov, 00:12
Steve Loughran     Re: Protobuff 3.0 for Spark Thu, 05 Nov, 10:43
Lan Jiang       Re: Protobuff 3.0 for Spark Mon, 09 Nov, 19:28
Koert Kuipers         Re: Protobuff 3.0 for Spark Mon, 09 Nov, 20:30
swetha How to unpersist a DStream in Spark Streaming Thu, 05 Nov, 01:03
swetha kasireddy   Re: How to unpersist a DStream in Spark Streaming Thu, 05 Nov, 07:13
Saisai Shao     Re: How to unpersist a DStream in Spark Streaming Thu, 05 Nov, 07:54
swetha kasireddy       Re: How to unpersist a DStream in Spark Streaming Thu, 05 Nov, 17:12
Tathagata Das         Re: How to unpersist a DStream in Spark Streaming Fri, 06 Nov, 07:44
Adrian Tanase         Re: How to unpersist a DStream in Spark Streaming Fri, 06 Nov, 09:28
Yashwanth Kumar   Re: How to unpersist a DStream in Spark Streaming Thu, 05 Nov, 07:52
Andy Davidson how to run RStudio or RStudio Server on ec2 cluster? Thu, 05 Nov, 01:11
Shivaram Venkataraman   Re: how to run RStudio or RStudio Server on ec2 cluster? Thu, 05 Nov, 01:37
Dogtail L Question about Spark shuffle read size Thu, 05 Nov, 01:33
Younes Naguib Spark reading from S3 getting very slow Thu, 05 Nov, 02:03
Steve Loughran   Re: Spark reading from S3 getting very slow Thu, 05 Nov, 10:44
ZhuGe streaming+sql with block has been removed error Thu, 05 Nov, 08:27
danilo Scheduling Spark process Thu, 05 Nov, 08:48
Adrian Tanase   Re: Scheduling Spark process Thu, 05 Nov, 09:43
Danilo Rizzo     Re: Scheduling Spark process Thu, 05 Nov, 10:52
Hitoshi Ozawa   Re: Scheduling Spark process Mon, 09 Nov, 02:25
千成徳 DataFrame equality does not working in 1.5.1 Thu, 05 Nov, 09:12
Yin Huai   Re: DataFrame equality does not working in 1.5.1 Thu, 05 Nov, 20:27
Seongduk Cheon     Re: DataFrame equality does not working in 1.5.1 Fri, 06 Nov, 01:14
Seongduk Cheon       Re: Fwd: Re: DataFrame equality does not working in 1.5.1 Fri, 06 Nov, 12:49
Michael Armbrust         Re: Fwd: Re: DataFrame equality does not working in 1.5.1 Fri, 06 Nov, 21:05
Michael Armbrust           Re: Fwd: Re: DataFrame equality does not working in 1.5.1 Fri, 06 Nov, 21:13
Seongduk Cheon             Re: Fwd: Re: DataFrame equality does not working in 1.5.1 Sat, 07 Nov, 04:06
patcharee How to run parallel on each DataFrame group Thu, 05 Nov, 09:40
Balachandar R.A. converting categorical values in csv file to numerical values Thu, 05 Nov, 09:54
tog   Re: converting categorical values in csv file to numerical values Thu, 05 Nov, 13:20
Balachandar R.A.     Re: converting categorical values in csv file to numerical values Fri, 06 Nov, 04:22
tog       Re: converting categorical values in csv file to numerical values Fri, 06 Nov, 06:28
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · Next »Thread · Author · Date
Box list
Dec 20214
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137