spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From marylucy <qaz163wsx_...@hotmail.com>
Subject Re: How to show RDD size
Date Mon, 20 Oct 2014 14:13:20 GMT
thank you for your reply!
is unpersist operation lazy?if yes,how to decrease memory size as quickly as possible

> 在 Oct 20, 2014,21:26,"Nicholas Chammas" <nicholas.chammas@gmail.com> 写道:
> 
> I believe it won't show up there until you trigger an action that causes the RDD to actually
be cached. Remember that certain operations in Spark are lazy, and caching is one of them.
> 
> Nick
> 
>> On Mon, Oct 20, 2014 at 9:19 AM, marylucy <qaz163wsx_001@hotmail.com> wrote:
>> in spark-shell,I do in follows
>>     val input = sc.textfile("hdfs://192.168.1.10/people/testinput/")
>>     input.cache()
>> 
>> In webui,I cannot see any rdd in storage tab.can anyone tell me how to show rdd size?thank
you
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
> 
Mime
View raw message