spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raghavendra Pandey <raghavendra.pan...@gmail.com>
Subject Re: How to list all dataframes and RDDs available in current session?
Date Sat, 22 Aug 2015 03:45:25 GMT
You get the list of all the persistet rdd using spark context...
On Aug 21, 2015 12:06 AM, "Rishitesh Mishra" <rishi80.mishra@gmail.com>
wrote:

> I am not sure if you can view all RDDs in a session. Tables are maintained
> in a catalogue . Hence its easier. However  you can see the DAG
> representation , which lists all the RDDs in a job , with Spark UI.
> On 20 Aug 2015 22:34, "Dhaval Patel" <dhaval1406@gmail.com> wrote:
>
>> Apologies!!!!
>>
>> I accidentally included Spark User DL on BCC. The actual email message is
>> below.
>> =============================================================
>>
>>
>> Hi:
>>
>> I have been working on few example using zeppelin.
>>
>> I have been trying to find a command that would list all
>> *dataframes/RDDs* that has been created in current session. Anyone knows if
>> there is any such commands available?
>>
>> Something similar to SparkSQL to list all temp tables :
>>       show tables;
>>
>> Thanks,
>> Dhaval
>>
>>
>>
>> On Thu, Aug 20, 2015 at 12:49 PM, Dhaval Patel <dhaval1406@gmail.com>
>> wrote:
>>
>>> Hi:
>>>
>>> I have been working on few example using zeppelin.
>>>
>>> I have been trying to find a command that would list all
>>> *dataframes/RDDs* that has been created in current session. Anyone knows if
>>> there is any such commands available?
>>>
>>> Something similar to SparkSQL to list all temp tables :
>>>       show tables;
>>>
>>> Thanks,
>>> Dhaval
>>>
>>
>>

Mime
View raw message