spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andras Nemeth <>
Subject Storage information about an RDD from the API
Date Tue, 29 Apr 2014 16:34:57 GMT

Is it possible to know from code about an RDD if it is cached, and more
precisely, how many of its partitions are cached in memory and how many are
cached on disk? I know I can get the storage level, but I also want to know
the current actual caching status. Knowing memory consumption would also be
awesome. :)

Basically what I'm looking for is the information on the storage tab of the
UI, but accessible from the API.


View raw message