spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jack Kolokasis <>
Subject Off Heap Memory
Date Tue, 11 Sep 2018 11:15:16 GMT
     I recently start studying the Spark's memory management system. 
More spesifically I want to understand how spark use the off-Heap memory.
Interanlly I saw, that there are two types of offHeap memory. 
(offHeapExecutionMemoryPool and offHeapStorageMemoryPool).

     How Spark use the offHeap memory ?

     How Spark use the offHeapExecutionMemoryPool and how the 
offHeapStorageMemoryPool ?

     Is there any good tutorial or a guide that explain internally the 
Spark Memory Management ?

Thanks for your reply,

To unsubscribe e-mail:

View raw message