spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From o_rayer <>
Subject In an executor, are the Python worker memory and the MemoryOverhead overlapping?
Date Tue, 18 Apr 2017 15:01:24 GMT
Hi there,

I'm using PySpark on a Hadoop cluster and I could not find the info about
the executor memory model with Python.

I know that the Python memory (spark.python.worker.memory) does not overlap
the JVM Heap (spark.executor.memory).

However, does the Python Memory overlap the Executor Memory Overhead or not

Thank you very much,

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe e-mail:

View raw message