hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiwei Yang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration
Date Wed, 15 Feb 2017 10:27:41 GMT
Weiwei Yang created MAPREDUCE-6847:
--------------------------------------

             Summary: Job history server should release jobs from cache after a fixed duration
                 Key: MAPREDUCE-6847
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6847
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: jobhistoryserver
            Reporter: Weiwei Yang
            Assignee: Weiwei Yang


We found history server is consuming a lot of memory when there are large jobs (with more
than 100k of tasks in a single job). Currently JHS cache only evicts entries with size, it's
better to add the time expiration as well to reduce heap usage if job has no one accessing
for sometime.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org


Mime
View raw message