spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <>
Subject [jira] [Commented] (SPARK-19530) Use guava weigher for code cache eviction
Date Thu, 09 Feb 2017 07:33:42 GMT


Apache Spark commented on SPARK-19530:

User 'viirya' has created a pull request for this issue:

> Use guava weigher for code cache eviction
> -----------------------------------------
>                 Key: SPARK-19530
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.1.0
>            Reporter: Liang-Chi Hsieh
> We use guava cache to cache compiled codes for codegen. Currently we use number of entries
(100 as maximum now) in the cache to determine when to evict older entries.
> However, the number of entries can't respond well to actually memory usage of cache entries.
As we heavily rely codegen now and the generated codes can be large, we shouldn't use maximum
of entries for code cache entry eviction.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message