spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yang Jie (Jira)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-34309) Use Caffeine instead of Guava Cache
Date Mon, 08 Feb 2021 05:49:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17280769#comment-17280769
] 

Yang Jie edited comment on SPARK-34309 at 2/8/21, 5:48 AM:
-----------------------------------------------------------

Thx [~xkrogen] ~ I submitted a temporary pr which includes all the places where guava cache
is used
{quote}[~LuciferYang] can you elaborate on where Guava Cache is used in performance critical
sections within Spark? Microbenchmarks are nice but it would be good to understand what kind
of effect this could have on overall performance.
{quote}
 

I need to think about where to make a Microbenchmarks


was (Author: luciferyang):
Thx [~xkrogen] ~ I submitted a temporary pr which includes all the places where guava cache
is used, 
{quote}[~LuciferYang] can you elaborate on where Guava Cache is used in performance critical
sections within Spark? Microbenchmarks are nice but it would be good to understand what kind
of effect this could have on overall performance.
{quote}
 

I need to think about where to make a Microbenchmarks

> Use Caffeine instead of Guava Cache
> -----------------------------------
>
>                 Key: SPARK-34309
>                 URL: https://issues.apache.org/jira/browse/SPARK-34309
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core, SQL
>    Affects Versions: 3.2.0
>            Reporter: Yang Jie
>            Priority: Minor
>         Attachments: image-2021-02-05-18-08-48-852.png, screenshot-1.png
>
>
> Caffeine is a high performance, near optimal caching library based on Java 8, it is
used in a similar way to guava cache, but with better performance. The comparison results
are as follow are on the [caffeine benchmarks |https://github.com/ben-manes/caffeine/wiki/Benchmarks]
> At the same time, caffeine has been used in some open source projects like Cassandra,
Hbase, Neo4j, Druid, Spring and so on.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message