flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-10068) Add documentation for async/RocksDB-based timers
Date Thu, 09 Aug 2018 14:39:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574924#comment-16574924

ASF GitHub Bot commented on FLINK-10068:

twalthr commented on a change in pull request #6504: [FLINK-10068][docs] Add documentation
for RocksDB-based timers and st…
URL: https://github.com/apache/flink/pull/6504#discussion_r208952554

 File path: docs/ops/state/large_state_tuning.md
 @@ -142,6 +142,17 @@ by default. To enable this feature, users can instantiate a `RocksDBStateBackend
         new RocksDBStateBackend(filebackend, true);
 {% endhighlight %}
+**RocksDB Timers**
+For RocksDB, user can chose whether timers are stored on the heap (default) or inside RocksDB.
Heap-based timers can have a better performance for smaller amounts of
+timers, while storing timers inside RocksDB offers higher scalability as the amount of timers
in RocksDB can exceed the available main memory (spilling to disk).
+When using RockDB as state backend, the type of timer storage can be selected through Flink's
configuration via option key `RocksDBOptions.TIMER_SERVICE_FACTORY`.
 Review comment:
   The option classes are mostly internal, right? So a proper YAML would be more useful I
guess. Can I only set this property for an entire Flink cluster or also per-job?

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

> Add documentation for async/RocksDB-based timers
> ------------------------------------------------
>                 Key: FLINK-10068
>                 URL: https://issues.apache.org/jira/browse/FLINK-10068
>             Project: Flink
>          Issue Type: Sub-task
>          Components: State Backends, Checkpointing
>            Reporter: Stefan Richter
>            Assignee: Stefan Richter
>            Priority: Major
>              Labels: pull-request-available
> Documentation how to activate RocksDB based timers, and update that snapshotting now
works async, expect for heap-timers + rocks-incremental-snapshot).

This message was sent by Atlassian JIRA

View raw message