flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From StephanEwen <...@git.apache.org>
Subject [GitHub] flink pull request: [FLINK-2084] [core] Add an option to start Fli...
Date Fri, 22 May 2015 16:57:07 GMT
GitHub user StephanEwen opened a pull request:

    https://github.com/apache/flink/pull/718

    [FLINK-2084] [core] Add an option to start Flink in streaming mode

    The streaming mode subsumes the batch mode, as it allows to run both kinds of programs.
Batch programs will most likely run slightly less efficient than in pure batch mode, due to
lazy memory allocation (see below)
    
    Adds new startup options to the JobManager and TaskManager.
    
    Adds additional scripts `bin/start-cluster-streaming.sh` and `start-local-streaming.sh`.
    
    Currently, streaming mode only sets the memory manager to lazy memory allocation to ensure
heap is not blocked by batch memory manager
    
    Includes [FLINK-2085] To support on-demand memory allocation in the memory manager.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/StephanEwen/incubator-flink streaming_mode

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/718.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #718
    
----
commit 7b58e2d49521e955ddacfa5586659df01fe57c57
Author: Stephan Ewen <sewen@apache.org>
Date:   2015-05-22T16:35:40Z

    [FLINK-2085] [runtime] Add an option to let the MemoryManager allocate and release memory
as needed.
    
    This is an alternative mode to the current mode that pre-allocates all memory.
    
    The default remains to pre-allocate all memory.

commit 43978cd979114858ad2f200f04bd1723693c2c3e
Author: Stephan Ewen <sewen@apache.org>
Date:   2015-05-22T15:12:45Z

    [FLINK-2084] [core] Add an option to start Flink in streaming mode
    
     - Streaming mode sets the memory manager to lazy memory allocation to ensure
       heap is not blocked by batch memory manager

commit 1df1f12e367b4b89b56e9e47dbe5a7a11e5e1583
Author: Stephan Ewen <sewen@apache.org>
Date:   2015-05-22T15:24:19Z

    [tests] Adjust tests for dedicated streaming mode and clean up test bases.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message