samoa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SAMOA-16) Add an adapter for Apache Flink-Streaming
Date Thu, 07 May 2015 07:23:00 GMT

    [ https://issues.apache.org/jira/browse/SAMOA-16?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532169#comment-14532169
] 

ASF GitHub Bot commented on SAMOA-16:
-------------------------------------

Github user rmetzger commented on the pull request:

    https://github.com/apache/incubator-samoa/pull/11#issuecomment-99753405
  
    We have a open JIRA in Flink to start a "streaming only" mode, which starts up Flink in
an streaming optimized mode.
    
    For now, you can set the following configuration values in the conf/flink-conf.yaml to
achieve a similar effect:
    - `taskmanager.memory.fraction`: This fraction describes the division between managed
and unmanaged heap space. Flink batch is using managed memory for its operations, flink streaming
uses unmanaged memory only. By default the value is set to 0.7, which leaves not much memory
for streaming. I would recommend setting the value to `0.001` ;)
    - `taskmanager.heap.mb`: Thats an integer specifying the task manager's heap size. By
default its set to 512. I suspect your machine has more memory.


> Add an adapter for Apache Flink-Streaming
> -----------------------------------------
>
>                 Key: SAMOA-16
>                 URL: https://issues.apache.org/jira/browse/SAMOA-16
>             Project: SAMOA
>          Issue Type: New Feature
>            Reporter: Paris Carbone
>            Assignee: Gianmarco De Francisci Morales
>
> Apache Flink-Streaming is a new system for distributed stream processing built for unique
and flexible high level stream transformations. A Flink adapter for Samoa should be able to
translate a Samoa Task topology into Flink streaming transformations. Some of the challenges
are the compositional topology support, circle detection and their translation to Flink iterations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message