flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4630) add netty tcp/restful pushed source support
Date Tue, 11 Oct 2016 09:16:20 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564978#comment-15564978

Robert Metzger commented on FLINK-4630:

I think the {{flink-netty-source}} would be a good candidate for Apache Bahir: https://github.com/apache/bahir-flink
Apache Bahir is a community for connectors (and plugins in general) of data processing systems.
There are several other Flink connectors in {{bahir-flink}}.

> add netty tcp/restful pushed source support
> -------------------------------------------
>                 Key: FLINK-4630
>                 URL: https://issues.apache.org/jira/browse/FLINK-4630
>             Project: Flink
>          Issue Type: New Feature
>          Components: Streaming Connectors
>            Reporter: shijinkui
> When source stream get start, listen a provided tcp port, receive stream data from user
data source.
> This netty tcp source is keepping alive and end-to-end, that is from business system
to flink worker directly. 
> Such source service is needed in produce indeed.
> describe the source in detail below:
> 1.	source run as a netty tcp server
> 2.	user provide a tcp port, if the port is in used, increace the port number between
1024 to 65535. Source can parallel.
> 3.	callback the provided url to report the real port to listen
> 4.	user push streaming data to netty server, then collect the data to flink

This message was sent by Atlassian JIRA

View raw message