beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (BEAM-5418) Add Flink version compatibility table to Runner page
Date Tue, 18 Sep 2018 16:47:00 GMT

     [ https://issues.apache.org/jira/browse/BEAM-5418?focusedWorklogId=145366&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-145366
]

ASF GitHub Bot logged work on BEAM-5418:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 18/Sep/18 16:46
            Start Date: 18/Sep/18 16:46
    Worklog Time Spent: 10m 
      Work Description: asfgit closed pull request #553: [BEAM-5418] Add Flink version compatibility
table to Runner page 
URL: https://github.com/apache/beam-site/pull/553
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/src/documentation/runners/flink.md b/src/documentation/runners/flink.md
index c7a6b1c74f..a2cac75879 100644
--- a/src/documentation/runners/flink.md
+++ b/src/documentation/runners/flink.md
@@ -20,6 +20,8 @@ limitations under the License.
 -->
 # Using the Apache Flink Runner
 
+The old Flink Runner will eventually be replaced by the Portable Runner which enables to
run pipelines in other languages than Java. Please see the [Portability page]({{ site.baseurl
}}/contribute/portability/) for the latest state.
+
 <nav class="language-switcher">
   <strong>Adapt for:</strong>
   <ul>
@@ -45,18 +47,42 @@ The [Beam Capability Matrix]({{ site.baseurl }}/documentation/runners/capability
 
 If you want to use the local execution mode with the Flink runner to don't have to complete
any setup.
 
-To use the Flink Runner for executing on a cluster, you have to setup a Flink cluster by
following the Flink [setup quickstart](https://ci.apache.org/projects/flink/flink-docs-release-1.1/quickstart/setup_quickstart.html).
+To use the Flink Runner for executing on a cluster, you have to setup a Flink cluster by
following the Flink [setup quickstart](https://ci.apache.org/projects/flink/flink-docs-stable/quickstart/setup_quickstart.html).
 
-To find out which version of Flink you need you can run this command to check the version
of the Flink dependency that your project is using:
-```
-$ mvn dependency:tree -Pflink-runner |grep flink
-...
-[INFO] |  +- org.apache.flink:flink-streaming-java_2.10:jar:1.2.1:runtime
-...
-```
-Here, we would need Flink 1.2.1. Please also note the Scala version in the dependency name.
In this case we need to make sure to use a Flink cluster with Scala version 2.10.
+### Version Compatibility
+
+The Flink cluster version has to match the version used by the FlinkRunner. To find out which
version of Flink please see the table below:
+
+<table class="table table-bordered">
+<tr>
+  <th>Beam version</th>
+  <th>Flink version</th>
+</tr>
+<tr>
+  <td>2.7.0, 2.6.0</td>
+  <td>1.5.x</td>
+</tr>
+<tr>
+  <td>2.5.0, 2.4.0, 2.3.0</td>
+  <td>1.4.x</td>
+</tr>
+<tr>
+  <td>2.2.0</td>
+  <td>1.3.x with Scala 2.10</td>
+</tr>
+<tr>
+  <td>2.2.0, 2.1.x</td>
+  <td>1.3.x with Scala 2.10</td>
+</tr>
+<tr>
+  <td>2.0.0</td>
+  <td>1.2.x with Scala 2.10</td>
+</tr>
+</table>
+
+For retrieving the right version, see the [Flink downloads page](https://flink.apache.org/downloads.html).
 
-For more information, the [Flink Documentation](https://ci.apache.org/projects/flink/flink-docs-release-1.1/)
can be helpful.
+For more information, the [Flink Documentation](https://ci.apache.org/projects/flink/flink-docs-stable/)
can be helpful.
 
 ### Specify your dependency
 
@@ -64,9 +90,8 @@ For more information, the [Flink Documentation](https://ci.apache.org/projects/f
 ```java
 <dependency>
   <groupId>org.apache.beam</groupId>
-  <artifactId>beam-runners-flink_2.10</artifactId>
+  <artifactId>beam-runners-flink_2.11</artifactId>
   <version>{{ site.release_latest }}</version>
-  <scope>runtime</scope>
 </dependency>
 ```
 


 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 145366)
    Time Spent: 1h  (was: 50m)

> Add Flink version compatibility table to Runner page 
> -----------------------------------------------------
>
>                 Key: BEAM-5418
>                 URL: https://issues.apache.org/jira/browse/BEAM-5418
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink, website
>            Reporter: Maximilian Michels
>            Assignee: Maximilian Michels
>            Priority: Major
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> Following up a discussion on the mailing list. There have been confusions which version
of Beam is compatible with which Flink version. The only way for users at the moment is to
look into the source code.
> A table like this will be helpful:
> || Beam || Flink ||
> |2.5.0 | 1.4.0 |
> |2.6.0 |  1.5.0 |
> |2.7.0 |  1.5.2 |



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message