flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aljoscha <...@git.apache.org>
Subject [GitHub] flink pull request #2176: [FLINK-4118] The docker-flink image is outdated (1...
Date Fri, 01 Jul 2016 14:25:14 GMT
Github user aljoscha commented on a diff in the pull request:

    --- Diff: flink-contrib/docker-flink/README.md ---
    @@ -1,80 +1,75 @@
    -#Apache Flink cluster deployment on Docker using Docker-Compose
    +Apache Flink cluster deployment on docker using docker-compose
    -###Install Docker
    +# Installation
    +Install the most recent stable version of docker
    -if you have issues with Docker-Compose versions incompatible with your version of Docker
    +Install the most recent stable version of docker-compose
    -`curl -sSL https://get.docker.com/ubuntu/ | sudo sh`
    +# Build
    -###Install Docker-Compose
    +Images are based on the official Java Alpine (OpenJDK 8) image and run
    +supervisord to stay alive when running containers. If you want to build the
    +flink image run:
    -curl -L https://github.com/docker/compose/releases/download/1.1.0/docker-compose-`uname
-s`-`uname -m` > /usr/local/bin/docker-compose
    +    sh build.sh
    -chmod +x /usr/local/bin/docker-compose
    -###Get the repo
    -###Build the images
    -Images are based on Ubuntu Trusty 14.04 and run Supervisord to stay alive when running
    +    docker build -t flink .
    -The base image installs Oracle Java JDK 1.7 and SSH client & server. You can change
the SSH password there or add your own key and adjust SSH config.
    +If you want to build the container for a specific version of flink/hadoop/scala
    +you can configure it in the respective args:
    -- Run `./build.sh`
    +    docker build --build-arg FLINK_VERSION=1.0.3 --build-arg HADOOP_VERSION=26 --build-arg
SCALA_VERSION=2.10 -t "flink:1.0.3-hadoop2.6-scala_2.10" flink
    +# Deploy
     - Deploy cluster and see config/setup log output (best run in a screen session)
    -`docker-compose up`
    +        docker-compose up
     - Deploy as a daemon (and return)
    -`docker-compose up -d`
    +        docker-compose up -d
     - Scale the cluster up or down to *N* TaskManagers
    -`docker-compose scale taskmanager=<N>`
    -- Access the JobManager node with SSH (exposed on Port 220)
    +        docker-compose scale taskmanager=<N>
    -`ssh root@localhost -p 220`
    +- Access the Job Manager container
    -or on Mac OS X with boot2docker
    -`ssh root@$(boot2docker ip) -p 220`
    -The password is 'secret'
    +        docker exec -it $(docker ps --filter name=flink_jobmanager --format={{.ID}})
     - Kill the cluster
    -`docker-compose kill`
    +        docker-compose kill
     - Upload a jar to the cluster
    -`scp -P 220 <your_jar> root@localhost:/<your_path>`
    +        for i in $(docker ps --filter name=flink --format={{.ID}}); do
    --- End diff --
    Yep, the TaskManagers pull it from the JobManager which keeps it in a component called

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.

View raw message