flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Till Rohrmann (Jira)" <j...@apache.org>
Subject [jira] [Created] (FLINK-15790) Make FlinkKubeClient and its implementations asynchronous
Date Tue, 28 Jan 2020 16:00:00 GMT
Till Rohrmann created FLINK-15790:

             Summary: Make FlinkKubeClient and its implementations asynchronous
                 Key: FLINK-15790
                 URL: https://issues.apache.org/jira/browse/FLINK-15790
             Project: Flink
          Issue Type: Sub-task
          Components: Deployment / Kubernetes
    Affects Versions: 1.10.0
            Reporter: Till Rohrmann
             Fix For: 1.11.0, 1.10.1

The {{FlinkKubeClient}} interface offers several methods which are synchronous (e.g. {{FlinkKubeClient.createTaskManagerPod}},
{{FlinkKubeClient.stopPod}}, {{FlinkKubeClient.getPodsWithLabels}}, etc). The problem is that
these methods are directly used by the {{KubernetesResourceManager}} which calls them from
the main thread. Since these methods perform I/O operations (sending and receiving network
packages) they can potentially block the execution and hence should not happen from the {{RpcEndpoint's}}
main thread.

I propose to make all potentially blocking operations on the {{FlinkKubeClient}} asynchronous
so that the {{KubernetesResourceManager}} does not risk to block the main thread. Alternatively,
we could also introduce a {{FlinkKubeClientAsync}} which offers asynchronous operations.

This message was sent by Atlassian Jira

View raw message