flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aljoscha Krettek <aljos...@apache.org>
Subject Re: Flink Cluster is savepointing jobmanager instead of external filesystem
Date Sun, 16 Oct 2016 09:08:33 GMT
Which version of Flink are you using? In the 1.2 SNAPSHOT version the
configuration for save points is changed:
https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/savepoints.html#configuration

Cheers,
Aljoscha

On Fri, 14 Oct 2016 at 19:03 Jason Brelloch <jb.bc.flk@gmail.com> wrote:

> It is a standalone cluster.
>
> On Fri, Oct 14, 2016 at 1:02 PM, Aljoscha Krettek <aljoscha@apache.org>
> wrote:
>
> Hi,
> are you running this standalone or on YARN?
>
> I'm also directly looping in Ufuk because he knows that stuff best. Maybe
> he has an idea what could be going on.
>
> Cheers,
> Aljoscha
>
> On Fri, 14 Oct 2016 at 18:39 Jason Brelloch <jb.bc.flk@gmail.com> wrote:
>
> Hey all,
>
> We are running into an issue where the savepoint command is saving to the
> jobmanager instead of the filesystem location specified in the
> flink-conf.yaml.  It saves to the filesystem when we are running in a local
> standalone flink, but when we deploy the job to our flink cluster it saves
> to the jobmanager.  The flink-conf is nearly identical in both places.
> Here are the relevant savepoint parameters.
>
> savepoints.state.backend: filesystem
> savepoints.state.backend.fs.dir: gs://bettercloud-non-prod/flink-savepoints
>
> Is there another configuration we have to set that is specific to clusters
> to make this work?  Or can anyone think of a reason this would occur?
>
> --
> *Jason Brelloch* | Product Developer
> 3405 Piedmont Rd. NE, Suite 325, Atlanta, GA 30305
> <http://www.bettercloud.com/>
> Subscribe to the BetterCloud Monitor
> <https://www.bettercloud.com/monitor?utm_source=bettercloud_email&utm_medium=email_signature&utm_campaign=monitor_launch>
-
> Get IT delivered to your inbox
>
>
>
>
> --
> *Jason Brelloch* | Product Developer
> 3405 Piedmont Rd. NE, Suite 325, Atlanta, GA 30305
> <http://www.bettercloud.com/>
> Subscribe to the BetterCloud Monitor
> <https://www.bettercloud.com/monitor?utm_source=bettercloud_email&utm_medium=email_signature&utm_campaign=monitor_launch>
-
> Get IT delivered to your inbox
>

Mime
View raw message