flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Brelloch <jb.bc....@gmail.com>
Subject Re: Flink Cluster is savepointing jobmanager instead of external filesystem
Date Sun, 16 Oct 2016 20:07:36 GMT
Sorry, I should have mentioned that.  We are still running 1.0.1 version.

On Sun, Oct 16, 2016 at 5:08 AM, Aljoscha Krettek <aljoscha@apache.org>
wrote:

> Which version of Flink are you using? In the 1.2 SNAPSHOT version the
> configuration for save points is changed: https://ci.apache.
> org/projects/flink/flink-docs-release-1.2/setup/savepoints.
> html#configuration
>
> Cheers,
> Aljoscha
>
> On Fri, 14 Oct 2016 at 19:03 Jason Brelloch <jb.bc.flk@gmail.com> wrote:
>
>> It is a standalone cluster.
>>
>> On Fri, Oct 14, 2016 at 1:02 PM, Aljoscha Krettek <aljoscha@apache.org>
>> wrote:
>>
>> Hi,
>> are you running this standalone or on YARN?
>>
>> I'm also directly looping in Ufuk because he knows that stuff best. Maybe
>> he has an idea what could be going on.
>>
>> Cheers,
>> Aljoscha
>>
>> On Fri, 14 Oct 2016 at 18:39 Jason Brelloch <jb.bc.flk@gmail.com> wrote:
>>
>> Hey all,
>>
>> We are running into an issue where the savepoint command is saving to the
>> jobmanager instead of the filesystem location specified in the
>> flink-conf.yaml.  It saves to the filesystem when we are running in a local
>> standalone flink, but when we deploy the job to our flink cluster it saves
>> to the jobmanager.  The flink-conf is nearly identical in both places.
>> Here are the relevant savepoint parameters.
>>
>> savepoints.state.backend: filesystem
>> savepoints.state.backend.fs.dir: gs://bettercloud-non-prod/
>> flink-savepoints
>>
>> Is there another configuration we have to set that is specific to
>> clusters to make this work?  Or can anyone think of a reason this would
>> occur?
>>
>> --
>> *Jason Brelloch* | Product Developer
>> 3405 Piedmont Rd. NE, Suite 325, Atlanta, GA 30305
>> <http://www.bettercloud.com/>
>> Subscribe to the BetterCloud Monitor
>> <https://www.bettercloud.com/monitor?utm_source=bettercloud_email&utm_medium=email_signature&utm_campaign=monitor_launch>
-
>> Get IT delivered to your inbox
>>
>>
>>
>>
>> --
>> *Jason Brelloch* | Product Developer
>> 3405 Piedmont Rd. NE, Suite 325, Atlanta, GA 30305
>> <http://www.bettercloud.com/>
>> Subscribe to the BetterCloud Monitor
>> <https://www.bettercloud.com/monitor?utm_source=bettercloud_email&utm_medium=email_signature&utm_campaign=monitor_launch>
-
>> Get IT delivered to your inbox
>>
>


-- 
*Jason Brelloch* | Product Developer
3405 Piedmont Rd. NE, Suite 325, Atlanta, GA 30305
<http://www.bettercloud.com/>
Subscribe to the BetterCloud Monitor
<https://www.bettercloud.com/monitor?utm_source=bettercloud_email&utm_medium=email_signature&utm_campaign=monitor_launch>
-
Get IT delivered to your inbox

Mime
View raw message