flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gary Yao <g...@data-artisans.com>
Subject Re: How to run flip-6 on mesos
Date Tue, 24 Apr 2018 07:39:02 GMT
Hi Miki,

The stacktrace you posted looks familiar [1]. We have fixed the issue in
Flink
1.5. What is the Flink version you are using? FLIP-6 before Flink 1.5 is
very
experimental, and I doubt that it is in a usable state. Since 1.5 is not out
yet, you can either compile the release branch yourself, or use the RC1
binaries [2]. If you are already on 1.5, please open a ticket.

Best,
Gary

[1] https://issues.apache.org/jira/browse/FLINK-8176
[2] http://people.apache.org/~trohrmann/flink-1.5.0-rc1/

On Tue, Apr 24, 2018 at 9:27 AM, miki haiat <miko5054@gmail.com> wrote:

> The problem is that the Web UI hasn't started at all
>  Im using the sane config file that i used for none flip-6 is that ok ?
> Also i got this error in the logs .
>
>
> 2018-04-24 10:16:05,466 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>>     - Could not recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9
>> c6.
>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>>         at org.apache.flink.util.Preconditions.checkState(Preconditions
>> .java:195)
>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>>         at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>> rJobs$3(Dispatcher.java:445)
>>         at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
>>         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>> exec(AbstractDispatcher.scala:415)
>>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.
>> java:260)
>>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(
>> ForkJoinPool.java:1339)
>>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>> l.java:1979)
>>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>> orkerThread.java:107)
>> 2018-04-24 10:16:05,469 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>>     - Could not recover the job graph for 700f37540fe95787510dfa2bc0cc5a
>> c3.
>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>>         at org.apache.flink.util.Preconditions.checkState(Preconditions
>> .java:195)
>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>>         at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>> rJobs$3(Dispatcher.java:445)
>>         at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
>>         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>> exec(AbstractDispatcher.scala:415)
>>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.
>> java:260)
>>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(
>> ForkJoinPool.java:1339)
>>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>> l.java:1979)
>>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>> orkerThread.java:107)
>
>
>
> On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <gary@data-artisans.com> wrote:
>
>> Hi Miki,
>>
>> IIRC the port on which the Web UI is listening is not allocated
>> dynamically when
>> deploying on Mesos, and should be 8081 by default (you can override the
>> default
>> by setting rest.port in flink-conf.yaml). If you can find out the
>> hostname/IP of
>> the JobManager, you can submit as usual via the Web UI. Alternatively you
>> can
>> use the CLI, e.g.,
>>
>>   bin/flink run -m hostname:6123 examples/streaming/WordCount.jar
>>
>> where 6123 is the jobmanager.rpc.port.
>>
>> Let me know if any of these work for you
>>
>> Best,
>> Gary
>>
>>
>> On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <miko5054@gmail.com> wrote:
>>
>>> NO  :) ...
>>> I usually using the web UI .
>>> Can you refer me to some example how to submit  a job ?
>>> Using REST ? to which port ?
>>>
>>> thanks,
>>>
>>> miki
>>>
>>> On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <gary@data-artisans.com>
>>> wrote:
>>>
>>>> Hi Miki,
>>>>
>>>> Did you try to submit a job? With the introduction of FLIP-6, resources
>>>> are
>>>> allocated dynamically.
>>>>
>>>> Best,
>>>> Gary
>>>>
>>>>
>>>> On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <miko5054@gmail.com> wrote:
>>>>
>>>>>
>>>>> HI,
>>>>> Im trying to tun flip-6 on mesos but its not clear to me what is the
>>>>> correct way to do it .
>>>>>
>>>>> I run  the session script and i can see that new framework has been
>>>>> created in mesos  but the task manager  hasn't been created
>>>>> running  taskmanager-flip6.sh throw null pointer ...
>>>>>
>>>>> what is the correct way to run flip-6 .
>>>>>
>>>>>
>>>>> thanks,
>>>>>
>>>>> miki
>>>>>
>>>>
>>>>
>>>
>>
>

Mime
View raw message