flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From miki haiat <miko5...@gmail.com>
Subject Re: How to run flip-6 on mesos
Date Tue, 24 Apr 2018 07:27:19 GMT
The problem is that the Web UI hasn't started at all
 Im using the sane config file that i used for none flip-6 is that ok ?
Also i got this error in the logs .


2018-04-24 10:16:05,466 ERROR
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Could not
> recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9c6.
> java.lang.IllegalStateException: Not running. Forgot to call start()?
>         at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
>         at
> org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>         at
> org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>         at
> org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
>         at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
>         at
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
>         at
> scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>         at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
>         at
> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>         at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> 2018-04-24 10:16:05,469 ERROR
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Could not
> recover the job graph for 700f37540fe95787510dfa2bc0cc5ac3.
> java.lang.IllegalStateException: Not running. Forgot to call start()?
>         at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
>         at
> org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>         at
> org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>         at
> org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
>         at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
>         at
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
>         at
> scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>         at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
>         at
> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>         at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)



On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <gary@data-artisans.com> wrote:

> Hi Miki,
>
> IIRC the port on which the Web UI is listening is not allocated
> dynamically when
> deploying on Mesos, and should be 8081 by default (you can override the
> default
> by setting rest.port in flink-conf.yaml). If you can find out the
> hostname/IP of
> the JobManager, you can submit as usual via the Web UI. Alternatively you
> can
> use the CLI, e.g.,
>
>   bin/flink run -m hostname:6123 examples/streaming/WordCount.jar
>
> where 6123 is the jobmanager.rpc.port.
>
> Let me know if any of these work for you
>
> Best,
> Gary
>
>
> On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <miko5054@gmail.com> wrote:
>
>> NO  :) ...
>> I usually using the web UI .
>> Can you refer me to some example how to submit  a job ?
>> Using REST ? to which port ?
>>
>> thanks,
>>
>> miki
>>
>> On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <gary@data-artisans.com> wrote:
>>
>>> Hi Miki,
>>>
>>> Did you try to submit a job? With the introduction of FLIP-6, resources
>>> are
>>> allocated dynamically.
>>>
>>> Best,
>>> Gary
>>>
>>>
>>> On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <miko5054@gmail.com> wrote:
>>>
>>>>
>>>> HI,
>>>> Im trying to tun flip-6 on mesos but its not clear to me what is the
>>>> correct way to do it .
>>>>
>>>> I run  the session script and i can see that new framework has been
>>>> created in mesos  but the task manager  hasn't been created
>>>> running  taskmanager-flip6.sh throw null pointer ...
>>>>
>>>> what is the correct way to run flip-6 .
>>>>
>>>>
>>>> thanks,
>>>>
>>>> miki
>>>>
>>>
>>>
>>
>

Mime
View raw message