flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From miki haiat <miko5...@gmail.com>
Subject Re: How to run flip-6 on mesos
Date Tue, 24 Apr 2018 07:42:27 GMT
Its 1.4.2 ...
Any approximate date for 1.5 release ?

Thanks allot for your help .



On Tue, Apr 24, 2018 at 10:39 AM, Gary Yao <gary@data-artisans.com> wrote:

> Hi Miki,
>
> The stacktrace you posted looks familiar [1]. We have fixed the issue in
> Flink
> 1.5. What is the Flink version you are using? FLIP-6 before Flink 1.5 is
> very
> experimental, and I doubt that it is in a usable state. Since 1.5 is not
> out
> yet, you can either compile the release branch yourself, or use the RC1
> binaries [2]. If you are already on 1.5, please open a ticket.
>
> Best,
> Gary
>
> [1] https://issues.apache.org/jira/browse/FLINK-8176
> [2] http://people.apache.org/~trohrmann/flink-1.5.0-rc1/
>
>
> On Tue, Apr 24, 2018 at 9:27 AM, miki haiat <miko5054@gmail.com> wrote:
>
>> The problem is that the Web UI hasn't started at all
>>  Im using the sane config file that i used for none flip-6 is that ok ?
>> Also i got this error in the logs .
>>
>>
>> 2018-04-24 10:16:05,466 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>>>     - Could not recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9
>>> c6.
>>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>>>         at org.apache.flink.util.Preconditions.checkState(Preconditions
>>> .java:195)
>>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>>>         at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>>> rJobs$3(Dispatcher.java:445)
>>>         at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
>>>         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>>> exec(AbstractDispatcher.scala:415)
>>>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.j
>>> ava:260)
>>>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(For
>>> kJoinPool.java:1339)
>>>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>>> l.java:1979)
>>>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>>> orkerThread.java:107)
>>> 2018-04-24 10:16:05,469 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>>>     - Could not recover the job graph for 700f37540fe95787510dfa2bc0cc5a
>>> c3.
>>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>>>         at org.apache.flink.util.Preconditions.checkState(Preconditions
>>> .java:195)
>>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>>>         at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>>> rJobs$3(Dispatcher.java:445)
>>>         at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
>>>         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>>> exec(AbstractDispatcher.scala:415)
>>>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.j
>>> ava:260)
>>>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(For
>>> kJoinPool.java:1339)
>>>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>>> l.java:1979)
>>>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>>> orkerThread.java:107)
>>
>>
>>
>> On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <gary@data-artisans.com>
>> wrote:
>>
>>> Hi Miki,
>>>
>>> IIRC the port on which the Web UI is listening is not allocated
>>> dynamically when
>>> deploying on Mesos, and should be 8081 by default (you can override the
>>> default
>>> by setting rest.port in flink-conf.yaml). If you can find out the
>>> hostname/IP of
>>> the JobManager, you can submit as usual via the Web UI. Alternatively
>>> you can
>>> use the CLI, e.g.,
>>>
>>>   bin/flink run -m hostname:6123 examples/streaming/WordCount.jar
>>>
>>> where 6123 is the jobmanager.rpc.port.
>>>
>>> Let me know if any of these work for you
>>>
>>> Best,
>>> Gary
>>>
>>>
>>> On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <miko5054@gmail.com> wrote:
>>>
>>>> NO  :) ...
>>>> I usually using the web UI .
>>>> Can you refer me to some example how to submit  a job ?
>>>> Using REST ? to which port ?
>>>>
>>>> thanks,
>>>>
>>>> miki
>>>>
>>>> On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <gary@data-artisans.com>
>>>> wrote:
>>>>
>>>>> Hi Miki,
>>>>>
>>>>> Did you try to submit a job? With the introduction of FLIP-6,
>>>>> resources are
>>>>> allocated dynamically.
>>>>>
>>>>> Best,
>>>>> Gary
>>>>>
>>>>>
>>>>> On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <miko5054@gmail.com>
>>>>> wrote:
>>>>>
>>>>>>
>>>>>> HI,
>>>>>> Im trying to tun flip-6 on mesos but its not clear to me what is
the
>>>>>> correct way to do it .
>>>>>>
>>>>>> I run  the session script and i can see that new framework has been
>>>>>> created in mesos  but the task manager  hasn't been created
>>>>>> running  taskmanager-flip6.sh throw null pointer ...
>>>>>>
>>>>>> what is the correct way to run flip-6 .
>>>>>>
>>>>>>
>>>>>> thanks,
>>>>>>
>>>>>> miki
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>

Mime
View raw message