flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gary Yao <g...@data-artisans.com>
Subject Re: How to run flip-6 on mesos
Date Wed, 25 Apr 2018 08:08:41 GMT
Hi Miki,

We are currently working on resolving the last blocking issues for a second
Release Candidate. Afterwards it depends on how many new blocking issues
will be
found during the testing.

Best,
Gary

On Tue, Apr 24, 2018 at 9:42 AM, miki haiat <miko5054@gmail.com> wrote:

> Its 1.4.2 ...
> Any approximate date for 1.5 release ?
>
> Thanks allot for your help .
>
>
>
> On Tue, Apr 24, 2018 at 10:39 AM, Gary Yao <gary@data-artisans.com> wrote:
>
>> Hi Miki,
>>
>> The stacktrace you posted looks familiar [1]. We have fixed the issue in
>> Flink
>> 1.5. What is the Flink version you are using? FLIP-6 before Flink 1.5 is
>> very
>> experimental, and I doubt that it is in a usable state. Since 1.5 is not
>> out
>> yet, you can either compile the release branch yourself, or use the RC1
>> binaries [2]. If you are already on 1.5, please open a ticket.
>>
>> Best,
>> Gary
>>
>> [1] https://issues.apache.org/jira/browse/FLINK-8176
>> [2] http://people.apache.org/~trohrmann/flink-1.5.0-rc1/
>>
>>
>> On Tue, Apr 24, 2018 at 9:27 AM, miki haiat <miko5054@gmail.com> wrote:
>>
>>> The problem is that the Web UI hasn't started at all
>>>  Im using the sane config file that i used for none flip-6 is that ok ?
>>> Also i got this error in the logs .
>>>
>>>
>>> 2018-04-24 10:16:05,466 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>>>>     - Could not recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9
>>>> c6.
>>>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>>>>         at org.apache.flink.util.Preconditions.checkState(Preconditions
>>>> .java:195)
>>>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>>>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>>>>         at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>>>> rJobs$3(Dispatcher.java:445)
>>>>         at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39
>>>> )
>>>>         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>>>> exec(AbstractDispatcher.scala:415)
>>>>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.j
>>>> ava:260)
>>>>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(For
>>>> kJoinPool.java:1339)
>>>>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>>>> l.java:1979)
>>>>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>>>> orkerThread.java:107)
>>>> 2018-04-24 10:16:05,469 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>>>>     - Could not recover the job graph for 700f37540fe95787510dfa2bc0cc5a
>>>> c3.
>>>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>>>>         at org.apache.flink.util.Preconditions.checkState(Preconditions
>>>> .java:195)
>>>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>>>>         at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>>>>         at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>>>> rJobs$3(Dispatcher.java:445)
>>>>         at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39
>>>> )
>>>>         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>>>> exec(AbstractDispatcher.scala:415)
>>>>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.j
>>>> ava:260)
>>>>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(For
>>>> kJoinPool.java:1339)
>>>>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>>>> l.java:1979)
>>>>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>>>> orkerThread.java:107)
>>>
>>>
>>>
>>> On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <gary@data-artisans.com>
>>> wrote:
>>>
>>>> Hi Miki,
>>>>
>>>> IIRC the port on which the Web UI is listening is not allocated
>>>> dynamically when
>>>> deploying on Mesos, and should be 8081 by default (you can override the
>>>> default
>>>> by setting rest.port in flink-conf.yaml). If you can find out the
>>>> hostname/IP of
>>>> the JobManager, you can submit as usual via the Web UI. Alternatively
>>>> you can
>>>> use the CLI, e.g.,
>>>>
>>>>   bin/flink run -m hostname:6123 examples/streaming/WordCount.jar
>>>>
>>>> where 6123 is the jobmanager.rpc.port.
>>>>
>>>> Let me know if any of these work for you
>>>>
>>>> Best,
>>>> Gary
>>>>
>>>>
>>>> On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <miko5054@gmail.com> wrote:
>>>>
>>>>> NO  :) ...
>>>>> I usually using the web UI .
>>>>> Can you refer me to some example how to submit  a job ?
>>>>> Using REST ? to which port ?
>>>>>
>>>>> thanks,
>>>>>
>>>>> miki
>>>>>
>>>>> On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <gary@data-artisans.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Miki,
>>>>>>
>>>>>> Did you try to submit a job? With the introduction of FLIP-6,
>>>>>> resources are
>>>>>> allocated dynamically.
>>>>>>
>>>>>> Best,
>>>>>> Gary
>>>>>>
>>>>>>
>>>>>> On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <miko5054@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>>
>>>>>>> HI,
>>>>>>> Im trying to tun flip-6 on mesos but its not clear to me what
is the
>>>>>>> correct way to do it .
>>>>>>>
>>>>>>> I run  the session script and i can see that new framework has
been
>>>>>>> created in mesos  but the task manager  hasn't been created
>>>>>>> running  taskmanager-flip6.sh throw null pointer ...
>>>>>>>
>>>>>>> what is the correct way to run flip-6 .
>>>>>>>
>>>>>>>
>>>>>>> thanks,
>>>>>>>
>>>>>>> miki
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>

Mime
View raw message