flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-8485) Running Flink inside Intellij no longer works after upgrading from 1.3.2 to 1.4.0
Date Thu, 25 Jan 2018 10:51:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16339069#comment-16339069
] 

ASF GitHub Bot commented on FLINK-8485:
---------------------------------------

GitHub user tillrohrmann opened a pull request:

    https://github.com/apache/flink/pull/5360

    [backport-1.4] [FLINK-8485] [client] Unblock JobSubmissionClientActor#tryToSubmitJob

    This is a backport of #5359. Additionally it also includes a backport of #4924.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/tillrohrmann/flink unblockJobSubmissionClientActor1.4

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/5360.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #5360
    
----
commit ce399d5dee3f8bb065bacd2caf9f848d08a954e9
Author: Bartłomiej Tartanus <bartektartanus@...>
Date:   2017-10-30T14:39:43Z

    [FLINK-7949] Make AsyncWaitOperator recoverable also when queue is full
    
    Start emitter thread BEFORE filling up the queue of recovered elements.
    This guarantees that we won't deadlock inserting the recovered elements,
    because the emitter can already start processing elements.
    
    This closes #4924.

commit 7bd682e5e379952458b0dc91d0f7f218afb83f50
Author: Till Rohrmann <trohrmann@...>
Date:   2018-01-10T17:53:38Z

    [FLINK-7949] Add unit test for AsyncWaitOperator recovery with full queue

commit b06670e1361bf5bae76073db8f7060af61c26100
Author: Till Rohrmann <trohrmann@...>
Date:   2018-01-25T10:40:33Z

    [FLINK-8485] [client] Unblock JobSubmissionClientActor#tryToSubmitJob
    
    The JobSubmissionClientActor blocked a ActorSystem's dispatcher thread when requesting
    the BlobServer port from the cluster. This fails when using the FlinkMiniCluster on a
    single core machine because we set the number of threads to 1.
    
    This commit unblocks the JobSubmissionClientActor#tryToSubmitJob method and sets the
    lower limit of dispatcher threads to 2 when using the FlinkMiniCluster.

----


> Running Flink inside Intellij no longer works after upgrading from 1.3.2 to 1.4.0
> ---------------------------------------------------------------------------------
>
>                 Key: FLINK-8485
>                 URL: https://issues.apache.org/jira/browse/FLINK-8485
>             Project: Flink
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 1.4.0, 1.5.0
>            Reporter: Xuan Nguyen
>            Assignee: Till Rohrmann
>            Priority: Blocker
>             Fix For: 1.5.0, 1.4.1
>
>
> I upgraded flink from 1.3.2 to 1.4.0 and my simple test case no longer runs within Intellij
or any other IDE when I click on the "RUN" button.  I'm using JDK 1.8.
> My Dependencies are:
>  
> {code:java}
> dependencies {
> compile group: 'log4j', name: 'log4j', version: '1.2.17' 
> compile 'org.apache.flink:flink-java:1.4.0' 
> compile 'org.apache.flink:flink-streaming-java_2.11:1.4.0' 
> compile 'org.apache.flink:flink-clients_2.11:1.4.0' 
> compile 'org.apache.flink:flink-table_2.11:1.4.0' 
> compile 'org.apache.flink:flink-scala_2.11:1.4.0' 
> compile 'org.apache.flink:flink-streaming-scala_2.11:1.4.0'
> compile 'org.apache.flink:flink-connector-kafka-0.8_2.11:1.4.0'
> compile 'org.apache.flink:flink-queryable-state-runtime_2.11:1.4.0'
> compile 'org.apache.flink:flink-queryable-state-client-java__2.11:1.4.0' testCompile
'junit:junit:+'
> }
> {code}
>  
> {{ }}
> {{The exception:}}
> {code:java}
> Exception in thread "main" org.apache.flink.runtime.client.JobSubmissionException: Could
not retrieve BlobServer address. at org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:166)
at akka.dispatch.Futures$$anonfun$future$1.apply(Future.scala:97) at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.util.concurrent.ExecutionException: akka.pattern.AskTimeoutException: Ask
timed out on [Actor[akka://flink/user/jobmanager_1#-1662993273]] after [10000 ms]. Sender[null]
sent message of type "org.apache.flink.runtime.messages.JobManagerMessages$RequestBlobManagerPort$".
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915)
at org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:160)
... 9 more Caused by: akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/jobmanager_1#-1662993273]]
after [10000 ms]. Sender[null] sent message of type "org.apache.flink.runtime.messages.JobManagerMessages$RequestBlobManagerPort$".
at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:604) at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:126)
at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601) at
scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109) at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:329)
at akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:280)
at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:284)
at akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:236)
at java.lang.Thread.run(Thread.java:748){code}
>  
> The debug full logs are located in [https://gist.github.com/xuan/e6d4543c478c30d5747428589b03dd03] along
with the test case.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message