flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1465) GlobalBufferPool reports negative memory allocation
Date Mon, 02 Feb 2015 08:59:34 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301023#comment-14301023
] 

Robert Metzger commented on FLINK-1465:
---------------------------------------

The error occurred when having the following two entries in the configuration
{code}
taskmanager.network.numberOfBuffers: 131072
taskmanager.network.bufferSizeInBytes: 32768
{code}
The heap-size of each TaskManager was set to 20GB.

> GlobalBufferPool reports negative memory allocation
> ---------------------------------------------------
>
>                 Key: FLINK-1465
>                 URL: https://issues.apache.org/jira/browse/FLINK-1465
>             Project: Flink
>          Issue Type: Bug
>          Components: Local Runtime, TaskManager
>    Affects Versions: 0.9
>            Reporter: Robert Metzger
>
> I've got this error message when starting Flink.
> It does not really help me. I suspect that my configuration files (which worked with
0.8 aren't working with 0.9 anymore). Still, the exception is reporting weird stuff
> {code}
> 11:41:02,516 INFO  org.apache.flink.yarn.YarnUtils$$anonfun$startActorSystemAndTaskManager$1$$anon$1
 - TaskManager successfully registered at JobManager akka.tcp://flink@cloud-18.dima.tu-berlin.de:39674/user/jo
> bmanager.
> 11:41:25,230 ERROR org.apache.flink.yarn.YarnUtils$$anonfun$startActorSystemAndTaskManager$1$$anon$1
 - Failed to instantiate network environment.
> java.io.IOException: Failed to instantiate network buffer pool: Could not allocate enough
memory segments for GlobalBufferPool (required (Mb): 0, allocated (Mb): -965, missing (Mb):
965).
>         at org.apache.flink.runtime.io.network.NetworkEnvironment.<init>(NetworkEnvironment.java:81)
>         at org.apache.flink.runtime.taskmanager.TaskManager.setupNetworkEnvironment(TaskManager.scala:508)
>         at org.apache.flink.runtime.taskmanager.TaskManager.org$apache$flink$runtime$taskmanager$TaskManager$$finishRegistration(TaskManager.scala:479)
>         at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$receiveWithLogMessages$1.applyOrElse(TaskManager.scala:226)
>         at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)
>         at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)
>         at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)
>         at org.apache.flink.yarn.YarnTaskManager$$anonfun$receiveYarnMessages$1.applyOrElse(YarnTaskManager.scala:32)
>         at scala.PartialFunction$OrElse.apply(PartialFunction.scala:162)
>         at org.apache.flink.runtime.ActorLogMessages$$anon$1.apply(ActorLogMessages.scala:41)
>         at org.apache.flink.runtime.ActorLogMessages$$anon$1.apply(ActorLogMessages.scala:27)
>         at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118)
>         at org.apache.flink.runtime.ActorLogMessages$$anon$1.applyOrElse(ActorLogMessages.scala:27)
>         at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
>         at org.apache.flink.runtime.taskmanager.TaskManager.aroundReceive(TaskManager.scala:78)
>         at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
>         at akka.actor.ActorCell.invoke(ActorCell.scala:487)
>         at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254)
>         at akka.dispatch.Mailbox.run(Mailbox.scala:221)
>         at akka.dispatch.Mailbox.exec(Mailbox.scala:231)
>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> Caused by: java.lang.OutOfMemoryError: Could not allocate enough memory segments for
GlobalBufferPool (required (Mb): 0, allocated (Mb): -965, missing (Mb): 965).
>         at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.<init>(NetworkBufferPool.java:76)
>         at org.apache.flink.runtime.io.network.NetworkEnvironment.<init>(NetworkEnvironment.java:78)
>         ... 23 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message