spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zuhair Khayyat <zuhair.khay...@gmail.com>
Subject com.google.protobuf out of memory
Date Sun, 25 May 2014 08:15:54 GMT
Dear all,

I am getting a OutOfMemoryError in class ByteString.java from package
com.google.protobuf when processing very large data using spark 0.9. Does
increasing spark.shuffle.memoryFraction helps or I should add more memory
to my workers? Below the error I get during execution.

14/05/25 07:26:05 INFO MapOutputTrackerMasterActor: Asked to send map
output locations for shuffle 0 to spark@cloud21:47985

14/05/25 07:26:05 INFO MapOutputTrackerMasterActor: Asked to send map
output locations for shuffle 0 to spark@cloud5:46977

14/05/25 07:26:05 INFO MapOutputTrackerMasterActor: Asked to send map
output locations for shuffle 0 to spark@cloud14:51948

14/05/25 07:26:05 INFO MapOutputTrackerMasterActor: Asked to send map
output locations for shuffle 0 to spark@cloud12:45368

14/05/25 07:26:05 INFO MapOutputTrackerMasterActor: Asked to send map
output locations for shuffle 0 to spark@cloud9:50926

14/05/25 07:26:05 INFO MapOutputTrackerMasterActor: Asked to send map
output locations for shuffle 0 to spark@cloud10:50690

14/05/25 07:26:12 ERROR ActorSystemImpl: Uncaught fatal error from thread
[spark-akka.actor.default-dispatcher-5] shutting down ActorSystem [spark]

java.lang.OutOfMemoryError: Java heap space

        at com.google.protobuf_spark.ByteString.copyFrom(ByteString.java:90)

        at com.google.protobuf_spark.ByteString.copyFrom(ByteString.java:99)

        at
akka.remote.MessageSerializer$.serialize(MessageSerializer.scala:36)

        at
akka.remote.EndpointWriter$$anonfun$akka$remote$EndpointWriter$$serializeMessage$1.apply(Endpoint.scala:672)

        at
akka.remote.EndpointWriter$$anonfun$akka$remote$EndpointWriter$$serializeMessage$1.apply(Endpoint.scala:672)

        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)

        at
akka.remote.EndpointWriter.akka$remote$EndpointWriter$$serializeMessage(Endpoint.scala:671)

        at
akka.remote.EndpointWriter$$anonfun$7.applyOrElse(Endpoint.scala:559)

        at
akka.remote.EndpointWriter$$anonfun$7.applyOrElse(Endpoint.scala:544)

        at
scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:33)

        at akka.actor.FSM$class.processEvent(FSM.scala:595)

        at akka.remote.EndpointWriter.processEvent(Endpoint.scala:443)

        at akka.actor.FSM$class.akka$actor$FSM$$processMsg(FSM.scala:589)

        at akka.actor.FSM$$anonfun$receive$1.applyOrElse(FSM.scala:583)

        at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)

        at akka.actor.ActorCell.invoke(ActorCell.scala:456)

        at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)

        at akka.dispatch.Mailbox.run(Mailbox.scala:219)

        at
akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)

        at
scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)

        at
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)

        at
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)

        at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)


Thank you,

Mime
View raw message