spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From prabeesh <>
Subject Re: spark job stuck when running on mesos fine grained mode
Date Fri, 30 May 2014 05:28:54 GMT
Hi Lukasz Jastrzebski ,

I have a question regarding Shark execution on mesos.

I am querying a file which is in hdfs and write results back to hdfs. The
problem I am facing in this is , unable to write output to hdfs. ie, when I
use the method SaveAsTextfile() , then the job is getting resubmitted. have
you ever faced such a scenario while working with shark. if so and if u
solved it can you please help us in solving the same.

14/05/30 10:16:35 INFO DAGScheduler: The failed fetch was from Stage 4
(mapPartitionsWithIndex at Operator.scala:333); marking it for resubmission
14/05/30 10:16:35 INFO DAGScheduler: Executor lost:
201405291518-3644595722-5050-17933-1 (epoch 148)

View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message