spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From prabeesh <prabsma...@gmail.com>
Subject Re: spark job stuck when running on mesos fine grained mode
Date Fri, 30 May 2014 05:28:54 GMT
Hi Lukasz Jastrzebski ,

I have a question regarding Shark execution on mesos.

I am querying a file which is in hdfs and write results back to hdfs. The
problem I am facing in this is , unable to write output to hdfs. ie, when I
use the method SaveAsTextfile() , then the job is getting resubmitted. have
you ever faced such a scenario while working with shark. if so and if u
solved it can you please help us in solving the same.

14/05/30 10:16:35 INFO DAGScheduler: The failed fetch was from Stage 4
(mapPartitionsWithIndex at Operator.scala:333); marking it for resubmission
14/05/30 10:16:35 INFO DAGScheduler: Executor lost:
201405291518-3644595722-5050-17933-1 (epoch 148)






--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-job-stuck-when-running-on-mesos-fine-grained-mode-tp2326p6556.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message