spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Error: 'SparkContext' object has no attribute 'getActiveStageIds'
Date Sat, 21 Mar 2015 01:03:19 GMT
Please take a look
at core/src/main/scala/org/apache/spark/SparkStatusTracker.scala, around
line 58:
  def getActiveStageIds(): Array[Int] = {

Cheers

On Fri, Mar 20, 2015 at 3:59 PM, xing <ehomecity@gmail.com> wrote:

> getStageInfo in self._jtracker.getStageInfo below seems not
> implemented/included in the current python library.
>
>    def getStageInfo(self, stageId):
>         """
>         Returns a :class:`SparkStageInfo` object, or None if the stage
>         info could not be found or was garbage collected.
>         """
>         stage = self._jtracker.getStageInfo(stageId)
>         if stage is not None:
>             # TODO: fetch them in batch for better performance
>             attrs = [getattr(stage, f)() for f in
> SparkStageInfo._fields[1:]]
>             return SparkStageInfo(stageId, *attrs)
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/Error-SparkContext-object-has-no-attribute-getActiveStageIds-tp11136p11140.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message