spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From edmond_huo <huoxiang5...@gmail.com>
Subject Re: The difference between pyspark.rdd.PipelinedRDD and pyspark.rdd.RDD
Date Wed, 17 Sep 2014 14:37:40 GMT
Hi Davis, 

When I run your code in pyspark, I still get the same error:

>>> sc.parallelize(range(10)).map(lambda x: (x, str(x))).sortByKey().count()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: 'PipelinedRDD' object has no attribute 'sortByKey'

Is it the matter with spark version? I am using spark-0.7.3.

Thanks.



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/The-difference-between-pyspark-rdd-PipelinedRDD-and-pyspark-rdd-RDD-tp14421p14449.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message