spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From edmond_huo <>
Subject Re: The difference between pyspark.rdd.PipelinedRDD and pyspark.rdd.RDD
Date Wed, 17 Sep 2014 14:37:40 GMT
Hi Davis, 

When I run your code in pyspark, I still get the same error:

>>> sc.parallelize(range(10)).map(lambda x: (x, str(x))).sortByKey().count()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: 'PipelinedRDD' object has no attribute 'sortByKey'

Is it the matter with spark version? I am using spark-0.7.3.


View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message