spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheng, Hao" <>
Subject RE: InferredSchema Example in Spark-SQL
Date Mon, 18 May 2015 00:41:06 GMT
Typo? Should be .toDF(), not .toRD()

From: Ram Sriharsha []
Sent: Monday, May 18, 2015 8:31 AM
To: Rajdeep Dua
Cc: user
Subject: Re: InferredSchema Example in Spark-SQL

you mean toDF() ? (toDF converts the RDD to a DataFrame, in this case inferring schema from
the case class)

On Sun, May 17, 2015 at 5:07 PM, Rajdeep Dua <<>>
Hi All,
Was trying the Inferred Schema spart example

I am getting the following compilation error on the function toRD()

value toRD is not a member of org.apache.spark.rdd.RDD[Person]
[error]     val people = sc.textFile("/home/ubuntu/work/spark-src/spark/examples/src/main/resources/people.txt").map(_.split(",")).map(p
=> Person(p(0), p(1).trim.toInt)).toRD()


View raw message