spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manoj Samel <manojsamelt...@gmail.com>
Subject Error in SparkSQL Example
Date Sun, 30 Mar 2014 14:31:30 GMT
Hi,

On
http://people.apache.org/~pwendell/catalyst-docs/sql-programming-guide.html,
I am trying to run code on "Writing Language-Integrated Relational Queries"
( I have 1.0.0 Snapshot ).

I am running into error on

val people: RDD[Person] // An RDD of case class objects, from the first
example.

scala> val people: RDD[Person]
<console>:19: error: not found: type RDD
       val people: RDD[Person]
                   ^

scala> val people: org.apache.spark.rdd.RDD[Person]
<console>:18: error: class $iwC needs to be abstract, since value people is
not defined
class $iwC extends Serializable {
      ^

Any idea what the issue is ?

Also, its not clear what does the RDD[Person] brings. I can run the DSL
without the case class objects RDD ...

val people =
sc.textFile("examples/src/main/resources/people.txt").map(_.split(",")).map(p
=> Person(p(0), p(1).trim.toInt))

val teenagers = people.where('age >= 13).where('age <= 19)

Thanks,

Mime
View raw message