spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Armbrust <mich...@databricks.com>
Subject Re: spark 1.2: value toJSON is not a member of org.apache.spark.sql.SchemaRDD
Date Tue, 06 Jan 2015 02:30:49 GMT
I think you are missing something:

$ javap -cp ~/Downloads/spark-sql_2.10-1.2.0.jar
org.apache.spark.sql.SchemaRDD|grep toJSON
  public org.apache.spark.rdd.RDD<java.lang.String> toJSON();

On Mon, Jan 5, 2015 at 3:11 AM, bchazalet <bchazalet@companywatch.net>
wrote:

> Hi everyone,
>
> I have just switched to spark 1.2.0 from 1.1.1, updating my sbt to point to
> the 1.2.0 jars.
>
>   "org.apache.spark"  %% "spark-core"              % "1.2.0",
>   "org.apache.spark"  %% "spark-sql"               % "1.2.0",
>   "org.apache.spark"  %% "spark-hive"              % "1.2.0",
>
> I was hoping to use the new SchemaRDD#toJSON among other features, but it
> seems that this method is not available in the 1.2.0 spark-sql jars. I did
> a
> 'javap SchemaRDD.class | grep toJSON' on the unarchived
> spark-sql_2.10-1.2.0.jar that I got from maven, but it's not there.
>
> The SchemaRDD#toJson is present in the  source
> <
> https://github.com/apache/spark/blob/branch-1.2/sql/core/src/main/scala/org/apache/spark/sql/SchemaRDD.scala
> >
> within the branch-1.2 branch though.
>
> I am missing something? Or wasn't that feature shipped with 1.2?
>
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/spark-1-2-value-toJSON-is-not-a-member-of-org-apache-spark-sql-SchemaRDD-tp20972.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message