spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yong Zhang <>
Subject Re: RDD can not convert to df, thanks
Date Fri, 17 Mar 2017 11:06:50 GMT
You also need the import the sqlContext implicits

import sqlContext.implicits._


From: 萝卜丝炒饭 <>
Sent: Friday, March 17, 2017 1:52 AM
To:; user
Subject: Re: RDD can not convert to df, thanks

More info,I have imported the implicitics of sparksession.

From: ""<>
Date: 2017/3/17 11:48:43
To: "user"<>;
Subject: RDD can not convert to df, thanks

hi all,

when i try to convert rdd to DF, I meet errors like belowing:

value toDF is not a member of org.apache.spark.rdd.RDD[XXXXX]
possible causer:may be a semicolon is missing before value toDF

My code looks like:

spark.textfile(xxxx).map(s=>_.split(".")).map(  s=>AAA(1,2)).toDF

the code can pass the compile but when run, it meet errors.

AAA is my defined case class.
my spark is 2.11.

Would any one can help me please?

thanks advanced.

View raw message