spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sujith chacko <sujithchacko.2...@gmail.com>
Subject Re: sessionState could not be accessed in spark-shell command line
Date Thu, 07 Sep 2017 06:21:53 GMT
If your intention is to just view the logical plan in spark shell  then I
think you can follow the query which I mentioned in previous mail.  In
spark 2.1.0 sessionState is a private member which you cannot access.

Thanks.


On Thu, 7 Sep 2017 at 11:39 AM, ChenJun Zou <stephen.zcj@gmail.com> wrote:

> spark-2.1.1 I use
>
>
>
> 2017-09-07 14:00 GMT+08:00 sujith chacko <sujithchacko.2010@gmail.com>:
>
>> Hi,
>>     may I know which version of spark you are using, in 2.2 I tried with
>> below query in spark-shell for viewing the logical plan and it's working
>> fine
>>
>> spark.sql("explain extended select * from table1")
>>
>> The above query you can use for seeing logical plan.
>>
>> Thanks,
>> Sujith
>>
>> On Thu, 7 Sep 2017 at 11:03 AM, ChenJun Zou <stephen.zcj@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> when I use spark-shell to get the logical plan of  sql, an error occurs
>>>
>>> scala> spark.sessionState
>>> <console>:30: error: lazy value sessionState in class SparkSession
>>> cannot be accessed in org.apache.spark.sql.SparkSession
>>>        spark.sessionState
>>>              ^
>>>
>>> But if I use spark-submit to access the "sessionState" variable, It's
>>> OK.
>>>
>>> Is there a way to access it in spark-shell?
>>>
>>
>

Mime
View raw message