spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <>
Subject Re: sqlContext vs spark.
Date Fri, 03 Feb 2017 20:20:46 GMT

Yes. Forget about SQLContext. It's been merged into SparkSession as of
Spark 2.0 (same about HiveContext).

Long live SparkSession! :-)


On 3 Feb 2017 7:48 p.m., "☼ R Nair (रविशंकर नायर)" <> wrote:


In Spark 1.6.0, we used

val jdbcDF =

for creating a data frame through hsbc.

In Spark 2.1.x, we have seen this is
val jdbcDF = *spark*.read.format(-----)

Does that mean we should not be using sqlContext going forward? Also, we
see that sqlContext is not auto initialized while running spark-shell.
Please advise, thanks

Best, Ravion

View raw message