spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From SRK <>
Subject Can SqlContext be used inside mapPartitions
Date Wed, 23 Dec 2015 00:44:34 GMT

Can SQL Context be used inside mapPartitions? My requirement is to register
a set of data from hdfs as a temp table and to be able to lookup from inside
MapPartitions based on a key. If it is not supported, is there a different
way of doing this?


View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message