spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Patrick Woody <>
Subject Re: Get Spark version before starting context
Date Sat, 04 Jul 2015 20:09:08 GMT
To somewhat answer my own question - it looks like an empty request to the
rest API will throw an error which returns the version in JSON as well.
Still not ideal though. Would there be any objection to adding a simple
version endpoint to the API?

On Sat, Jul 4, 2015 at 4:00 PM, Patrick Woody <>

> Hey all,
> Is it possible to reliably get the version string of a Spark cluster prior
> to trying to connect via the SparkContext on the client side? Most of the
> errors I've seen on mismatched versions have been cryptic, so it would be
> helpful if I could throw an exception earlier.
> I know it is contained the HTML of the master, but an API point would also
> be helpful. Does this exist?
> Thanks!
> -Pat

View raw message