spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Proust GZ Feng <>
Subject Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0
Date Wed, 29 Jul 2015 02:33:13 GMT
Although I'm not sure how valuable Cygwin support it is, at least the 
release notes need mention that Cygwin is not supported by design from 

>From the description of the changeset, looks like remove the supporting is 
not intended by the author


From:   Sachin Naik <>
To:     Sean Owen <>
Cc:     Steve Loughran <>, Proust GZ 
Feng/China/IBM@IBMCN, "" <>
Date:   07/29/2015 05:05 AM
Subject:        Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0

I agree with Sean - using virtual box on windows and using linux vm is a 
lot easier than trying to circumvent the cygwin oddities. a lot of 
functionality might not work in cygwin and you will end up trying to do 
back patches. Unless there is a compelling reason - cygwin support seems 
not required 

@sachinnaik from iphone

On Jul 28, 2015, at 1:25 PM, Sean Owen <> wrote:

> That's for the Windows interpreter rather than bash-running Cygwin. I
> don't know it's worth doing a lot of legwork for Cygwin, but, if it's
> really just a few lines of classpath translation in one script, seems
> reasonable.
> On Tue, Jul 28, 2015 at 9:13 PM, Steve Loughran <> 
>> there's a spark-submit.cmd file for windows. Does that work?
>> On 27 Jul 2015, at 21:19, Proust GZ Feng <> wrote:
>> Hi, Spark Users
>> Looks like Spark 1.4.0 cannot work with Cygwin due to the removing of 
>> support in bin/spark-class
>> The changeset is

>> The changeset said "Add a library for launching Spark jobs
>> programmatically", but how to use it in Cygwin?
>> I'm wondering any solutions available to make it work in Windows?
>> Thanks
>> Proust
> ---------------------------------------------------------------------
> To unsubscribe, e-mail:
> For additional commands, e-mail:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message