spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject Re: Problem with Java and Scala interoperability // streaming
Date Wed, 19 Apr 2017 21:08:30 GMT
works now! thanks much!

On Wed, Apr 19, 2017 at 2:05 PM, kant kodali <kanth909@gmail.com> wrote:

> oops my bad. I see it now! sorry.
>
> On Wed, Apr 19, 2017 at 1:56 PM, Marcelo Vanzin <vanzin@cloudera.com>
> wrote:
>
>> I see a bunch of getOrCreate methods in that class. They were all
>> added in SPARK-6752, a long time ago.
>>
>> On Wed, Apr 19, 2017 at 1:51 PM, kant kodali <kanth909@gmail.com> wrote:
>> > There is no getOrCreate for JavaStreamingContext however I do use
>> > JavaStreamingContext inside createStreamingContext() from my code in the
>> > previous email.
>> >
>> > On Wed, Apr 19, 2017 at 1:46 PM, Marcelo Vanzin <vanzin@cloudera.com>
>> wrote:
>> >>
>> >> Why are you not using JavaStreamingContext if you're writing Java?
>> >>
>> >> On Wed, Apr 19, 2017 at 1:42 PM, kant kodali <kanth909@gmail.com>
>> wrote:
>> >> > Hi All,
>> >> >
>> >> > I get the following errors whichever way I try either lambda or
>> >> > generics. I
>> >> > am using
>> >> > spark 2.1 and scalla 2.11.8
>> >> >
>> >> >
>> >> > StreamingContext ssc = StreamingContext.getOrCreate(h
>> dfsCheckpointDir,
>> >> > () ->
>> >> > {return createStreamingContext();}, null, false);
>> >> >
>> >> > ERROR
>> >> >
>> >> > StreamingContext ssc = StreamingContext.getOrCreate(h
>> dfsCheckpointDir,
>> >> > () ->
>> >> > {return createStreamingContext();}, null, false);
>> >> >
>> >> > multiple non-overriding abstract methods found in interface Function0
>> >> >
>> >> > Note: Some messages have been simplified; recompile with
>> -Xdiags:verbose
>> >> > to
>> >> > get full output
>> >> >
>> >> > 1 error
>> >> >
>> >> > :compileJava FAILED
>> >> >
>> >> >
>> >> > StreamingContext ssc = StreamingContext.getOrCreate(h
>> dfsCheckpointDir,
>> >> > new
>> >> > Function0<StreamingContext>() {
>> >> >     @Override
>> >> >     public StreamingContext apply() {
>> >> >         return createStreamingContext();
>> >> >     }
>> >> > }, null, false);
>> >> >
>> >> >
>> >> > ERROR
>> >> >
>> >> > is not abstract and does not override abstract method apply$mcV$sp()
>> in
>> >> > Function0
>> >> >
>> >> > StreamingContext ssc = StreamingContext.getOrCreate(h
>> dfsCheckpointDir,
>> >> > new
>> >> > Function0<StreamingContext>() {
>> >> > ^
>> >> >
>> >> > 1 error
>> >> >
>> >> > :compileJava FAILED
>> >> >
>> >> >
>> >> > Thanks!
>> >> >
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Marcelo
>> >
>> >
>>
>>
>>
>> --
>> Marcelo
>>
>
>

Mime
View raw message