spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bill Jay <bill.jaypeter...@gmail.com>
Subject Re: Spark Streaming: no job has started yet
Date Wed, 23 Jul 2014 18:36:19 GMT
The code is pretty long. But the main idea is to consume from Kafka,
preprocess the data, and groupBy a field. I use mutliple DStream to add
parallelism to the consumer. It seems when the number of DStreams is large,
this happens often.

Thanks,

Bill


On Tue, Jul 22, 2014 at 11:13 PM, Akhil Das <akhil@sigmoidanalytics.com>
wrote:

> Can you paste the piece of code?
>
> Thanks
> Best Regards
>
>
> On Wed, Jul 23, 2014 at 1:22 AM, Bill Jay <bill.jaypeterson@gmail.com>
> wrote:
>
>> Hi all,
>>
>> I am running a spark streaming job. The job hangs on one stage, which
>> shows as follows:
>>
>> Details for Stage 4
>> Summary Metrics No tasks have started yetTasksNo tasks have started yet
>>
>>
>>
>> Does anyone have an idea on this?
>>
>> Thanks!
>>
>> Bill
>> Bill
>>
>
>

Mime
View raw message