storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kunal Gupta <kunal.gu...@kartrocket.com>
Subject Re: Unable to Ingest real time data from TridentDruidBeam to Druid datastore
Date Wed, 22 Feb 2017 14:36:57 GMT
Yes I did,  TridentDruidBeam is creating task in druid and able to send
message to druid but druid is not creating a datasource and segments in
datasource.

On 22 Feb 2017 20:04, "Manikumar" <manikumar.reddy@gmail.com> wrote:

> Did you enable druid tranquility library debug logs on storm side? any
> errors?
>
> On Wed, Feb 22, 2017 at 6:50 PM, Kunal Gupta <kunal.gupta@kartrocket.com>
> wrote:
>
>> Hi,
>>
>> Just one update I am running all druid nodes without relatime node of
>> druid, so is it compulsory to run realtimenode for this type of
>> architecture?
>>
>> On Wed, Feb 22, 2017 at 6:03 PM, Kunal Gupta <kunal.gupta@kartrocket.com>
>> wrote:
>>
>>> By default logging is enabled but unable to see any error.
>>>
>>> On Wed, Feb 22, 2017 at 5:56 PM, Kunal Gupta <kunal.gupta@kartrocket.com
>>> > wrote:
>>>
>>>> Hi,
>>>>
>>>> I have logs for indexing task , PFA indexing task logs.
>>>>
>>>> Can you guess what went wrong at my side?
>>>>
>>>> On Wed, Feb 22, 2017 at 5:51 PM, Manikumar <manikumar.reddy@gmail.com>
>>>> wrote:
>>>>
>>>>> Pl enable druid logs and check for any errors in druid task/overlord
>>>>> logs.
>>>>>
>>>>> On Wed, Feb 22, 2017 at 5:43 PM, Kunal Gupta <
>>>>> kunal.gupta@kartrocket.com> wrote:
>>>>>
>>>>>> Any update on this issue ?
>>>>>>
>>>>>> On Wed, Feb 22, 2017 at 3:21 PM, Kunal Gupta <
>>>>>> kunal.gupta@kartrocket.com> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I am using Storm version 1.0.1 and druid 0.9.0
>>>>>>>
>>>>>>> I have written a trident Topology which do some pre-aggregation
and
>>>>>>> then persist data into druid but the last step of persistence
is not
>>>>>>> working for me.
>>>>>>>
>>>>>>> *Please help me out.*
>>>>>>>
>>>>>>> When I submit the topology to storm, its start well and invoke
>>>>>>> indexing task in druid which run well but don't ingest data into
druid, I
>>>>>>> can see logs in storm too that event has been sent to druid but
I can't see
>>>>>>> anything on druid. As well as no datasource get created after
assigning
>>>>>>> indexing task to druid.
>>>>>>>
>>>>>>> PFA all files with DruidBeamFactoryImpl.java is implemented druid
>>>>>>> beam factory file and RealTimeTopology.java is trident topology
mail file.
>>>>>>>
>>>>>>> *Please reach me out soon, I have to close this project soon.*
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> *Thanks **Kunal*
>>>>>>> *+91-9958189589*
>>>>>>> *Senior Software Engineer*
>>>>>>>
>>>>>>>
>>>>>>> *Bigfoot Retail Solutions Pvt Ltd.Khasra No. 264, Westend Marg,
>>>>>>> Saidulajab, Saket 110030http://www.kartrocket.com
>>>>>>> <http://www.kartrocket.com/>*
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Thanks **Kunal*
>>>>>> *+91-9958189589*
>>>>>> *Senior Software Engineer*
>>>>>>
>>>>>>
>>>>>> *Bigfoot Retail Solutions Pvt Ltd.Khasra No. 264, Westend Marg,
>>>>>> Saidulajab, Saket 110030http://www.kartrocket.com
>>>>>> <http://www.kartrocket.com/>*
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> *Thanks **Kunal*
>>>> *+91-9958189589*
>>>> *Senior Software Engineer*
>>>>
>>>>
>>>> *Bigfoot Retail Solutions Pvt Ltd.Khasra No. 264, Westend Marg,
>>>> Saidulajab, Saket 110030http://www.kartrocket.com
>>>> <http://www.kartrocket.com/>*
>>>>
>>>
>>>
>>>
>>> --
>>> *Thanks **Kunal*
>>> *+91-9958189589*
>>> *Senior Software Engineer*
>>>
>>>
>>> *Bigfoot Retail Solutions Pvt Ltd.Khasra No. 264, Westend Marg,
>>> Saidulajab, Saket 110030http://www.kartrocket.com
>>> <http://www.kartrocket.com/>*
>>>
>>
>>
>>
>> --
>> *Thanks **Kunal*
>> *+91-9958189589*
>> *Senior Software Engineer*
>>
>>
>> *Bigfoot Retail Solutions Pvt Ltd.Khasra No. 264, Westend Marg,
>> Saidulajab, Saket 110030http://www.kartrocket.com
>> <http://www.kartrocket.com/>*
>>
>
>

Mime
View raw message