storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sai Dilip Reddy Kiralam <dkira...@aadhya-analytics.com>
Subject Re: Storm topology using all the Max connections of db
Date Wed, 04 May 2016 04:23:30 GMT
Hi,

Thank you Spico Florin.



*Best regards,*

*K.Sai Dilip Reddy.*

On Wed, May 4, 2016 at 1:18 AM, Spico Florin <spicoflorin@gmail.com> wrote:

> hi!
>   please have a look
> https://github.com/apache/storm/tree/master/external/storm-jdbc where you
> hve to implemnt thw interface connectionprovider interface. you have to
> dins a third paty librry that provides conection pooloing for postgresql
> and use that library to implement the interface connection provider. i hope
> that other community member will give you some other ideas.
>  i hope that these help.
> regards,
>  florin
>
> On Tuesday, May 3, 2016, Sai Dilip Reddy Kiralam <
> dkiralam@aadhya-analytics.com> wrote:
>
>> to implemI'm using storm jdbc for connecting to db.how can I use pooling
>> on codes on topology.please share information on connection pooling used on
>> storm topologies.
>>
>>
>>
>> *Best regards,*
>>
>> *K.Sai Dilip Reddy.*
>>
>> On Thu, Apr 28, 2016 at 12:28 PM, Sai Dilip Reddy Kiralam <
>> dkiralam@aadhya-analytics.com> wrote:
>>
>>> Hi Spico,
>>>
>>> I use 9 bolts with parallelism of 1 and with 1 task for each
>>> bolt(default) and I'm not using any ConnectionPool for connecting to
>>> postgres.Just using jdbc classe examples here is source example
>>> http://storm.apache.org/releases/2.0.0-SNAPSHOT/storm-jdbc.html.
>>> I will check by using the ConnectionPool.
>>>
>>> Thank you.
>>>
>>>
>>>
>>>
>>> *Best regards,*
>>>
>>> *K.Sai Dilip Reddy.*
>>>
>>> On Thu, Apr 28, 2016 at 12:19 PM, Spico Florin <spicoflorin@gmail.com>
>>> wrote:
>>>
>>>> Hello!
>>>>    How many tasks do you have for inserting the data to your database?
>>>> Are you using ConnectionPool for connecting to Postgres? If your number of
>>>> task superseeds the number of max connections provided in connection pool
>>>> then your have a problem.
>>>> Please also check the number of max connections that your db accepts.
>>>> I hope that these help.
>>>> Regards,
>>>>   Florin
>>>>
>>>> On Thu, Apr 28, 2016 at 7:09 AM, Sai Dilip Reddy Kiralam <
>>>> dkiralam@aadhya-analytics.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I have topology that make connection with postgresdb and insert the
>>>>> fields into tables of a test db.my topology is working fine but when
I
>>>>> submit the topology it is establishing all the connections of db.but
I
>>>>> don’t know why it is taking all the max connections.
>>>>>
>>>>>
>>>>> below attached the pics of pg_stat_activity.
>>>>>
>>>>>
>>>>> *Best regards,*
>>>>>
>>>>> *K.Sai Dilip Reddy.*
>>>>>
>>>>
>>>>
>>>
>>

Mime
View raw message