storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Spico Florin <spicoflo...@gmail.com>
Subject Re: Storm topology using all the Max connections of db
Date Tue, 03 May 2016 19:48:38 GMT
hi!
  please have a look
https://github.com/apache/storm/tree/master/external/storm-jdbc where you
hve to implemnt thw interface connectionprovider interface. you have to
dins a third paty librry that provides conection pooloing for postgresql
and use that library to implement the interface connection provider. i hope
that other community member will give you some other ideas.
 i hope that these help.
regards,
 florin

On Tuesday, May 3, 2016, Sai Dilip Reddy Kiralam <
dkiralam@aadhya-analytics.com> wrote:

> to implemI'm using storm jdbc for connecting to db.how can I use pooling
> on codes on topology.please share information on connection pooling used on
> storm topologies.
>
>
>
> *Best regards,*
>
> *K.Sai Dilip Reddy.*
>
> On Thu, Apr 28, 2016 at 12:28 PM, Sai Dilip Reddy Kiralam <
> dkiralam@aadhya-analytics.com
> <javascript:_e(%7B%7D,'cvml','dkiralam@aadhya-analytics.com');>> wrote:
>
>> Hi Spico,
>>
>> I use 9 bolts with parallelism of 1 and with 1 task for each
>> bolt(default) and I'm not using any ConnectionPool for connecting to
>> postgres.Just using jdbc classe examples here is source example
>> http://storm.apache.org/releases/2.0.0-SNAPSHOT/storm-jdbc.html.
>> I will check by using the ConnectionPool.
>>
>> Thank you.
>>
>>
>>
>>
>> *Best regards,*
>>
>> *K.Sai Dilip Reddy.*
>>
>> On Thu, Apr 28, 2016 at 12:19 PM, Spico Florin <spicoflorin@gmail.com
>> <javascript:_e(%7B%7D,'cvml','spicoflorin@gmail.com');>> wrote:
>>
>>> Hello!
>>>    How many tasks do you have for inserting the data to your database?
>>> Are you using ConnectionPool for connecting to Postgres? If your number of
>>> task superseeds the number of max connections provided in connection pool
>>> then your have a problem.
>>> Please also check the number of max connections that your db accepts.
>>> I hope that these help.
>>> Regards,
>>>   Florin
>>>
>>> On Thu, Apr 28, 2016 at 7:09 AM, Sai Dilip Reddy Kiralam <
>>> dkiralam@aadhya-analytics.com
>>> <javascript:_e(%7B%7D,'cvml','dkiralam@aadhya-analytics.com');>> wrote:
>>>
>>>> Hi,
>>>>
>>>> I have topology that make connection with postgresdb and insert the
>>>> fields into tables of a test db.my topology is working fine but when I
>>>> submit the topology it is establishing all the connections of db.but I
>>>> don’t know why it is taking all the max connections.
>>>>
>>>>
>>>> below attached the pics of pg_stat_activity.
>>>>
>>>>
>>>> *Best regards,*
>>>>
>>>> *K.Sai Dilip Reddy.*
>>>>
>>>
>>>
>>
>

Mime
View raw message