sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jarek Jarcec Cecho <jar...@apache.org>
Subject Re: sqoop to re-use connections
Date Sat, 29 Mar 2014 16:04:49 GMT
Well, you can definitely try it out. However that proxy would have keep pre-allocated thread
pool in order for this to work correctly - remember that Sqoop will open several parallel
connections and that you do not have entire control when.

Jarcec

On Thu, Mar 27, 2014 at 06:35:01PM +0100, Mathieu Despriee wrote:
> Ok, thanks for your answer.
> 
> I was thinking about using a kind of 'jdbc proxy' on some host to manage
> this pb.
> What do you think ?
> 
> Mathieu
> 
> 
> 
> 2014-03-27 17:09 GMT+01:00 Jarek Jarcec Cecho <jarcec@apache.org>:
> 
> > Hi Mathieu,
> > Sqoop will open several parallel connections to your database from
> > different machines in your Hadoop cluster. I'm afraid that you do not have
> > much control over when and how the connections are created.
> >
> > Jarcec
> >
> > On Mon, Mar 24, 2014 at 05:10:02PM +0100, Mathieu Despriee wrote:
> > > Hi folks,
> > >
> > > Here, I have a constraint on my source database : I can use connections
> > for
> > > how long I want, but I cannot reopen again and again connections (the
> > > password has a limited validity, not the connections)
> > >
> > > So I would like to re-use a single jdbc connection to collect several
> > > tables.
> > >
> > > Is it possible ?
> > >
> > > PS : I'm a beginner in sqoop, please apologize if it's a documented
> > > question. I didn't find
> > >
> > > thanks
> > > Mathieu
> >

Mime
View raw message