sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Attila Szabo <asz...@cloudera.com>
Subject Re: Ivy local resolve
Date Mon, 09 May 2016 07:27:29 GMT
Hey Jarcec,

Sorry for this, but I've forgot this one...

Please find my proposed changes here:


Please also review it when you'll have time for that!


On Thu, Apr 21, 2016 at 4:30 PM, Jarek Jarcec Cecho <jarcec@apache.org>

> Hi Attila,
> thank you for looking into how to make Sqoop 1 compilation faster. I’m
> also in the camp of devs who is affected by the turn around of at least 3
> minutes for one simple change :( I’m sadly not an ivy expert either, but
> I’m sure that we can do some staged approach to make at least option to
> build faster. Could you open a JIRA and attach the patch there? Sadly our
> mailing lists doesn’t allow attachments so the patch did not made it to
> list.
> Jarcec
> > On Apr 18, 2016, at 4:26 AM, Attila Szabo <aszabo@cloudera.com> wrote:
> >
> > Hi all,
> >
> > First let me introduce myself to the community:
> > I'm Attila Szabo. I'm a software engineer at Cloudera since Oct. 2015,
> and I've just recently (March this year) started to contribute Sqoop. So as
> you can see I'm quite new in this community, but also I'm very enthusiastic
> to join the Sqoop development.
> >
> > I'd like to ask a question about Ivy resolve, and how to make it
> affective.
> > I have to highlight that I'm not an ant or ivy expert, so maybe this is
> possible I've missed something!
> >
> > However I've faced the following issue on my dev pc:
> >
> > Every ant operation is very slow at me, because regardless I have the
> artifacts in my local ivy cache or not, it goes to the maven2 repo to check
> something connected to the resolve process. It doesn't download anything,
> as I've already got the dependencies, however this process is still quite
> slow (on my home network for example it could take 2-5 minutes).
> >
> > I've seen that it looks for the dependencies in the local .m2
> repository, but usually I do not have those artifacts in my local .m2 and
> also for me it would make sense to have a maven independent solution.
> >
> > So I've read a few things about ivy resolver, and got a workaround
> (details in the attached patch file), which provides another FS related
> resolver points to my local ivy cache, and that gives the required
> performance for me (10 seconds max the resolve phase, once I've downloaded
> all the dependencies).
> >
> > My questions are the following:
> >       • Is it a valid solution, or did I make any fundamental mistakes?
> >       • If the ivy cache related way is not preferred (by any reason),
> is there any EZ to access and run solution to have the related artifacts
> installed/downloaded in my local maven repo.
> >       • Is there any other way to have a fast resolution without
> "hacking" around the ivysettings or the local maven repo (it is possible
> I've just missed an ant task, or something in the docs).
> > Many thanks for the help,
> >
> >
> > --
> > Best regards,
> >
> > Attila Szabo
> > Sotware Engineer
> >
> >

Best regards,

Attila Szabo
Sotware Engineer


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message