sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From SHANKAR REDDY <sankara.teluku...@gmail.com>
Subject Re: Sqoop Server
Date Thu, 22 Jan 2015 07:46:02 GMT
Hi Veena,
Thanks for the update.

SQOOP-2033 created to  accommodate Technical guide of Sqoop server.

Let me go though the Wiki and keep you posted if any questions.

-Sankar

Thanks,
Sankara,
M : 510 936 0999

On Wed, Jan 21, 2015 at 4:25 PM, Veena Basavaraj <vbasavaraj@cloudera.com>
wrote:

> Shankar,
>
> I created a wiki to explain the sqoop server internals. Wrote another wiki
> to explain all the sqoop entities we have and their relationship to others.
>
> https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+2+(1.99.4)+Entity+Nomenclature+and+Relationships
>
> lmk, if this helps you understand sqoop, feedback and suggestions to
> improve wiki always welcome
>
> Veena
>
>
>
>
> Best,
> *./Vee*
>
> On Wed, Jan 21, 2015 at 8:19 AM, Veena Basavaraj <vbasavaraj@cloudera.com>
> wrote:
>
> > Hey Shankar,
> >
> > Good point, I do not see a technical guide of the Sqoop Server ( nor a
> > comprehensive design doc). Please add a doc ticket for it and we can
> create
> > one together.
> >
> > Here are some quick details that might help you. I am assuming you have
> > some basic exposure to how tomcat works.
> >
> > 1. Sqoop-server uses tomcat web server, it is very bare bones. The main
> > entry point is the TomcatToolRunner
> > <
> https://github.com/apache/sqoop/blob/sqoop2/tomcat/src/main/java/org/apache/sqoop/tomcat/TomcatToolRunner.java>
> ,
> > it bootstraps the tomcat and loads all the sqoop related classes into its
> > class path.
> >
> > 2. The main hook for the sqoop server to start is this entry in the
> > web.xml. Tomcat invokes it callbacks as it bootups and we use the
> >
> > contextInitialized callback to initialize all the related code.
> >
> >  <!-- Listeners -->
> >
> >   <listener>
> >
> >
> >
> <listener-class>org.apache.sqoop.server.ServerInitializer</listener-class>
> >
> >   </listener>
> >
> > 3. SqoopServer.initialize() is the main entry point.
> >
> > 4. There are a bunch of servlets in web.xml :
> >
> https://github.com/apache/sqoop/blob/sqoop2/server/src/main/webapp/WEB-INF/web.xml
> >
> > They receive the requests and process it. Each Servlet has its
> > corresponding handler class that handles the request for that servlet. It
> > then internally calls the internal sqoop core/ common code.
> >
> > All the rest APIs supported are documented here:
> > http://sqoop.apache.org/docs/1.99.4/RESTAPI.html#id1
> >
> > There is also the Sqoop-client that used to invoke the Sqoop-server
> > methods via the jersey REST client, Recently it was switched to
> Hadoop-auth
> > for adding Kerberos support that are documented herehttps://
> > cwiki.apache.org/confluence/display/SQOOP/Security+Guide+On+Sqoop+2
> >
> >
> > Hope this helps!
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > Best,
> > *./Vee*
> >
> > On Tue, Jan 20, 2015 at 9:51 PM, SHANKAR REDDY <
> > sankara.telukutla@gmail.com> wrote:
> >
> >> Team,
> >> Any one can share information about Sqoop server documentation or slides
> >> should helpful for me.
> >>
> >> Thanks in advance.
> >>
> >> -Sankar
> >>
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message