knox-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lmc...@apache.org
Subject svn commit: r1596893 - in /knox: site/books/knox-0-5-0/knox-0-5-0-new.html site/books/knox-0-5-0/knox-0-5-0.html site/books/knox-0-5-0/likeised trunk/books/0.5.0/book.md
Date Thu, 22 May 2014 14:49:53 GMT
Author: lmccay
Date: Thu May 22 14:49:52 2014
New Revision: 1596893

URL: http://svn.apache.org/r1596893
Log:
broke URL Mapping out to its own subsection

Modified:
    knox/site/books/knox-0-5-0/knox-0-5-0-new.html
    knox/site/books/knox-0-5-0/knox-0-5-0.html
    knox/site/books/knox-0-5-0/likeised
    knox/trunk/books/0.5.0/book.md

Modified: knox/site/books/knox-0-5-0/knox-0-5-0-new.html
URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-5-0/knox-0-5-0-new.html?rev=1596893&r1=1596892&r2=1596893&view=diff
==============================================================================
--- knox/site/books/knox-0-5-0/knox-0-5-0-new.html (original)
+++ knox/site/books/knox-0-5-0/knox-0-5-0-new.html Thu May 22 14:49:52 2014
@@ -24,6 +24,7 @@
   </ul></li>
   <li><a href="#Gateway+Details">Gateway Details</a>
   <ul>
+    <li><a href="#URL+Mapping">URL Mapping</a></li>
     <li><a href="#Configuration">Configuration</a></li>
     <li><a href="#Knox+CLI">Knox CLI</a></li>
     <li><a href="#Authentication">Authentication</a></li>
@@ -274,7 +275,7 @@ Server: Jetty(6.1.26)
   <li>How URLs are mapped between a gateway that services multiple Hadoop clusters
and the clusters themselves</li>
   <li>How the gateway is configured through gateway-site.xml and cluster specific topology
files</li>
   <li>How to configure the various policy enfocement provider features such as authentication,
authorization, auditing, hostmapping, etc.</li>
-</ul><h3><a id="URL+Mapping"></a>URL Mapping</h3><p>The
gateway functions much like a reverse proxy. As such, it maintains a mapping of URLs that
are exposed externally by the gateway to URLs that are provided by the Hadoop cluster.</p><h4><a
id="Default+Topology+URLs"></a>Default Topology URLs</h4><p>In order
to provide compatibility with the Hadoop java client and existing CLI tools, the Knox Gateway
has provided a feature called the Default Topology. This refers to a topology deployment that
will be able to route URLs without the additional context that the gateway uses for differentiating
from one Hadoop cluster to another. This allows the URLs to match those used by existing clients
for that may access webhdfs through the Hadoop file system abstraction.</p><p>When
a topology file is deployed with a file name that matches the configured default topology
name, a specialized mapping for URLs is installed for that particular topology. This allows
the URLs that are expected by the e
 xisting Hadoop CLIs for webhdfs to be used in interacting with the specific Hadoop cluster
that is represented by the default topology file.</p><p>The configuration for
the default topology name is found in gateway-site.xml as a property called: &ldquo;default.app.topology.name&rdquo;.</p><p>The
default value for this property is &ldquo;sandbox&rdquo;.</p><p>Therefore,
when deploying the sandbox.xml topology, both of the following example URLs work for the same
underlying Hadoop cluster:</p>
+</ul></div><div id="URL+Mapping"><h3><a id="URL+Mapping"></a>URL
Mapping</h3><p>The gateway functions much like a reverse proxy. As such, it maintains
a mapping of URLs that are exposed externally by the gateway to URLs that are provided by
the Hadoop cluster.</p><h4><a id="Default+Topology+URLs"></a>Default
Topology URLs</h4><p>In order to provide compatibility with the Hadoop java client
and existing CLI tools, the Knox Gateway has provided a feature called the Default Topology.
This refers to a topology deployment that will be able to route URLs without the additional
context that the gateway uses for differentiating from one Hadoop cluster to another. This
allows the URLs to match those used by existing clients for that may access webhdfs through
the Hadoop file system abstraction.</p><p>When a topology file is deployed with
a file name that matches the configured default topology name, a specialized mapping for URLs
is installed for that particular topology. This allows the URL
 s that are expected by the existing Hadoop CLIs for webhdfs to be used in interacting with
the specific Hadoop cluster that is represented by the default topology file.</p><p>The
configuration for the default topology name is found in gateway-site.xml as a property called:
&ldquo;default.app.topology.name&rdquo;.</p><p>The default value for this
property is &ldquo;sandbox&rdquo;.</p><p>Therefore, when deploying the
sandbox.xml topology, both of the following example URLs work for the same underlying Hadoop
cluster:</p>
 <pre><code>https://{gateway-host}:{gateway-port}/webhdfs
 https://{gateway-host}:{gateway-port}/{gateway-path}/{cluster-name}/webhdfs
 </code></pre><p>These default topology URLs exist for all of the services
in the topology.</p><h4><a id="Fully+Qualified+URLs"></a>Fully Qualified
URLs</h4><p>Examples of mappings for the WebHDFS, WebHCat, Oozie and Stargate/HBase
are shown below. These mapping are generated from the combination of the gateway configuration
file (i.e. <code>{GATEWAY_HOME}/conf/gateway-site.xml</code>) and the cluster
topology descriptors (e.g. <code>{GATEWAY_HOME}/conf/topologies/{cluster-name}.xml</code>).
The port numbers show for the Cluster URLs represent the default ports for these services.
The actual port number may be different for a given cluster.</p>

Modified: knox/site/books/knox-0-5-0/knox-0-5-0.html
URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-5-0/knox-0-5-0.html?rev=1596893&r1=1596892&r2=1596893&view=diff
==============================================================================
--- knox/site/books/knox-0-5-0/knox-0-5-0.html (original)
+++ knox/site/books/knox-0-5-0/knox-0-5-0.html Thu May 22 14:49:52 2014
@@ -24,6 +24,7 @@
   </ul></li>
   <li><a href="#Gateway+Details">Gateway Details</a>
   <ul>
+    <li><a href="#URL+Mapping">URL Mapping</a></li>
     <li><a href="#Configuration">Configuration</a></li>
     <li><a href="#Knox+CLI">Knox CLI</a></li>
     <li><a href="#Authentication">Authentication</a></li>

Modified: knox/site/books/knox-0-5-0/likeised
URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-5-0/likeised?rev=1596893&r1=1596892&r2=1596893&view=diff
==============================================================================
--- knox/site/books/knox-0-5-0/likeised (original)
+++ knox/site/books/knox-0-5-0/likeised Thu May 22 14:49:52 2014
@@ -15,6 +15,7 @@ s@<h4><a id="Apache+Knox+Directory+Layou
 s@<h3><a id="Supported+Services@</div><div id="Supported+Services"><h3><a
id="Supported+Services@
 s@<h4><a id="Configure+Sandbox+port+mapping+for+VirtualBox@</div><div id="Configure+Sandbox+port+mapping+for+VirtualBox"><h4><a
id="Configure+Sandbox+port+mapping+for+VirtualBox@
 s@<h2><a id="Gateway+Details@</div><div id="Gateway+Details"><h2><a
id="Gateway+Details@
+s@<h3><a id="URL+Mapping@</div><div id="URL+Mapping"><h3><a
id="URL+Mapping@
 s@<h3><a id="Configuration@</div><div id="Configuration"><h3><a
id="Configuration@
 s@<h3><a id="Knox+CLI@</div><div id="Knox+CLI"><h3><a id="Knox+CLI@
 s@<h3><a id="Authentication@</div><div id="Authentication"><h3><a
id="Authentication@

Modified: knox/trunk/books/0.5.0/book.md
URL: http://svn.apache.org/viewvc/knox/trunk/books/0.5.0/book.md?rev=1596893&r1=1596892&r2=1596893&view=diff
==============================================================================
--- knox/trunk/books/0.5.0/book.md (original)
+++ knox/trunk/books/0.5.0/book.md Thu May 22 14:49:52 2014
@@ -31,6 +31,7 @@
     * #[Apache Knox Directory Layout]
     * #[Supported Services]
 * #[Gateway Details]
+    * #[URL Mapping]
     * #[Configuration]
     * #[Knox CLI]
     * #[Authentication]



Mime
View raw message