nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Nutch Wiki] Update of "GoogleSummerOfCode/SitemapCrawler/week1" by CihadGuzel
Date Mon, 01 Jun 2015 19:29:07 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification.

The "GoogleSummerOfCode/SitemapCrawler/week1" page has been changed by CihadGuzel:
https://wiki.apache.org/nutch/GoogleSummerOfCode/SitemapCrawler/week1

Comment:
report of week1 is added.

New page:
|| '''Week :''' 1 (25 May 2015 - 31 May 2015) |||| [[https://wiki.apache.org/nutch/GoogleSummerOfCode/SitemapCrawler/week2|Next
week]]||

'''Title :''' Sitemap url injection is done.

Sitemap list injection is provided on this week working. The Url path of sitemap files wanted
to be injected can be defined from seed file. 

In addition, Some preparatory work related to following works is being done. 

----
Example:

If you have two sitemap files, you can define them as follow:

 * ''http://www.example.com/     sitemaps: sitemap1.xml sitemap2.xml'' 
 * ''http://www.example2.com/
 * ''http://www.example3.com/''

Mime
View raw message