nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-1262) Map `duplicating` content-types to a single type
Date Mon, 11 Jun 2012 20:23:44 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293039#comment-13293039
] 

Hudson commented on NUTCH-1262:
-------------------------------

Integrated in nutch-trunk-maven #306 (See [https://builds.apache.org/job/nutch-trunk-maven/306/])
    NUTCH-1262 Map `duplicating` content-types to a single type (Revision 1348785)

     Result = SUCCESS
markus : 
Files : 
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/conf/nutch-default.xml
* /nutch/trunk/src/plugin/index-more/src/java/org/apache/nutch/indexer/more/MoreIndexingFilter.java

                
> Map `duplicating` content-types to a single type
> ------------------------------------------------
>
>                 Key: NUTCH-1262
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1262
>             Project: Nutch
>          Issue Type: Improvement
>    Affects Versions: 1.4
>            Reporter: Markus Jelsma
>            Assignee: Markus Jelsma
>            Priority: Minor
>             Fix For: 1.6
>
>         Attachments: NUTCH-1262-1.5-1.patch, NUTCH-1262-1.5-2.patch
>
>
> Similar or duplicating content-types can end-up differently in an index. With, for example,
both application/xhtml+xml and text/html it is impossible to use a single filter to select
`web pages`.
> See also: http://lucene.472066.n3.nabble.com/application-xhtml-xml-gt-text-html-td3699942.html
> Content-Type mapping is disabled by default and is enabled via moreIndexingFilter.mapMimeTypes.
Example mapping file is provided in conf/.
> {code}
> # target MIME-type <TAB> type1 [<TAB> type2 ...]
> # Map XHTML to HTML
> text/html       application/xhtml+xml
> # Map XHTML and HTML to something else
> Web page        text/html       application/xhtml+xml
> # Map some office documents to each other
> Office document application/vnd.oasis.opendocument.text application/x-tika-msoffice
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message