nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doğacan Güney (JIRA) <j...@apache.org>
Subject [jira] Updated: (NUTCH-434) Replace usage of ObjectWritable with something based on GenericWritable
Date Sat, 24 Feb 2007 13:37:05 GMT

     [ https://issues.apache.org/jira/browse/NUTCH-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Doğacan Güney updated NUTCH-434:
--------------------------------

    Attachment: NUTCH-434.patch

This patch adds two new classes: GenericWritableConfigurable which extends GenericWritable
and can inject confs and NutchWritable which can wrap most of the Nutch-specific writables
(I may have missed some).

This patch also updates Indexer, Segment{Reader,Merger} and MetaWrapper to use NutchWritable
instead of ObjectWritable.

> Replace usage of ObjectWritable with something based on GenericWritable
> -----------------------------------------------------------------------
>
>                 Key: NUTCH-434
>                 URL: https://issues.apache.org/jira/browse/NUTCH-434
>             Project: Nutch
>          Issue Type: Improvement
>            Reporter: Sami Siren
>         Attachments: NUTCH-434.patch
>
>
> We should replace the usage of ObjectWritable and classes extending it with class extending
GenericWritable. Classes based on GenericWritable have smaller footprint on disc and the baseclass
also does not contain any classes that are Deprecated.
> There is one problem though: the ParseData currently needs Configuration object before
it can deserialize itself and GenericWritable
> doesn't provide a way to inject configuration in. We could either a) remove the need
for Configuration, or b) write a class similar to GenericWritable that does conf injecting.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message