nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Markus Jelsma (JIRA)" <>
Subject [jira] [Updated] (NUTCH-1676) Add rudimentary SSL support to protocol-http
Date Wed, 18 Dec 2013 11:48:08 GMT


Markus Jelsma updated NUTCH-1676:

    Attachment: NUTCH-1676.patch

I think that is fine, i haven't seen any server not supporting any TLS. The worst is SSLv2
and TLSv1 so there's always TLS. But in general we don't care about security because a lot
crawls are public. If we default to TLS but make it configurable, then users can also do secure
crawls. If users want to do secure crawls, they probably want to configure cipher suites as

Here's a patch making protocols and cipher suites configurable via lib-http. The default cipher
suite list is decent enough, it has non export and anon suites. One could argue we'd remove
the RC4 suites as well. Best are on top anyway.

> Add rudimentary SSL support to protocol-http
> --------------------------------------------
>                 Key: NUTCH-1676
>                 URL:
>             Project: Nutch
>          Issue Type: Improvement
>          Components: protocol
>    Affects Versions: 1.7
>            Reporter: Julien Nioche
>             Fix For: 1.8
>         Attachments: NUTCH-1676.patch, NUTCH-1676.patch
> Adding https support to our http protocol would be a good thing even if it does not handle
the security. This would save us from having to use the http-client plugin which is buggy
in its current form. 
> Patch generated from
> Needs testing...

This message was sent by Atlassian JIRA

View raw message