nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2562) protocol-http fails to read large chunked HTTP responses
Date Thu, 10 May 2018 21:36:00 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471152#comment-16471152
] 

ASF GitHub Bot commented on NUTCH-2562:
---------------------------------------

sebastian-nagel opened a new pull request #329: NUTCH-2562 protocol-http fails to read large
chunked HTTP responses
URL: https://github.com/apache/nutch/pull/329
 
 
   - if http.content.limit is reached skip remaining chunked content
     including any headers in the trailer

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> protocol-http fails to read large chunked HTTP responses
> --------------------------------------------------------
>
>                 Key: NUTCH-2562
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2562
>             Project: Nutch
>          Issue Type: Sub-task
>    Affects Versions: 1.14
>            Reporter: Gerard Bouchar
>            Priority: Major
>             Fix For: 1.15
>
>
> While reading chunked content, if the content size becomes larger than http.getMaxContent(),
instead of just stopping and truncate the content, it tries to read a new chunk before having
read the previous one completely, resulting in a '{color:#333333}bad chunk length' error.{color}
>  
> {color:#333333}See: https://github.com/apache/nutch/blob/master/src/plugin/protocol-http/src/java/org/apache/nutch/protocol/http/HttpResponse.java#L440-L442{color}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message