gora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GORA-426) MongoDB cursor timeout on long running parse job
Date Mon, 20 Jul 2015 06:37:07 GMT

    [ https://issues.apache.org/jira/browse/GORA-426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14633091#comment-14633091

ASF GitHub Bot commented on GORA-426:

Github user AlexanderYastrebov commented on the pull request:

    Hello @drazzib 
    My point is following:
    1. If you have mean page parse time (in nutch) greater than 6 seconds, you will end up
with closed cursor and failed parse run (because of default 100 batchSize and 10 min cursor
    2. There is no evidence at all (neither in API, not in docs) for lib user that cursor
may be closed unexpectedly while reading result.
    3. (MongoDB)Result has close() method and with proper use there will leak no cursors.
    4. One more option to configure is worse than no option at all.

> MongoDB cursor timeout on long running parse job
> ------------------------------------------------
>                 Key: GORA-426
>                 URL: https://issues.apache.org/jira/browse/GORA-426
>             Project: Apache Gora
>          Issue Type: Bug
>          Components: gora-mongodb
>    Affects Versions: 0.6
>            Reporter: Alexander Yastrebov
>            Assignee: Damien Raude-Morvan
>              Labels: performance
> On long running parse job mongodb server may kill cursor by timeout (10 minutes default).
> We propose to disable server cursor timeout.
> See pull request
> https://github.com/apache/gora/pull/27

This message was sent by Atlassian JIRA

View raw message