gora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GORA-426) MongoDB cursor timeout on long running parse job
Date Mon, 20 Jul 2015 06:37:07 GMT

    [ https://issues.apache.org/jira/browse/GORA-426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14633091#comment-14633091
] 

ASF GitHub Bot commented on GORA-426:
-------------------------------------

Github user AlexanderYastrebov commented on the pull request:

    https://github.com/apache/gora/pull/27#issuecomment-122774999
  
    Hello @drazzib 
    
    My point is following:
    1. If you have mean page parse time (in nutch) greater than 6 seconds, you will end up
with closed cursor and failed parse run (because of default 100 batchSize and 10 min cursor
timeout).
    2. There is no evidence at all (neither in API, not in docs) for lib user that cursor
may be closed unexpectedly while reading result.
    3. (MongoDB)Result has close() method and with proper use there will leak no cursors.
    4. One more option to configure is worse than no option at all.



> MongoDB cursor timeout on long running parse job
> ------------------------------------------------
>
>                 Key: GORA-426
>                 URL: https://issues.apache.org/jira/browse/GORA-426
>             Project: Apache Gora
>          Issue Type: Bug
>          Components: gora-mongodb
>    Affects Versions: 0.6
>            Reporter: Alexander Yastrebov
>            Assignee: Damien Raude-Morvan
>              Labels: performance
>
> On long running parse job mongodb server may kill cursor by timeout (10 minutes default).
> We propose to disable server cursor timeout.
> See pull request
> https://github.com/apache/gora/pull/27



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message