giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dionysios Logothetis (Jira)" <j...@apache.org>
Subject [jira] [Resolved] (GIRAPH-942) RexsterUtils drops some data when it reads data from Titan DB
Date Tue, 12 May 2020 18:18:00 GMT

     [ https://issues.apache.org/jira/browse/GIRAPH-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dionysios Logothetis resolved GIRAPH-942.
-----------------------------------------
    Resolution: Abandoned

> RexsterUtils drops some data when it reads data from Titan DB
> -------------------------------------------------------------
>
>                 Key: GIRAPH-942
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-942
>             Project: Giraph
>          Issue Type: Bug
>         Environment: - Ubuntu 12.04
> - Hadoop 1.2.1
> - Giraph trunk
> - Titan 0.4.4
>            Reporter: Seong-il Lee
>            Priority: Minor
>         Attachments: GIRAPH-942.patch
>
>
> *Problem:*
> When Giraph reads data from Titan DB via RexsterUtils.
> Giraph can't read whole data from TitanDB.
> *Reason:*
> RexsterUtils split the data to chunk as many as number of map tasks.
> But Giraph use map tasks - 1 workers (one for master), except SplitMasterWorker=false
option used.
> So, Giraph drop some data as much as a chunk.
> *Solution:*
> I modified code for RexsterUtils.java
> - before
> chunks : number of map tasks
> - after
> chunks : number of available workers



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message