metron-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (METRON-1302) Split up Indexing Topology into batch and random access sections
Date Tue, 02 Jan 2018 21:41:00 GMT

    [ https://issues.apache.org/jira/browse/METRON-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308751#comment-16308751
] 

ASF GitHub Bot commented on METRON-1302:
----------------------------------------

Github user merrimanr commented on a diff in the pull request:

    https://github.com/apache/metron/pull/831#discussion_r159321881
  
    --- Diff: metron-platform/metron-indexing/src/test/java/org/apache/metron/indexing/integration/IndexingIntegrationTest.java
---
    @@ -197,9 +140,7 @@ public void test() throws Exception {
           //assert that our input docs are equivalent to the output docs, converting the
input docs keys based
           // on the field name converter
           assertInputDocsMatchOutputs(inputDocs, docs, getFieldNameConverter());
    -      assertInputDocsMatchOutputs(inputDocs, readDocsFromDisk(hdfsDir), x -> x);
    -    } catch(Throwable e) {
    -      e.printStackTrace();
    +      //assertInputDocsMatchOutputs(inputDocs, readDocsFromDisk(hdfsDir), x -> x);
    --- End diff --
    
    Is this comment intentional?


> Split up Indexing Topology into batch and random access sections
> ----------------------------------------------------------------
>
>                 Key: METRON-1302
>                 URL: https://issues.apache.org/jira/browse/METRON-1302
>             Project: Metron
>          Issue Type: Improvement
>            Reporter: Casey Stella
>
> Currently we have the indexing topology handle writing to both random access indices
(e.g. elasticsearch) as well as batch write indices (e.g. hdfs).  We should split these up
and configure them separately.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message