metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mmiklavc <>
Subject [GitHub] incubator-metron issue #445: METRON-706: Add Stellar transformations and fil...
Date Thu, 09 Feb 2017 19:56:33 GMT
Github user mmiklavc commented on the issue:
    Adding these timing notes about the import for reference:
    **No filter, local load, multiple threads (5), batch 128**
    real	10m22.127s
    user	11m11.873s
    sys	4m23.912s
    903392 rows
    **With filters, multiple threads (5), batch 128 (1 record less)**
    real	10m58.210s
    user	11m10.592s
    sys	4m16.585s
    903391 rows
    **MapReduce mode**
    real	9m20.566s
    user	0m26.853s
    sys	0m10.334s
    903391 rows

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message