metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Foley <>
Subject Re: [DISCUSS] Next Release (0.3.1) Content
Date Fri, 27 Jan 2017 21:58:59 GMT
I think I have the last formatting problem resolved for METRON-660, and plan to submit a PR
this evening.  I would like to see it added to 0.3.1.  Note that we still have to agree on
how to integrate it.

I’ve also been working on METRON-322, providing flush timeouts for batched writers.  I believe
that’s been discussed in previous sprint planning meetings? I need to rebase it, but I think
I can have it ready Monday or Tuesday, if that’s early enough to include.


On 1/26/17, 7:50 PM, "" <> wrote:

    I haven't had a chance to look through the unresolved JIRAs but I did want
    to mention a few quick things.
    First, when we released 0.3.0 and dropped the BETA flag, one of the things
    that was discussed was putting together a method of documenting upgrades
    from one version to the next.  As one of the first steps toward making that
    a reasonable process, I think we should assemble more detailed release
    notes, especially outlining non-backwards compatible changes.  In the
    "[DISCUSS] Next Release Name" email thread Kyle Richardson suggested we use
    "" to do this, and I still agree with that thought, but I'm
    open to alternatives.
    Separately, a *nice to have* would be *METRON-660*, which was discussed in
    the "[PROPOSAL] up-to-date versioned documentation" thread, to give us some
    cleaner documentation using the existing READMEs.  I'd be happy to help
    with this one, I'm just not sure what the next steps are, aside from the
    start that Matt has here
    My last *nice to have* is *METRON-635*, which I have a *PR open for here
    <>*.  If I could get
    someone else to reproduce the error that I'm seeing I would be happy to
    pursue additional testing, troubleshooting, etc.  I've seen others report
    the same issue
    on the HCC boards, so I'm fairly confident that it is not an issue with my
    local environment.
    On Thu, Jan 26, 2017 at 6:18 PM Casey Stella <> wrote:
    I took the liberty of adding the pull requests since the new year into the
    in-progress list in the previous email.  If you own one of these and do not
    believe that you can complete the review in the next week or so, let me
    know and we can remove.  The only one of these that I see as mandatory is
    METRON-650 because the reliance on the opensoc github repo might cause
    issues with the release being acceptable (see discussion by Mike Miklavcic
    with the mentors a couple weeks ago).
    On Thu, Jan 26, 2017 at 6:06 PM, Casey Stella <> wrote:
    > Hello Everyone!
    > It's been almost 2 months since the last major release and I think it
    > might be time to do a minor release of 0.3.1. The purpose of this email is
    > multifold:
    >    - to take stock of what we have already committed
    >    - figure out what (if anything) is missing to make a release that
    >    we're proud of
    >    - find volunteers for the missing items
    > For those who get email alerts on the JIRA changes, it should be no
    > surprise that I have gone through and put the committed items in the 0.3.1
    > release bucket.  So, let's take stock of what we have.
    > *What's made it so far into the next release*
    >    - METRON-283 Migrate Geo Enrichment outside of MySQL (justinleet)
    >    closes apache/incubator-metron#421
    >    - METRON-668: Remove the "tickUpdate" profile config and make the
    >    "init" phase not reset variables closes apache/incubator-metron#420
    >    - METRON-672: SolrIndexingIntegrationTest fails intermittently closes
    >    apache/incubator-metron#424
    >    - METRON-664: Make the index configuration per-writer with
    >    enabled/disabled closes apache/incubator-metron#419
    >    - METRON-600: Fix Metron Website (iraghumitra via cestella) closes
    >    apache/incubator-metron#399
    >    - METRON-666 Fix javadoc doclint errors closes
    >    apache/incubator-metron#418
    >    - METRON-659 Emulate Sensors in Development Environments (nickwallen)
    >    closes apache/incubator-metron#417
    >    - METRON-652: Extract indexing config from enrichment config closes
    >    apache/incubator-metron#415
    >    - METRON-654 Create RPM Installer for Profiler (nickwallen) closes
    >    apache/incubator-metron#413
    >    - METRON-656: Make Stellar 'in' closer to functioning like python
    >    closes apache/incubator-metron#416
    >    - METRON-532 Define Profile Period When Calling PROFILE_GET closes
    >    apache/incubator-metron#414
    >    - METRON-624: Updated Comparison/Equality Evaluations in Stellar
    >    closes apache/incubator-metron#404
    >    - METRON-644 RPM builds only work with Docker for Mac (kylerichardson)
    >    closes apache/incubator-metron#409
    >    - METRON-640: Add a Stellar function to compute shannon entropy for
    >    strings closes apache/incubator-metron#403
    >    - METRON-637: Add a STATS_BIN function to Stellar. closes
    >    apache/incubator-metron#401
    >    - METRON-622 Create a Metron Docker Compose application  (merrimanr)
    >    closes apache/incubator-metron#393
    >    - METRON-643: Stellar function documentation needs to be updated
    >    closes apache/incubator-metron#407
    >    - METRON-645 Unable to Start Fastcapa Test Environment (nickwallen)
    >    closes apache/incubator-metron#410
    >    - METRON-647 Parser unit test failures due to assumed year values
    >    (justinleet) closes apache/incubator-metron#412
    >    - METRON-639: The Network Stellar functions need to have better unit
    >    testing closes apache/incubator-metron#402
    >    - METRON-631 Broken link on fastcapa README (JonZeolla via nickwallen)
    >    closes apache/incubator-metron#398
    >    - METRON-625: Parser Filters cannot be specified from the sensor
    >    config closes apache/incubator-metron#396
    >    - METRON-587 Integration tests should use common processor
    >    implementations where possible (ottobackwards) closes
    >    apache/incubator-metron#374
    >    - METRON-616: Added support for float and long literals in Stellar
    >    closes apache/incubator-metron#392
    >    - METRON-580: Remove hard-coded Metron version from Ambari MPack code
    >    (mmiklavc) closes apache/incubator-metron#364
    >    - METRON-618 Eliminate Javac Warnings in metron-analytics (justinleet)
    >    closes apache/incubator-metron#391
    >    - METRON-364: Preserve Type for Arithmetic Expressions in Stellar
    >    closes apache/incubator-metron#390
    >    - METRON-585 Pcap Replay Fails to Stop (nickwallen) closes
    >    apache/incubator-metron#369
    >    - METRON-586 STELLAR should have FILL_LEFT and FILL_RIGHT functions
    >    (ottobackwards) closes apache/incubator-metron#370
    >    - METRON-612 Clean up Error Prone generated warnings (justinleet)
    >    closes apache/incubator-metron#389
    >    - METRON-610: OnlineStatisticsProvider serialization is broken at
    >    random in the REPL closes apache/incubator-metron#388
    >    - METRON-596 Eliminate Maven warnings from build (justinleet) closes
    >    apache/incubator-metron#378
    >    - METRON-604 Mpack installs do not work on clean machines due to
    >    missing Elastic Curator repo (justinleet) closes
    >    - METRON-607: Enrichment doc improvement and test cleanup (mmiklavc)
    >    closes apache/incubator-metron#386
    >    - METRON-606 Profiler Overwriting Previously Written Values
    >    (nickwallen) closes apache/incubator-metron#387
    >    - METRON-591: Make the website in compliance with ASF standards closes
    >    apache/incubator-metron#373
    >    - METRON-597 Sporadic Failures of Profiler Integration Tests
    >    (nickwallen) closes apache/incubator-metron#383
    >    - METRON-595 Elasticsearch Writer only uses One IP Address
    >    (JonathanRider via dlyle65535) closes apache/incubator-metron#379
    >    - METRON-593 Enable an automated static analysis tool in the build
    >    (justinleet) closes apache/incubator-metron#376
    >    - METRON-592 Change popup to Warning message in Assign Master page for
    >    Client check (anandsubbu via dlyle65535) closes
    >    - METRON-598 Add Kyle Richardson to committers (kylerichardson) closes
    >    apache/incubator-metron#382
    >    - METRON-565: apps/metron/enrichment/indexed directory path does not
    >    get created for metron cluster deployed via Ambari (mmiklavc) closes
    >    apache/incubator-metron#365
    >    - METRON-588 Remove ASF License Headers from directly copied Chef
    >    Bento Files closes apache/incubator-metron#372
    >    - METRON-576 Stellar function resolution takes too long on running
    >    cluster (nickwallen) closes apache/incubator-metron#366
    >    - METRON-570 Add Profiler Link to README (nickwallen) closes
    >    apache/incubator-metron#371
    >    - METRON-578 Missing error handling bolts for enrichment and threat
    >    intel closes apache/incubator-metron#363
    >    - METRON-522 Need to mandate Client installation on Metron Host closes
    >    apache/incubator-metron#367
    >    - METRON-584 STELLAR should have a TO_LONG Function (ottobackwards)
    >    closes apache/incubator-metron#368
    >    - METRON-575 State from different profiles can be co-mingled
    >    incorrectly (nickwallen) closes apache/incubator-metron#362
    >    - METRON-538 Ensure proper shutdown, exceptions of integration test
    >    components (ottobackwards) closes apache/incubator-metron#344
    >    - METRON-567 Usernames as numerics strings attempted to be parsed and
    >    compared as numbers (ottobackwards) closes apache/incubator-metron#360
    >    - METRON-562: Add rudimentary statistical outlier detection closes
    >    apache/incubator-metron#352
    >    - METRON-557 Create Stellar Functions for Kafka (nickwallen) closes
    >    apache/incubator-metron#354
    >    - METRON-556 Profiler - Refactor 'Group By' Calculation (nickwallen)
    >    closes apache/incubator-metron#348
    >    - METRON-547 MaasIntegrationTests should integrate with the Metron
    >    Integration classes (ottobackwards) closes apache/incubator-metron#350
    >    - METRON-561 ShellEditor tests hang if vim is set as EDITOR in your
    >    profile (ottobackwards) closes apache/incubator-metron#351
    > *What else will make it?*
    > Ok, so now that we know what's in there already, I need to ask your help
    > in determining what you want in the next release that is not currently
    > being worked on.  In order to do that, please help me by responding to
    > email and
    >    - proposing and justifying a JIRA from the list of unresolved JIRAs
    >    <>
    >    are not currently scheduled and let me know which ones should be
    >    Please include whether the JIRA is "Nice to Have" or "Critical to
    Have" and
    >    if you volunteer to do it.
    >    - proposing and justifying that one of the in-progress tasks
    >    <
    >     should *not* be included for release
    > I'd like to aim to get release candidates out as soon as possible, so
    > let's look forward a vigorous discussion and a great release.
    > Thanks for the contributions and for your continued engagement in the
    > Metron community.  If you see something that you don't like in this
    > process, please let me know.  Feedback is very welcome.
    > Best,
    > Casey
    Sent from my mobile device

View raw message