metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Miklavcic <michael.miklav...@gmail.com>
Subject Re: [DISCUSS] Metron release 0.4.1
Date Wed, 30 Aug 2017 15:27:51 GMT
I have some work around fixing how we handle config with Ambari that I'd
like to see go in. No PR yet, but coming soon. I expect to have this by the
RC deadline.

Mike

On Wed, Aug 30, 2017 at 8:57 AM, Nick Allen <nick@nickallen.org> wrote:

> The following PRs are usability enhancements for the Profiler.  They are
> fairly simple and I think are very helpful for troubleshooting.  I don't
> want to hold up the release, but it would be a "nice to have" to get these
> in.
>
> If anyone has cycles, I would appreciate some reviews of these PRs.
> https://github.com/apache/metron/pull/721
> https://github.com/apache/metron/pull/716
>
>
>
> On Tue, Aug 29, 2017 at 8:59 PM Matt Foley <mattf@apache.org> wrote:
>
> > Okay, just to be clear, you’re requesting we wait until Friday, if
> > necessary, to cut an RC with 717 in it?
> > Thanks,
> > --Matt
> >
> > On 8/29/17, 11:45 AM, "Casey Stella" <cestella@gmail.com> wrote:
> >
> >     709 is in and 717 is under concerted review by Otto.  I'd like to see
> > it in
> >     by Friday.
> >
> >     On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley <mattf@apache.org>
> wrote:
> >
> >     > Hi all,
> >     > Thanks for your inputs.  The three PRs Nick mentioned have been
> >     > successfully closed.
> >     > Casey, do you have an ETA for these two PRs? (PR#709 and 717)
> >     > Thanks,
> >     > --Matt
> >     >
> >     > On 8/29/17, 9:34 AM, "Casey Stella" <cestella@gmail.com> wrote:
> >     >
> >     >     For my PRs, I'd vote for METRON-1122 being in (commit very
> > imminent).
> >     >     I'd very much like METRON-1134 to be in as well.
> >     >
> >     >     Beyond that, I'm ok
> >     >
> >     >     On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen <
> nick@nickallen.org>
> >     > wrote:
> >     >
> >     >     > Thanks for starting the process, Matt.
> >     >     >
> >     >     > These are my own open PRs that I would most like to see get
> in.
> >     > They all
> >     >     > relate to the Profiler. My other outstanding PRs are less
> > important.
> >     >     >
> >     >     >    - https://github.com/apache/metron/pull/705
> >     >     >    - https://github.com/apache/metron/pull/707
> >     >     >    - https://github.com/apache/metron/pull/708
> >     >     >
> >     >     >
> >     >     >
> >     >     >
> >     >     >
> >     >     > On Tue, Aug 22, 2017 at 4:17 PM Matt Foley <mattf@apache.org
> >
> > wrote:
> >     >     >
> >     >     > > Hello all,
> >     >     > > At the meeting this morning, the community expressed the
> > wish to
> >     > create a
> >     >     > > new release, to be a point release and not including
> > METRON-777.
> >     >     > >
> >     >     > > Therefore, I propose to create release 0.4.1 from Metron
> > master
> >     > branch,
> >     >     > > with whatever additional commits the community considers
> > vital and
> >     > can
> >     >     > get
> >     >     > > in in the next few days.
> >     >     > >
> >     >     > > There have been 74 commits since the 0.4.0 release (list
> > appended
> >     > to end
> >     >     > > of this message).
> >     >     > > I have not yet done a compare to make sure all 74 completed
> >     > commits have
> >     >     > > closed their Jiras, but I will follow up with that info.
> >     >     > >
> >     >     > > There are 35 open PRs, see
> > https://github.com/apache/metron/pulls
> >     > ,
> >     >     > which
> >     >     > > is getting a little clunky.  Surely not all of them can get
> > in in
> >     > the
> >     >     > next
> >     >     > > few days, but do we want to try to close and include some
> of
> > them?
> >     >     > >
> >     >     > > Please respond to the list with your requests to include
> > specific
> >     >     > > additional PRs before we cut the 0.4.1 release candidate.
> > Let’s
> >     > keep it
> >     >     > > practical so we don’t delay more than a week or so.
> >     >     > >
> >     >     > > TIMEFRAME:  Tentatively I would like to start the process
> of
> >     > cutting an
> >     >     > RC
> >     >     > > this coming Monday 28 August.  If we have too many PRs
> > required to
> >     > be in,
> >     >     > > we may have to slip that.  Likewise, if there is need for
> > urgency,
> >     > I can
> >     >     > > start as soon as tomorrow.  We will be guided by your
> > responses.
> >     >     > >
> >     >     > > Thanks,
> >     >     > > --Matt
> >     >     > > (Release Manager)
> >     >     > >
> >     >     > > COMPLETED PRs as of 22 Aug 2017:
> >     >     > >     METRON-1115 Jackson is not properly serializing
> > readMetadata
> >     > and
> >     >     > > mergeMetadata SensorParserConfig properties  (merrimanr)
> > closes
> >     >     > > apache/metron#703
> >     >     > >     METRON-1047 REST should use core-site.xml for Hadoop
> >     > configuration
> >     >     > > (merrimanr) closes apache/metron#672
> >     >     > >     METRON-1111 Mislabeled Configuration Property in Ambari
> >     > (nickwallen)
> >     >     > > closes apache/metron#698
> >     >     > >     METRON-1113 UpdateControllerIntegrationTest fails with
> > 500
> >     > error
> >     >     > > (merrimanr) closes apache/metron#701
> >     >     > >     METRON-711 StellarShell assigns variables even if an
> > exception
> >     > was
> >     >     > > thrown in the statement. (ottobackwards) closes
> > apache/metron#686
> >     >     > >     METRON-1110 REST jvm flags property is being
> overwritten
> > when
> >     >     > Kerberos
> >     >     > > is enabled (merrimanr) closes apache/metron#697
> >     >     > >     METRON-739 Create Local Profile Runner (nickwallen)
> > closes
> >     >     > > apache/metron#693
> >     >     > >     METRON-1109 Indexing topology fails to start after
> > Kerberos is
> >     >     > enabled
> >     >     > > (merrimanr) closes apache/metron#696
> >     >     > >     METRON-1108 Metron configuration tabs are not showing
> up
> > in
> >     > Ambari
> >     >     > > this closes apache/incubator-metron#695
> >     >     > >     METRON-1078 Metron Indexing fails to stop during
> > &quot;Stop All
> >     >     > > Services&quot; (dlyle65535) closes apache/metron#680
> >     >     > >     METRON-1104 Build Failure - Due to Bootstrap version
> > change
> >     >     > > (iraghumitra via justinleet) closes apache/metron#691
> >     >     > >     METRON-1094 MaaS will not start due to classpath error
> >     > relating to
> >     >     > > Yarn closes apache/incubator-metron#688
> >     >     > >     METRON-1102 Add support for ingesting cybox URI
> > observables
> >     > from
> >     >     > taxii
> >     >     > > feeds closes apache/incubator-metron#689
> >     >     > >     METRON-838 Incorrect set of ts in FireEye parser
> (bjigmp
> > via
> >     >     > > justinleet) closes apache/metron#528
> >     >     > >     METRON-322 Global Batching and Flushing (mattf-horton)
> > closes
> >     >     > > apache/metron#481
> >     >     > >     METRON-988 UI for viewing alerts generated by Metron
> >     > (iraghumitra
> >     >     > via
> >     >     > > nickwallen) closes apache/metron#620
> >     >     > >     METRON-1084 Management UI web server license should be
> > Apache
> >     >     > > (merrimanr) closes apache/metron#683
> >     >     > >     METRON-1026 threatintel_taxii_load.sh throws exception
> > closes
> >     >     > > apache/incubator-metron#643
> >     >     > >     METRON-1051 Enable the ability to update indexed
> messages
> >     > closes
> >     >     > > apache/incubator-metron#666
> >     >     > >     METRON-1069 Ambari MPack documentation around
> development
> >     > strategies
> >     >     > > (justinleet) closes apache/metron#1069
> >     >     > >     METRON-1069 Ambari MPack documentation around
> development
> >     > strategies
> >     >     > > (merrimanr via justinleet) closes apache/metron#1069
> >     >     > >     METRON-1069 Ambari MPack documentation around
> development
> >     > strategies
> >     >     > > (justinleet) closes apache/metron#1069
> >     >     > >     METRON-1076 Management UI status check always reports
> the
> >     > service as
> >     >     > > running (merrimanr) closes apache/metron#678
> >     >     > >     METRON-1075 Add faceted search capabilities (merrimanr)
> > closes
> >     >     > > apache/metron#679
> >     >     > >     METRON-379 Stellar - No Error When Adding Variables
> That
> > Do
> >     > Not Exist
> >     >     > > (ottobackwards) closes apache/metron#675
> >     >     > >     METRON-1038 Stellar should have a better collection of
> > basic
> >     > math
> >     >     > > operations closes apache/incubator-metron#650
> >     >     > >     METRON-1072 Cleanup Maven build warnings (mmiklavc)
> > closes
> >     >     > > apache/metron#676
> >     >     > >     METRON-1056 Get field types from Elasticsearch
> > (merrimanr)
> >     > closes
> >     >     > > apache/metron#662
> >     >     > >     METRON-1011 Stellar ENRICHMENT functions should enforce
> >     > submission of
> >     >     > > 4 parameters (jasper-k via ottobackwards) closes
> > apache/metron#628
> >     >     > >     METRON-975 Normalize logging and switch to common idiom
> > with
> >     > SLF4J
> >     >     > > (mmiklavc) closes apache/metron#599
> >     >     > >     METRON-681 CSVConverter should trim values (basvdl via
> >     > ottobackwards)
> >     >     > > closes apache/metron#674
> >     >     > >     METRON-746 Build Custom Checkstyle and IDE formatting
> > settings
> >     >     > > (justinleet via mmiklavc) closes apache/metron#577
> >     >     > >     METRON-1060 Add performance timing logging to
> enrichment
> >     > topology
> >     >     > > (mmiklavc) closes apache/metron#665
> >     >     > >     METRON-982 REST STORM Support for supervisor summary
> >     > (ottobackwards)
> >     >     > > closes apache/metron#607
> >     >     > >     METRON-1064 Make init script OS-agnostic (merrimanr)
> > closes
> >     >     > > apache/metron#669
> >     >     > >     METRON-984 Create STELLAR Decoding Functions
> > (ottobackwards)
> >     > closes
> >     >     > > apache/metron#642
> >     >     > >     METRON-1067 Minor typo in documentation (spencer-hanson
> > via
> >     >     > > justinleet) closes apache/metron#671
> >     >     > >     METRON-1018 Integration tests should reference flux
> yaml
> > and
> >     > property
> >     >     > > files deployed by Ambari (merrimanr) closes
> apache/metron#635
> >     >     > >     METRON-1050 Improve Docs of `profiler.period.duration`
> >     > (nickwallen)
> >     >     > > closes apache/metron#656
> >     >     > >     METRON-1043 Profiler Should be Less Dramatic When
> Missing
> >     >     > > Configuration (nickwallen) closes apache/metron#655
> >     >     > >     METRON-1053 Relocate Metron Docker (nickwallen) closes
> >     >     > > apache/metron#659
> >     >     > >     METRON-1058 address checkstyle warnings for
> > UnusedImports in
> >     >     > > metron-stellar (dbist via ottobackwards) closes
> > apache/metron#663
> >     >     > >     METRON-1035 Added SUM to the rules triage aggregation
> > docs
> >     > closes
> >     >     > > apache/incubator-metron#649
> >     >     > >     METRON-1039 Add ZIP function to Stellar closes
> >     >     > > apache/incubator-metron#652
> >     >     > >     METRON-1054 Ambari Mpack Attempts to Kill Topologies
> > That Are
> >     > Not
> >     >     > > Running (nickwallen) closes apache/metron#660
> >     >     > >     METRON-992: Create performance tuning guide (mmiklavc)
> > closes
> >     >     > > apache/metron#614
> >     >     > >     METRON-1044 Disabled writers are not acking messages
> >     > (merrimanr)
> >     >     > > closes apache/metron#654
> >     >     > >     METRON-1022 Elasticsearch REST endpoint this closes
> >     >     > > apache/incubator-metron#636
> >     >     > >     METRON-1048 Intermittent Test Failure for
> >     >     > > SimpleHBaseEnrichmentWriterLoggingTest (nickwallen) closes
> >     >     > apache/metron#658
> >     >     > >     METRON-1029 Topology worker opts are not being set when
> >     > Kerberos is
> >     >     > > enabled (merrimanr) closes apache/metron#645
> >     >     > >     METRON-1031 Management UI Cannot Start Topologies in
> > Kerberized
> >     >     > > Environment (nickwallen) closes apache/metron#647
> >     >     > >     METRON-1008 Migrate Travis build to use Trusty (jjmeyer
> > via
> >     >     > > justinleet) closes apache/metron#633
> >     >     > >     METRON-633 Create better logging for
> > HbaseEnrichmentWriter
> >     > (zezutom
> >     >     > > via justinleet) closes apache/metron#572
> >     >     > >     METRON-1003 ParserUtil parses dates incorrect (bjigmp
> via
> >     > justinleet)
> >     >     > > closes apache/metron#623
> >     >     > >     METRON-1040 Create Installation Instructions for the
> > Profiler
> >     >     > > (nickwallen) closes apache/metron#653
> >     >     > >     METRON-833 Update MaaS documentation to explain how it
> >     > interacts with
> >     >     > > kerberos (cestella via justinleet) closes apache/metron#520
> >     >     > >     METRON-1033 Profiler example uses incorrect units for
> > expires
> >     >     > > (simonellistonball via nickwallen) closes apache/metron#648
> >     >     > >     METRON-1019 Metron 0.4.0 manual installation guide for
> > CentOS 6
> >     >     > > (lvets via ottobackwards) closes apache/metron#631
> >     >     > >     METRON-1013 StellarShell does not validate parameters
> >     > (ottobackwards)
> >     >     > > closes apache/metron#639
> >     >     > >     METRON-1017 Ambari components should be separate
> > (merrimanr)
> >     > closes
> >     >     > > apache/metron#634
> >     >     > >     METRON-933 STELLAR support for setting fields to regex
> > match
> >     > captures
> >     >     > > (ottobackwards) closes apache/metron#638
> >     >     > >     METRON-1001 Allow metron to ingest parser metadata
> along
> > with
> >     > data
> >     >     > > closes apache/incubator-metron#621
> >     >     > >     METRON-1027 Errant Log Message When No GeoIP Hit on
> > Valid,
> >     > External
> >     >     > > IPv4 Address (nickwallen) closes apache/metron#644
> >     >     > >     METRON-1025 Metron github pr template should not
> > reference
> >     > incubator
> >     >     > > (ottobackwards) closes apache/metron#640
> >     >     > >     METRON-1021 increment metron version number to 0.4.1
in
> > poms
> >     > etc
> >     >     > > (mattf-horton) closes apache/metron#637
> >     >     > >     METRON-986 Enhance Fastcapa to Support Intel X520
> > (nickwallen)
> >     > closes
> >     >     > > apache/metron#608
> >     >     > >     METRON-1012 Update Metron public web site for 0.4.0
> > release
> >     >     > > (mattf-horton) closes apache/metron#629
> >     >     > >     METRON-1014 StellarShell class name typo (mattf-horton)
> > closes
> >     >     > > apache/metron#630
> >     >     > >     METRON-990 Clean up and organize flux properties
> > (merrimanr)
> >     > closes
> >     >     > > apache/metron#613
> >     >     > >     METRON-508 Expand Elasticsearch templates to support
> the
> >     > standard bro
> >     >     > > logs (JonZeolla) closes apache/metron#586
> >     >     > >     METRON-1007 Ship the metron-management jar as part of
> > the mpack
> >     >     > > install (ottobackwards) closes apache/metron#627
> >     >     > >     METRON-877 Extract core implementation and UDF support,
> > create
> >     >     > > metron-stellar module (mattf-horton) closes
> apache/metron#616
> >     >     > >     METRON-1004 Travis CI - Job Exceeded Maximum Time Limit
> >     > (justinleet)
> >     >     > > closes apache/metron#624
> >     >     > >     METRON-999 Add virtualization support checks to
> >     > platform-info.sh
> >     >     > > (JonZeolla via jonzeolla) closes apache/metron#618
> >     >     > >
> >     >     > >
> >     >     > >
> >     >     > >
> >     >     > >
> >     >     >
> >     >
> >     >
> >     >
> >     >
> >
> >
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message