metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nick Allen <n...@nickallen.org>
Subject Re: [DISCUSS] Metron release 0.4.1
Date Thu, 31 Aug 2017 14:45:01 GMT
Matt, et al - For JIRAs that are going into master, should we be marking
these as "Next + 1" or "0.4.1" ?

On Thu, Aug 31, 2017 at 8:17 AM Zeolla@GMail.com <zeolla@gmail.com> wrote:

> Can I advocate to get METRON-1129 in the RC, and throw in a second vote for
> METRON-1134?  Both in an attempt to better support of prod/offline use.
> Happy to provide testing cycles for the former.
>
> Jon
>
> On Wed, Aug 30, 2017 at 11:41 AM Anand Subramanian <
> asubramanian@hortonworks.com> wrote:
>
> > Hi Matt,
> >
> > This defect needs to be included as a follow-on to METRON-1122:
> > * METRON-1141 (https://github.com/apache/metron/pull/723)
> >
> >
> > Thanks,
> > Anand
> >
> >
> >
> > On 8/30/17, 8:57 PM, "Michael Miklavcic" <michael.miklavcic@gmail.com>
> > wrote:
> >
> > >I have some work around fixing how we handle config with Ambari that I'd
> > >like to see go in. No PR yet, but coming soon. I expect to have this by
> > the
> > >RC deadline.
> > >
> > >Mike
> > >
> > >On Wed, Aug 30, 2017 at 8:57 AM, Nick Allen <nick@nickallen.org> wrote:
> > >
> > >> The following PRs are usability enhancements for the Profiler.  They
> are
> > >> fairly simple and I think are very helpful for troubleshooting.  I
> don't
> > >> want to hold up the release, but it would be a "nice to have" to get
> > these
> > >> in.
> > >>
> > >> If anyone has cycles, I would appreciate some reviews of these PRs.
> > >> https://github.com/apache/metron/pull/721
> > >> https://github.com/apache/metron/pull/716
> > >>
> > >>
> > >>
> > >> On Tue, Aug 29, 2017 at 8:59 PM Matt Foley <mattf@apache.org> wrote:
> > >>
> > >> > Okay, just to be clear, you’re requesting we wait until Friday,
if
> > >> > necessary, to cut an RC with 717 in it?
> > >> > Thanks,
> > >> > --Matt
> > >> >
> > >> > On 8/29/17, 11:45 AM, "Casey Stella" <cestella@gmail.com> wrote:
> > >> >
> > >> >     709 is in and 717 is under concerted review by Otto.  I'd like
> to
> > see
> > >> > it in
> > >> >     by Friday.
> > >> >
> > >> >     On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley <mattf@apache.org>
> > >> wrote:
> > >> >
> > >> >     > Hi all,
> > >> >     > Thanks for your inputs.  The three PRs Nick mentioned have
> been
> > >> >     > successfully closed.
> > >> >     > Casey, do you have an ETA for these two PRs? (PR#709 and
717)
> > >> >     > Thanks,
> > >> >     > --Matt
> > >> >     >
> > >> >     > On 8/29/17, 9:34 AM, "Casey Stella" <cestella@gmail.com>
> wrote:
> > >> >     >
> > >> >     >     For my PRs, I'd vote for METRON-1122 being in (commit
very
> > >> > imminent).
> > >> >     >     I'd very much like METRON-1134 to be in as well.
> > >> >     >
> > >> >     >     Beyond that, I'm ok
> > >> >     >
> > >> >     >     On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen <
> > >> nick@nickallen.org>
> > >> >     > wrote:
> > >> >     >
> > >> >     >     > Thanks for starting the process, Matt.
> > >> >     >     >
> > >> >     >     > These are my own open PRs that I would most like
to see
> > get
> > >> in.
> > >> >     > They all
> > >> >     >     > relate to the Profiler. My other outstanding PRs
are
> less
> > >> > important.
> > >> >     >     >
> > >> >     >     >    - https://github.com/apache/metron/pull/705
> > >> >     >     >    - https://github.com/apache/metron/pull/707
> > >> >     >     >    - https://github.com/apache/metron/pull/708
> > >> >     >     >
> > >> >     >     >
> > >> >     >     >
> > >> >     >     >
> > >> >     >     >
> > >> >     >     > On Tue, Aug 22, 2017 at 4:17 PM Matt Foley <
> > mattf@apache.org
> > >> >
> > >> > wrote:
> > >> >     >     >
> > >> >     >     > > Hello all,
> > >> >     >     > > At the meeting this morning, the community
expressed
> the
> > >> > wish to
> > >> >     > create a
> > >> >     >     > > new release, to be a point release and not
including
> > >> > METRON-777.
> > >> >     >     > >
> > >> >     >     > > Therefore, I propose to create release 0.4.1
from
> Metron
> > >> > master
> > >> >     > branch,
> > >> >     >     > > with whatever additional commits the community
> considers
> > >> > vital and
> > >> >     > can
> > >> >     >     > get
> > >> >     >     > > in in the next few days.
> > >> >     >     > >
> > >> >     >     > > There have been 74 commits since the 0.4.0
release
> (list
> > >> > appended
> > >> >     > to end
> > >> >     >     > > of this message).
> > >> >     >     > > I have not yet done a compare to make sure
all 74
> > completed
> > >> >     > commits have
> > >> >     >     > > closed their Jiras, but I will follow up with
that
> info.
> > >> >     >     > >
> > >> >     >     > > There are 35 open PRs, see
> > >> > https://github.com/apache/metron/pulls
> > >> >     > ,
> > >> >     >     > which
> > >> >     >     > > is getting a little clunky.  Surely not all
of them
> can
> > get
> > >> > in in
> > >> >     > the
> > >> >     >     > next
> > >> >     >     > > few days, but do we want to try to close and
include
> > some
> > >> of
> > >> > them?
> > >> >     >     > >
> > >> >     >     > > Please respond to the list with your requests
to
> include
> > >> > specific
> > >> >     >     > > additional PRs before we cut the 0.4.1 release
> > candidate.
> > >> > Let’s
> > >> >     > keep it
> > >> >     >     > > practical so we don’t delay more than a week
or so.
> > >> >     >     > >
> > >> >     >     > > TIMEFRAME:  Tentatively I would like to start
the
> > process
> > >> of
> > >> >     > cutting an
> > >> >     >     > RC
> > >> >     >     > > this coming Monday 28 August.  If we have too
many PRs
> > >> > required to
> > >> >     > be in,
> > >> >     >     > > we may have to slip that.  Likewise, if there
is need
> > for
> > >> > urgency,
> > >> >     > I can
> > >> >     >     > > start as soon as tomorrow.  We will be guided
by your
> > >> > responses.
> > >> >     >     > >
> > >> >     >     > > Thanks,
> > >> >     >     > > --Matt
> > >> >     >     > > (Release Manager)
> > >> >     >     > >
> > >> >     >     > > COMPLETED PRs as of 22 Aug 2017:
> > >> >     >     > >     METRON-1115 Jackson is not properly serializing
> > >> > readMetadata
> > >> >     > and
> > >> >     >     > > mergeMetadata SensorParserConfig properties
> (merrimanr)
> > >> > closes
> > >> >     >     > > apache/metron#703
> > >> >     >     > >     METRON-1047 REST should use core-site.xml
for
> Hadoop
> > >> >     > configuration
> > >> >     >     > > (merrimanr) closes apache/metron#672
> > >> >     >     > >     METRON-1111 Mislabeled Configuration Property
in
> > Ambari
> > >> >     > (nickwallen)
> > >> >     >     > > closes apache/metron#698
> > >> >     >     > >     METRON-1113 UpdateControllerIntegrationTest
fails
> > with
> > >> > 500
> > >> >     > error
> > >> >     >     > > (merrimanr) closes apache/metron#701
> > >> >     >     > >     METRON-711 StellarShell assigns variables
even if
> an
> > >> > exception
> > >> >     > was
> > >> >     >     > > thrown in the statement. (ottobackwards) closes
> > >> > apache/metron#686
> > >> >     >     > >     METRON-1110 REST jvm flags property is
being
> > >> overwritten
> > >> > when
> > >> >     >     > Kerberos
> > >> >     >     > > is enabled (merrimanr) closes apache/metron#697
> > >> >     >     > >     METRON-739 Create Local Profile Runner
> (nickwallen)
> > >> > closes
> > >> >     >     > > apache/metron#693
> > >> >     >     > >     METRON-1109 Indexing topology fails to
start after
> > >> > Kerberos is
> > >> >     >     > enabled
> > >> >     >     > > (merrimanr) closes apache/metron#696
> > >> >     >     > >     METRON-1108 Metron configuration tabs are
not
> > showing
> > >> up
> > >> > in
> > >> >     > Ambari
> > >> >     >     > > this closes apache/incubator-metron#695
> > >> >     >     > >     METRON-1078 Metron Indexing fails to stop
during
> > >> > &quot;Stop All
> > >> >     >     > > Services&quot; (dlyle65535) closes apache/metron#680
> > >> >     >     > >     METRON-1104 Build Failure - Due to Bootstrap
> version
> > >> > change
> > >> >     >     > > (iraghumitra via justinleet) closes apache/metron#691
> > >> >     >     > >     METRON-1094 MaaS will not start due to
classpath
> > error
> > >> >     > relating to
> > >> >     >     > > Yarn closes apache/incubator-metron#688
> > >> >     >     > >     METRON-1102 Add support for ingesting cybox
URI
> > >> > observables
> > >> >     > from
> > >> >     >     > taxii
> > >> >     >     > > feeds closes apache/incubator-metron#689
> > >> >     >     > >     METRON-838 Incorrect set of ts in FireEye
parser
> > >> (bjigmp
> > >> > via
> > >> >     >     > > justinleet) closes apache/metron#528
> > >> >     >     > >     METRON-322 Global Batching and Flushing
> > (mattf-horton)
> > >> > closes
> > >> >     >     > > apache/metron#481
> > >> >     >     > >     METRON-988 UI for viewing alerts generated
by
> Metron
> > >> >     > (iraghumitra
> > >> >     >     > via
> > >> >     >     > > nickwallen) closes apache/metron#620
> > >> >     >     > >     METRON-1084 Management UI web server license
> should
> > be
> > >> > Apache
> > >> >     >     > > (merrimanr) closes apache/metron#683
> > >> >     >     > >     METRON-1026 threatintel_taxii_load.sh throws
> > exception
> > >> > closes
> > >> >     >     > > apache/incubator-metron#643
> > >> >     >     > >     METRON-1051 Enable the ability to update
indexed
> > >> messages
> > >> >     > closes
> > >> >     >     > > apache/incubator-metron#666
> > >> >     >     > >     METRON-1069 Ambari MPack documentation
around
> > >> development
> > >> >     > strategies
> > >> >     >     > > (justinleet) closes apache/metron#1069
> > >> >     >     > >     METRON-1069 Ambari MPack documentation
around
> > >> development
> > >> >     > strategies
> > >> >     >     > > (merrimanr via justinleet) closes apache/metron#1069
> > >> >     >     > >     METRON-1069 Ambari MPack documentation
around
> > >> development
> > >> >     > strategies
> > >> >     >     > > (justinleet) closes apache/metron#1069
> > >> >     >     > >     METRON-1076 Management UI status check
always
> > reports
> > >> the
> > >> >     > service as
> > >> >     >     > > running (merrimanr) closes apache/metron#678
> > >> >     >     > >     METRON-1075 Add faceted search capabilities
> > (merrimanr)
> > >> > closes
> > >> >     >     > > apache/metron#679
> > >> >     >     > >     METRON-379 Stellar - No Error When Adding
> Variables
> > >> That
> > >> > Do
> > >> >     > Not Exist
> > >> >     >     > > (ottobackwards) closes apache/metron#675
> > >> >     >     > >     METRON-1038 Stellar should have a better
> collection
> > of
> > >> > basic
> > >> >     > math
> > >> >     >     > > operations closes apache/incubator-metron#650
> > >> >     >     > >     METRON-1072 Cleanup Maven build warnings
> (mmiklavc)
> > >> > closes
> > >> >     >     > > apache/metron#676
> > >> >     >     > >     METRON-1056 Get field types from Elasticsearch
> > >> > (merrimanr)
> > >> >     > closes
> > >> >     >     > > apache/metron#662
> > >> >     >     > >     METRON-1011 Stellar ENRICHMENT functions
should
> > enforce
> > >> >     > submission of
> > >> >     >     > > 4 parameters (jasper-k via ottobackwards) closes
> > >> > apache/metron#628
> > >> >     >     > >     METRON-975 Normalize logging and switch
to common
> > idiom
> > >> > with
> > >> >     > SLF4J
> > >> >     >     > > (mmiklavc) closes apache/metron#599
> > >> >     >     > >     METRON-681 CSVConverter should trim values
(basvdl
> > via
> > >> >     > ottobackwards)
> > >> >     >     > > closes apache/metron#674
> > >> >     >     > >     METRON-746 Build Custom Checkstyle and
IDE
> > formatting
> > >> > settings
> > >> >     >     > > (justinleet via mmiklavc) closes apache/metron#577
> > >> >     >     > >     METRON-1060 Add performance timing logging
to
> > >> enrichment
> > >> >     > topology
> > >> >     >     > > (mmiklavc) closes apache/metron#665
> > >> >     >     > >     METRON-982 REST STORM Support for supervisor
> summary
> > >> >     > (ottobackwards)
> > >> >     >     > > closes apache/metron#607
> > >> >     >     > >     METRON-1064 Make init script OS-agnostic
> (merrimanr)
> > >> > closes
> > >> >     >     > > apache/metron#669
> > >> >     >     > >     METRON-984 Create STELLAR Decoding Functions
> > >> > (ottobackwards)
> > >> >     > closes
> > >> >     >     > > apache/metron#642
> > >> >     >     > >     METRON-1067 Minor typo in documentation
> > (spencer-hanson
> > >> > via
> > >> >     >     > > justinleet) closes apache/metron#671
> > >> >     >     > >     METRON-1018 Integration tests should reference
> flux
> > >> yaml
> > >> > and
> > >> >     > property
> > >> >     >     > > files deployed by Ambari (merrimanr) closes
> > >> apache/metron#635
> > >> >     >     > >     METRON-1050 Improve Docs of
> > `profiler.period.duration`
> > >> >     > (nickwallen)
> > >> >     >     > > closes apache/metron#656
> > >> >     >     > >     METRON-1043 Profiler Should be Less Dramatic
When
> > >> Missing
> > >> >     >     > > Configuration (nickwallen) closes apache/metron#655
> > >> >     >     > >     METRON-1053 Relocate Metron Docker (nickwallen)
> > closes
> > >> >     >     > > apache/metron#659
> > >> >     >     > >     METRON-1058 address checkstyle warnings
for
> > >> > UnusedImports in
> > >> >     >     > > metron-stellar (dbist via ottobackwards) closes
> > >> > apache/metron#663
> > >> >     >     > >     METRON-1035 Added SUM to the rules triage
> > aggregation
> > >> > docs
> > >> >     > closes
> > >> >     >     > > apache/incubator-metron#649
> > >> >     >     > >     METRON-1039 Add ZIP function to Stellar
closes
> > >> >     >     > > apache/incubator-metron#652
> > >> >     >     > >     METRON-1054 Ambari Mpack Attempts to Kill
> Topologies
> > >> > That Are
> > >> >     > Not
> > >> >     >     > > Running (nickwallen) closes apache/metron#660
> > >> >     >     > >     METRON-992: Create performance tuning guide
> > (mmiklavc)
> > >> > closes
> > >> >     >     > > apache/metron#614
> > >> >     >     > >     METRON-1044 Disabled writers are not acking
> messages
> > >> >     > (merrimanr)
> > >> >     >     > > closes apache/metron#654
> > >> >     >     > >     METRON-1022 Elasticsearch REST endpoint
this
> closes
> > >> >     >     > > apache/incubator-metron#636
> > >> >     >     > >     METRON-1048 Intermittent Test Failure for
> > >> >     >     > > SimpleHBaseEnrichmentWriterLoggingTest (nickwallen)
> > closes
> > >> >     >     > apache/metron#658
> > >> >     >     > >     METRON-1029 Topology worker opts are not
being set
> > when
> > >> >     > Kerberos is
> > >> >     >     > > enabled (merrimanr) closes apache/metron#645
> > >> >     >     > >     METRON-1031 Management UI Cannot Start
Topologies
> in
> > >> > Kerberized
> > >> >     >     > > Environment (nickwallen) closes apache/metron#647
> > >> >     >     > >     METRON-1008 Migrate Travis build to use
Trusty
> > (jjmeyer
> > >> > via
> > >> >     >     > > justinleet) closes apache/metron#633
> > >> >     >     > >     METRON-633 Create better logging for
> > >> > HbaseEnrichmentWriter
> > >> >     > (zezutom
> > >> >     >     > > via justinleet) closes apache/metron#572
> > >> >     >     > >     METRON-1003 ParserUtil parses dates incorrect
> > (bjigmp
> > >> via
> > >> >     > justinleet)
> > >> >     >     > > closes apache/metron#623
> > >> >     >     > >     METRON-1040 Create Installation Instructions
for
> the
> > >> > Profiler
> > >> >     >     > > (nickwallen) closes apache/metron#653
> > >> >     >     > >     METRON-833 Update MaaS documentation to
explain
> how
> > it
> > >> >     > interacts with
> > >> >     >     > > kerberos (cestella via justinleet) closes
> > apache/metron#520
> > >> >     >     > >     METRON-1033 Profiler example uses incorrect
units
> > for
> > >> > expires
> > >> >     >     > > (simonellistonball via nickwallen) closes
> > apache/metron#648
> > >> >     >     > >     METRON-1019 Metron 0.4.0 manual installation
guide
> > for
> > >> > CentOS 6
> > >> >     >     > > (lvets via ottobackwards) closes apache/metron#631
> > >> >     >     > >     METRON-1013 StellarShell does not validate
> > parameters
> > >> >     > (ottobackwards)
> > >> >     >     > > closes apache/metron#639
> > >> >     >     > >     METRON-1017 Ambari components should be
separate
> > >> > (merrimanr)
> > >> >     > closes
> > >> >     >     > > apache/metron#634
> > >> >     >     > >     METRON-933 STELLAR support for setting
fields to
> > regex
> > >> > match
> > >> >     > captures
> > >> >     >     > > (ottobackwards) closes apache/metron#638
> > >> >     >     > >     METRON-1001 Allow metron to ingest parser
metadata
> > >> along
> > >> > with
> > >> >     > data
> > >> >     >     > > closes apache/incubator-metron#621
> > >> >     >     > >     METRON-1027 Errant Log Message When No
GeoIP Hit
> on
> > >> > Valid,
> > >> >     > External
> > >> >     >     > > IPv4 Address (nickwallen) closes apache/metron#644
> > >> >     >     > >     METRON-1025 Metron github pr template should
not
> > >> > reference
> > >> >     > incubator
> > >> >     >     > > (ottobackwards) closes apache/metron#640
> > >> >     >     > >     METRON-1021 increment metron version number
to
> > 0.4.1 in
> > >> > poms
> > >> >     > etc
> > >> >     >     > > (mattf-horton) closes apache/metron#637
> > >> >     >     > >     METRON-986 Enhance Fastcapa to Support
Intel X520
> > >> > (nickwallen)
> > >> >     > closes
> > >> >     >     > > apache/metron#608
> > >> >     >     > >     METRON-1012 Update Metron public web site
for
> 0.4.0
> > >> > release
> > >> >     >     > > (mattf-horton) closes apache/metron#629
> > >> >     >     > >     METRON-1014 StellarShell class name typo
> > (mattf-horton)
> > >> > closes
> > >> >     >     > > apache/metron#630
> > >> >     >     > >     METRON-990 Clean up and organize flux properties
> > >> > (merrimanr)
> > >> >     > closes
> > >> >     >     > > apache/metron#613
> > >> >     >     > >     METRON-508 Expand Elasticsearch templates
to
> support
> > >> the
> > >> >     > standard bro
> > >> >     >     > > logs (JonZeolla) closes apache/metron#586
> > >> >     >     > >     METRON-1007 Ship the metron-management
jar as part
> > of
> > >> > the mpack
> > >> >     >     > > install (ottobackwards) closes apache/metron#627
> > >> >     >     > >     METRON-877 Extract core implementation
and UDF
> > support,
> > >> > create
> > >> >     >     > > metron-stellar module (mattf-horton) closes
> > >> apache/metron#616
> > >> >     >     > >     METRON-1004 Travis CI - Job Exceeded Maximum
Time
> > Limit
> > >> >     > (justinleet)
> > >> >     >     > > closes apache/metron#624
> > >> >     >     > >     METRON-999 Add virtualization support checks
to
> > >> >     > platform-info.sh
> > >> >     >     > > (JonZeolla via jonzeolla) closes apache/metron#618
> > >> >     >     > >
> > >> >     >     > >
> > >> >     >     > >
> > >> >     >     > >
> > >> >     >     > >
> > >> >     >     >
> > >> >     >
> > >> >     >
> > >> >     >
> > >> >     >
> > >> >
> > >> >
> > >> >
> > >> >
> > >>
> >
> --
>
> Jon
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message