metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anand Subramanian <asubraman...@hortonworks.com>
Subject Re: [DISCUSS] Metron release 0.4.1
Date Wed, 30 Aug 2017 15:39:13 GMT
Hi Matt,

This defect needs to be included as a follow-on to METRON-1122:
* METRON-1141 (https://github.com/apache/metron/pull/723)


Thanks,
Anand



On 8/30/17, 8:57 PM, "Michael Miklavcic" <michael.miklavcic@gmail.com> wrote:

>I have some work around fixing how we handle config with Ambari that I'd
>like to see go in. No PR yet, but coming soon. I expect to have this by the
>RC deadline.
>
>Mike
>
>On Wed, Aug 30, 2017 at 8:57 AM, Nick Allen <nick@nickallen.org> wrote:
>
>> The following PRs are usability enhancements for the Profiler.  They are
>> fairly simple and I think are very helpful for troubleshooting.  I don't
>> want to hold up the release, but it would be a "nice to have" to get these
>> in.
>>
>> If anyone has cycles, I would appreciate some reviews of these PRs.
>> https://github.com/apache/metron/pull/721
>> https://github.com/apache/metron/pull/716
>>
>>
>>
>> On Tue, Aug 29, 2017 at 8:59 PM Matt Foley <mattf@apache.org> wrote:
>>
>> > Okay, just to be clear, you’re requesting we wait until Friday, if
>> > necessary, to cut an RC with 717 in it?
>> > Thanks,
>> > --Matt
>> >
>> > On 8/29/17, 11:45 AM, "Casey Stella" <cestella@gmail.com> wrote:
>> >
>> >     709 is in and 717 is under concerted review by Otto.  I'd like to see
>> > it in
>> >     by Friday.
>> >
>> >     On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley <mattf@apache.org>
>> wrote:
>> >
>> >     > Hi all,
>> >     > Thanks for your inputs.  The three PRs Nick mentioned have been
>> >     > successfully closed.
>> >     > Casey, do you have an ETA for these two PRs? (PR#709 and 717)
>> >     > Thanks,
>> >     > --Matt
>> >     >
>> >     > On 8/29/17, 9:34 AM, "Casey Stella" <cestella@gmail.com> wrote:
>> >     >
>> >     >     For my PRs, I'd vote for METRON-1122 being in (commit very
>> > imminent).
>> >     >     I'd very much like METRON-1134 to be in as well.
>> >     >
>> >     >     Beyond that, I'm ok
>> >     >
>> >     >     On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen <
>> nick@nickallen.org>
>> >     > wrote:
>> >     >
>> >     >     > Thanks for starting the process, Matt.
>> >     >     >
>> >     >     > These are my own open PRs that I would most like to see get
>> in.
>> >     > They all
>> >     >     > relate to the Profiler. My other outstanding PRs are less
>> > important.
>> >     >     >
>> >     >     >    - https://github.com/apache/metron/pull/705
>> >     >     >    - https://github.com/apache/metron/pull/707
>> >     >     >    - https://github.com/apache/metron/pull/708
>> >     >     >
>> >     >     >
>> >     >     >
>> >     >     >
>> >     >     >
>> >     >     > On Tue, Aug 22, 2017 at 4:17 PM Matt Foley <mattf@apache.org
>> >
>> > wrote:
>> >     >     >
>> >     >     > > Hello all,
>> >     >     > > At the meeting this morning, the community expressed
the
>> > wish to
>> >     > create a
>> >     >     > > new release, to be a point release and not including
>> > METRON-777.
>> >     >     > >
>> >     >     > > Therefore, I propose to create release 0.4.1 from Metron
>> > master
>> >     > branch,
>> >     >     > > with whatever additional commits the community considers
>> > vital and
>> >     > can
>> >     >     > get
>> >     >     > > in in the next few days.
>> >     >     > >
>> >     >     > > There have been 74 commits since the 0.4.0 release (list
>> > appended
>> >     > to end
>> >     >     > > of this message).
>> >     >     > > I have not yet done a compare to make sure all 74 completed
>> >     > commits have
>> >     >     > > closed their Jiras, but I will follow up with that info.
>> >     >     > >
>> >     >     > > There are 35 open PRs, see
>> > https://github.com/apache/metron/pulls
>> >     > ,
>> >     >     > which
>> >     >     > > is getting a little clunky.  Surely not all of them can
get
>> > in in
>> >     > the
>> >     >     > next
>> >     >     > > few days, but do we want to try to close and include
some
>> of
>> > them?
>> >     >     > >
>> >     >     > > Please respond to the list with your requests to include
>> > specific
>> >     >     > > additional PRs before we cut the 0.4.1 release candidate.
>> > Let’s
>> >     > keep it
>> >     >     > > practical so we don’t delay more than a week or so.
>> >     >     > >
>> >     >     > > TIMEFRAME:  Tentatively I would like to start the process
>> of
>> >     > cutting an
>> >     >     > RC
>> >     >     > > this coming Monday 28 August.  If we have too many PRs
>> > required to
>> >     > be in,
>> >     >     > > we may have to slip that.  Likewise, if there is need
for
>> > urgency,
>> >     > I can
>> >     >     > > start as soon as tomorrow.  We will be guided by your
>> > responses.
>> >     >     > >
>> >     >     > > Thanks,
>> >     >     > > --Matt
>> >     >     > > (Release Manager)
>> >     >     > >
>> >     >     > > COMPLETED PRs as of 22 Aug 2017:
>> >     >     > >     METRON-1115 Jackson is not properly serializing
>> > readMetadata
>> >     > and
>> >     >     > > mergeMetadata SensorParserConfig properties  (merrimanr)
>> > closes
>> >     >     > > apache/metron#703
>> >     >     > >     METRON-1047 REST should use core-site.xml for Hadoop
>> >     > configuration
>> >     >     > > (merrimanr) closes apache/metron#672
>> >     >     > >     METRON-1111 Mislabeled Configuration Property in
Ambari
>> >     > (nickwallen)
>> >     >     > > closes apache/metron#698
>> >     >     > >     METRON-1113 UpdateControllerIntegrationTest fails
with
>> > 500
>> >     > error
>> >     >     > > (merrimanr) closes apache/metron#701
>> >     >     > >     METRON-711 StellarShell assigns variables even if
an
>> > exception
>> >     > was
>> >     >     > > thrown in the statement. (ottobackwards) closes
>> > apache/metron#686
>> >     >     > >     METRON-1110 REST jvm flags property is being
>> overwritten
>> > when
>> >     >     > Kerberos
>> >     >     > > is enabled (merrimanr) closes apache/metron#697
>> >     >     > >     METRON-739 Create Local Profile Runner (nickwallen)
>> > closes
>> >     >     > > apache/metron#693
>> >     >     > >     METRON-1109 Indexing topology fails to start after
>> > Kerberos is
>> >     >     > enabled
>> >     >     > > (merrimanr) closes apache/metron#696
>> >     >     > >     METRON-1108 Metron configuration tabs are not showing
>> up
>> > in
>> >     > Ambari
>> >     >     > > this closes apache/incubator-metron#695
>> >     >     > >     METRON-1078 Metron Indexing fails to stop during
>> > &quot;Stop All
>> >     >     > > Services&quot; (dlyle65535) closes apache/metron#680
>> >     >     > >     METRON-1104 Build Failure - Due to Bootstrap version
>> > change
>> >     >     > > (iraghumitra via justinleet) closes apache/metron#691
>> >     >     > >     METRON-1094 MaaS will not start due to classpath
error
>> >     > relating to
>> >     >     > > Yarn closes apache/incubator-metron#688
>> >     >     > >     METRON-1102 Add support for ingesting cybox URI
>> > observables
>> >     > from
>> >     >     > taxii
>> >     >     > > feeds closes apache/incubator-metron#689
>> >     >     > >     METRON-838 Incorrect set of ts in FireEye parser
>> (bjigmp
>> > via
>> >     >     > > justinleet) closes apache/metron#528
>> >     >     > >     METRON-322 Global Batching and Flushing (mattf-horton)
>> > closes
>> >     >     > > apache/metron#481
>> >     >     > >     METRON-988 UI for viewing alerts generated by Metron
>> >     > (iraghumitra
>> >     >     > via
>> >     >     > > nickwallen) closes apache/metron#620
>> >     >     > >     METRON-1084 Management UI web server license should
be
>> > Apache
>> >     >     > > (merrimanr) closes apache/metron#683
>> >     >     > >     METRON-1026 threatintel_taxii_load.sh throws exception
>> > closes
>> >     >     > > apache/incubator-metron#643
>> >     >     > >     METRON-1051 Enable the ability to update indexed
>> messages
>> >     > closes
>> >     >     > > apache/incubator-metron#666
>> >     >     > >     METRON-1069 Ambari MPack documentation around
>> development
>> >     > strategies
>> >     >     > > (justinleet) closes apache/metron#1069
>> >     >     > >     METRON-1069 Ambari MPack documentation around
>> development
>> >     > strategies
>> >     >     > > (merrimanr via justinleet) closes apache/metron#1069
>> >     >     > >     METRON-1069 Ambari MPack documentation around
>> development
>> >     > strategies
>> >     >     > > (justinleet) closes apache/metron#1069
>> >     >     > >     METRON-1076 Management UI status check always reports
>> the
>> >     > service as
>> >     >     > > running (merrimanr) closes apache/metron#678
>> >     >     > >     METRON-1075 Add faceted search capabilities (merrimanr)
>> > closes
>> >     >     > > apache/metron#679
>> >     >     > >     METRON-379 Stellar - No Error When Adding Variables
>> That
>> > Do
>> >     > Not Exist
>> >     >     > > (ottobackwards) closes apache/metron#675
>> >     >     > >     METRON-1038 Stellar should have a better collection
of
>> > basic
>> >     > math
>> >     >     > > operations closes apache/incubator-metron#650
>> >     >     > >     METRON-1072 Cleanup Maven build warnings (mmiklavc)
>> > closes
>> >     >     > > apache/metron#676
>> >     >     > >     METRON-1056 Get field types from Elasticsearch
>> > (merrimanr)
>> >     > closes
>> >     >     > > apache/metron#662
>> >     >     > >     METRON-1011 Stellar ENRICHMENT functions should enforce
>> >     > submission of
>> >     >     > > 4 parameters (jasper-k via ottobackwards) closes
>> > apache/metron#628
>> >     >     > >     METRON-975 Normalize logging and switch to common
idiom
>> > with
>> >     > SLF4J
>> >     >     > > (mmiklavc) closes apache/metron#599
>> >     >     > >     METRON-681 CSVConverter should trim values (basvdl
via
>> >     > ottobackwards)
>> >     >     > > closes apache/metron#674
>> >     >     > >     METRON-746 Build Custom Checkstyle and IDE formatting
>> > settings
>> >     >     > > (justinleet via mmiklavc) closes apache/metron#577
>> >     >     > >     METRON-1060 Add performance timing logging to
>> enrichment
>> >     > topology
>> >     >     > > (mmiklavc) closes apache/metron#665
>> >     >     > >     METRON-982 REST STORM Support for supervisor summary
>> >     > (ottobackwards)
>> >     >     > > closes apache/metron#607
>> >     >     > >     METRON-1064 Make init script OS-agnostic (merrimanr)
>> > closes
>> >     >     > > apache/metron#669
>> >     >     > >     METRON-984 Create STELLAR Decoding Functions
>> > (ottobackwards)
>> >     > closes
>> >     >     > > apache/metron#642
>> >     >     > >     METRON-1067 Minor typo in documentation (spencer-hanson
>> > via
>> >     >     > > justinleet) closes apache/metron#671
>> >     >     > >     METRON-1018 Integration tests should reference flux
>> yaml
>> > and
>> >     > property
>> >     >     > > files deployed by Ambari (merrimanr) closes
>> apache/metron#635
>> >     >     > >     METRON-1050 Improve Docs of `profiler.period.duration`
>> >     > (nickwallen)
>> >     >     > > closes apache/metron#656
>> >     >     > >     METRON-1043 Profiler Should be Less Dramatic When
>> Missing
>> >     >     > > Configuration (nickwallen) closes apache/metron#655
>> >     >     > >     METRON-1053 Relocate Metron Docker (nickwallen) closes
>> >     >     > > apache/metron#659
>> >     >     > >     METRON-1058 address checkstyle warnings for
>> > UnusedImports in
>> >     >     > > metron-stellar (dbist via ottobackwards) closes
>> > apache/metron#663
>> >     >     > >     METRON-1035 Added SUM to the rules triage aggregation
>> > docs
>> >     > closes
>> >     >     > > apache/incubator-metron#649
>> >     >     > >     METRON-1039 Add ZIP function to Stellar closes
>> >     >     > > apache/incubator-metron#652
>> >     >     > >     METRON-1054 Ambari Mpack Attempts to Kill Topologies
>> > That Are
>> >     > Not
>> >     >     > > Running (nickwallen) closes apache/metron#660
>> >     >     > >     METRON-992: Create performance tuning guide (mmiklavc)
>> > closes
>> >     >     > > apache/metron#614
>> >     >     > >     METRON-1044 Disabled writers are not acking messages
>> >     > (merrimanr)
>> >     >     > > closes apache/metron#654
>> >     >     > >     METRON-1022 Elasticsearch REST endpoint this closes
>> >     >     > > apache/incubator-metron#636
>> >     >     > >     METRON-1048 Intermittent Test Failure for
>> >     >     > > SimpleHBaseEnrichmentWriterLoggingTest (nickwallen) closes
>> >     >     > apache/metron#658
>> >     >     > >     METRON-1029 Topology worker opts are not being set
when
>> >     > Kerberos is
>> >     >     > > enabled (merrimanr) closes apache/metron#645
>> >     >     > >     METRON-1031 Management UI Cannot Start Topologies
in
>> > Kerberized
>> >     >     > > Environment (nickwallen) closes apache/metron#647
>> >     >     > >     METRON-1008 Migrate Travis build to use Trusty (jjmeyer
>> > via
>> >     >     > > justinleet) closes apache/metron#633
>> >     >     > >     METRON-633 Create better logging for
>> > HbaseEnrichmentWriter
>> >     > (zezutom
>> >     >     > > via justinleet) closes apache/metron#572
>> >     >     > >     METRON-1003 ParserUtil parses dates incorrect (bjigmp
>> via
>> >     > justinleet)
>> >     >     > > closes apache/metron#623
>> >     >     > >     METRON-1040 Create Installation Instructions for
the
>> > Profiler
>> >     >     > > (nickwallen) closes apache/metron#653
>> >     >     > >     METRON-833 Update MaaS documentation to explain how
it
>> >     > interacts with
>> >     >     > > kerberos (cestella via justinleet) closes apache/metron#520
>> >     >     > >     METRON-1033 Profiler example uses incorrect units
for
>> > expires
>> >     >     > > (simonellistonball via nickwallen) closes apache/metron#648
>> >     >     > >     METRON-1019 Metron 0.4.0 manual installation guide
for
>> > CentOS 6
>> >     >     > > (lvets via ottobackwards) closes apache/metron#631
>> >     >     > >     METRON-1013 StellarShell does not validate parameters
>> >     > (ottobackwards)
>> >     >     > > closes apache/metron#639
>> >     >     > >     METRON-1017 Ambari components should be separate
>> > (merrimanr)
>> >     > closes
>> >     >     > > apache/metron#634
>> >     >     > >     METRON-933 STELLAR support for setting fields to
regex
>> > match
>> >     > captures
>> >     >     > > (ottobackwards) closes apache/metron#638
>> >     >     > >     METRON-1001 Allow metron to ingest parser metadata
>> along
>> > with
>> >     > data
>> >     >     > > closes apache/incubator-metron#621
>> >     >     > >     METRON-1027 Errant Log Message When No GeoIP Hit
on
>> > Valid,
>> >     > External
>> >     >     > > IPv4 Address (nickwallen) closes apache/metron#644
>> >     >     > >     METRON-1025 Metron github pr template should not
>> > reference
>> >     > incubator
>> >     >     > > (ottobackwards) closes apache/metron#640
>> >     >     > >     METRON-1021 increment metron version number to 0.4.1
in
>> > poms
>> >     > etc
>> >     >     > > (mattf-horton) closes apache/metron#637
>> >     >     > >     METRON-986 Enhance Fastcapa to Support Intel X520
>> > (nickwallen)
>> >     > closes
>> >     >     > > apache/metron#608
>> >     >     > >     METRON-1012 Update Metron public web site for 0.4.0
>> > release
>> >     >     > > (mattf-horton) closes apache/metron#629
>> >     >     > >     METRON-1014 StellarShell class name typo (mattf-horton)
>> > closes
>> >     >     > > apache/metron#630
>> >     >     > >     METRON-990 Clean up and organize flux properties
>> > (merrimanr)
>> >     > closes
>> >     >     > > apache/metron#613
>> >     >     > >     METRON-508 Expand Elasticsearch templates to support
>> the
>> >     > standard bro
>> >     >     > > logs (JonZeolla) closes apache/metron#586
>> >     >     > >     METRON-1007 Ship the metron-management jar as part
of
>> > the mpack
>> >     >     > > install (ottobackwards) closes apache/metron#627
>> >     >     > >     METRON-877 Extract core implementation and UDF support,
>> > create
>> >     >     > > metron-stellar module (mattf-horton) closes
>> apache/metron#616
>> >     >     > >     METRON-1004 Travis CI - Job Exceeded Maximum Time
Limit
>> >     > (justinleet)
>> >     >     > > closes apache/metron#624
>> >     >     > >     METRON-999 Add virtualization support checks to
>> >     > platform-info.sh
>> >     >     > > (JonZeolla via jonzeolla) closes apache/metron#618
>> >     >     > >
>> >     >     > >
>> >     >     > >
>> >     >     > >
>> >     >     > >
>> >     >     >
>> >     >
>> >     >
>> >     >
>> >     >
>> >
>> >
>> >
>> >
>>
Mime
View raw message