drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arina Yelchiyeva <arina.yelchiy...@gmail.com>
Subject Re: [DISCUSS] Drill 1.12.0 release
Date Sun, 26 Nov 2017 16:15:32 GMT
Current status:

DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - could not cherry-pick the commits. Needs fix.
DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
reviewer - Paul) - there are unit test failures. Needs fix.

Kind regards

On Sat, Nov 25, 2017 at 11:53 PM, AnilKumar B <akumarb2010@gmail.com> wrote:

> Hi Arina,
>
> Sorry for the delay. Just now we squashed Kafka storage plugin commits into
> one commit and pushed.
>
> Thanks & Regards,
> B Anil Kumar.
>
> On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
>
> > Current status:
> >
> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> > reviewer - Paul) - needs to squash the commits.
> > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> > reviewer - Paul) - needs to address some code review comments.
> >
> > Kind regards
> > Arina
> >
> > On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
> > arina.yelchiyeva@gmail.com> wrote:
> >
> > > Current status, we are close to the code freeze which will happen not
> > > later then the end of the next week.
> > >
> > > Blocker:
> > > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
> code
> > > reviewer - Arina) - in progress.
> > >
> > > Targeted for 1.12 release:
> > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
> code
> > > reviewer - Paul) - needs next round of code review.
> > > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> > > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> waiting
> > > for Parth code review.
> > > DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
> code
> > > reviewer - Tim) - code review is done, waiting for the merge.
> > >
> > > Kind regards
> > >
> > > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cshi@mapr.com> wrote:
> > >
> > >> Hi Arina,
> > >>
> > >>
> > >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
> > >> loading schema for storage plugins. Could you or Paul take a look at
> the
> > >> pull request for this JIRA https://github.com/apache/drill/pull/1032?
> I
> > >> think both of you are familiar with this part.
> > >>
> > >>
> > >> Thanks,
> > >>
> > >>
> > >> Chunhui
> > >>
> > >> ________________________________
> > >> From: Arina Yelchiyeva <arina.yelchiyeva@gmail.com>
> > >> Sent: Thursday, November 9, 2017 8:11:35 AM
> > >> To: dev@drill.apache.org
> > >> Subject: Re: [DISCUSS] Drill 1.12.0 release
> > >>
> > >> Yes, they are already in master.
> > >>
> > >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cgivre@gmail.com>
> wrote:
> > >>
> > >> > We’re including the Networking functions in this release right?
> > >> >
> > >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
> > >> arina.yelchiyeva@gmail.com>
> > >> > wrote:
> > >> > >
> > >> > > If changes will be done before cut off date, targeting mid
> November
> > >> that
> > >> > it
> > >> > > will be possible to include this Jira.
> > >> > >
> > >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cgivre@gmail.com>
> > >> wrote:
> > >> > >
> > >> > >> Hi Arina,
> > >> > >> Can we include DRILL-4091 Support for additional GIS operations
> in
> > >> > version
> > >> > >> 1.12?  In general the code looked pretty good.  There was
a unit
> > test
> > >> > >> missing which the developer submitted and some minor formatting
> > >> issues
> > >> > >> which I’m still waiting on.
> > >> > >> Thanks,
> > >> > >> —C
> > >> > >>
> > >> > >>
> > >> > >>
> > >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
> > >> arina.yelchiyeva@gmail.com
> > >> > >
> > >> > >> wrote:
> > >> > >>>
> > >> > >>> Current status:
> > >> > >>>
> > >> > >>> Blocker:
> > >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer
- Vlad
> > R.,
> > >> > code
> > >> > >>> reviewer - ?) - in progress.
> > >> > >>>
> > >> > >>> Targeted for 1.12 release:
> > >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy &
Vlad S., code
> > >> > >> reviewer -
> > >> > >>> Arina) - code review in final stage.
> > >> > >>> DRILL-4779: Kafka storage plugin support (developer -
Anil &
> > Kamesh,
> > >> > code
> > >> > >>> reviewer - Paul) - in review.
> > >> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582
for
> > >> PLAIN
> > >> > >>> mechanism (developer - Sorabh, code reviewer - Parth
& Laurent)
> -
> > >> > waiting
> > >> > >>> for the code review.
> > >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer
-
> > Arina,
> > >> > code
> > >> > >>> reviewer - Tim) - waiting for the code review.
> > >> > >>>
> > >> > >>> Kind regards
> > >> > >>> Arina
> > >> > >>>
> > >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> > >> > >>> arina.yelchiyeva@gmail.com> wrote:
> > >> > >>>
> > >> > >>>> Current status:
> > >> > >>>>
> > >> > >>>> Targeted for 1.12 release:
> > >> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> > >> rather
> > >> > >> than
> > >> > >>>> mock (developer - Paul, code reviewer - ?) - waiting
for the
> code
> > >> > review
> > >> > >>>> DRILL-5842: Refactor and simplify the fragment, operator
> contexts
> > >> for
> > >> > >>>> testing (developer - Paul, code reviewer - ?) - waiting
for the
> > >> code
> > >> > >>>> review
> > >> > >>>> DRILL-5834: Adding network functions (developer -
Charles, code
> > >> > reviewer
> > >> > >>>> - Arina) - waiting changes after code review
> > >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy,
code
> reviewer -
> > >> > >> Arina) - waiting
> > >> > >>>> for the code review
> > >> > >>>> DRILL-5772: Enable UTF-8 support in query string
by default
> > >> > (developer -
> > >> > >>>> Arina, code reviewer - Paul) - finalizing approach
> > >> > >>>> DRILL-4779: Kafka storage plugin support (developer
- Anil,
> code
> > >> > >> reviewer
> > >> > >>>> - ?) - finishing implementation
> > >> > >>>>
> > >> > >>>> Under question:
> > >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer
-
> Jyothsna,
> > >> code
> > >> > >>>> reviewer - ?) - waiting for the status update from
the
> developer
> > >> > >>>>
> > >> > >>>> Please free to suggest other items that are targeted
for 1.12
> > >> release.
> > >> > >>>> There are many Jiras that have fix version marked
as 1.12, it
> > >> would be
> > >> > >> good
> > >> > >>>> if developers revisit them and update fix version
to the actual
> > >> one.
> > >> > >>>> Link to the dashboard - https://issues.apache.org/
> > >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> > >> > DRILL&view=detail
> > >> > >>>>
> > >> > >>>> Kind regards
> > >> > >>>> Arina
> > >> > >>>>
> > >> > >>>>
> > >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <
> > parthc@apache.org>
> > >> > >> wrote:
> > >> > >>>>
> > >> > >>>>> I'm waiting to merge the SSL  changes in. Waiting
a couple of
> > days
> > >> > >> more to
> > >> > >>>>> see if there are any more comments before I merge
the changes
> > in.
> > >> > >>>>>
> > >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers
<
> progers@mapr.com>
> > >> > wrote:
> > >> > >>>>>
> > >> > >>>>>> Hi Arina,
> > >> > >>>>>>
> > >> > >>>>>> In addition to my own PRs, there are several
in the “active”
> > >> queue
> > >> > >> that
> > >> > >>>>> we
> > >> > >>>>>> could get in if we can just push them over
the line and clear
> > the
> > >> > >> queue.
> > >> > >>>>>> The owners of the PRs should check if we
are waiting on them
> to
> > >> take
> > >> > >>>>> action.
> > >> > >>>>>>
> > >> > >>>>>> 977     DRILL-5849: Add freemarker lib to
> dependencyManagement
> > to
> > >> > >> ensure
> > >> > >>>>>> prop…
> > >> > >>>>>> 976     DRILL-5797: Choose parquet reader
from read columns
> > >> > >>>>>> 975     DRILL-5743: Handling column family
and column scan
> for
> > >> hbase
> > >> > >>>>>> 973     DRILL-5775: Select * query on a maprdb
binary table
> > fails
> > >> > >>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown
for the case
> of
> > >> > nested
> > >> > >>>>>> field (reg. of DRILL-4264)
> > >> > >>>>>> 950     Drill 5431: SSL Support
> > >> > >>>>>> 949     DRILL-5795: Parquet Filter push down
at rowgroup
> level
> > >> > >>>>>> 936     DRILL-5772: Add unit tests to indicate
how utf-8
> > support
> > >> can
> > >> > >> be
> > >> > >>>>>> enabled / disabled in Drill
> > >> > >>>>>> 904     DRILL-5717: change some date time
test cases with
> > >> specific
> > >> > >>>>>> timezone or Local
> > >> > >>>>>> 892     DRILL-5645: negation of expression
causes null
> pointer
> > >> > >> exception
> > >> > >>>>>> 889     DRILL-5691: enhance scalar sub queries
checking for
> the
> > >> > >>>>> cartesian
> > >> > >>>>>> join
> > >> > >>>>>>
> > >> > >>>>>> (Items not on the list above have become
“inactive” for a
> > >> variety of
> > >> > >>>>>> reasons.)
> > >> > >>>>>>
> > >> > >>>>>> Thanks,
> > >> > >>>>>>
> > >> > >>>>>> - Paul
> > >> > >>>>>>
> > >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers
<progers@mapr.com>
> > >> wrote:
> > >> > >>>>>>>
> > >> > >>>>>>> Hi Arina,
> > >> > >>>>>>>
> > >> > >>>>>>> I’d like to include the following that
are needed to finish
> up
> > >> the
> > >> > >>>>>> “managed” sort and spill-to-disk for
hash agg:
> > >> > >>>>>>>
> > >> > >>>>>>> #928: DRILL-5716: Queue-driven memory
allocation
> > >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator
strictness for
> > >> "managed"
> > >> > >>>>>> operators
> > >> > >>>>>>> #960, DRILL-5815: Option to set query
memory as percent of
> > total
> > >> > >>>>>>>
> > >> > >>>>>>> The following is needed to resolve issues
with HBase support
> > in
> > >> > empty
> > >> > >>>>>> batches:
> > >> > >>>>>>>
> > >> > >>>>>>> #968, DRILL-5830: Resolve regressions
to MapR DB from
> > DRILL-5546
> > >> > >>>>>>>
> > >> > >>>>>>> The following are nice-to-haves that
build on work already
> > done
> > >> in
> > >> > >>>>> this
> > >> > >>>>>> release, and that some of my own work depends
on:
> > >> > >>>>>>>
> > >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture
to use
> > >> > SystemOptionManager
> > >> > >>>>>> rather than mock
> > >> > >>>>>>> #978: DRILL-5842: Refactor and simplify
the fragment,
> operator
> > >> > >>>>> contexts
> > >> > >>>>>> for testing
> > >> > >>>>>>>
> > >> > >>>>>>> The following is not needed for 1.12
per-se, but is the
> > >> foundation
> > >> > >>>>> for a
> > >> > >>>>>> project I’m working on; would be good to
get this in after
> 2-3
> > >> > months
> > >> > >> of
> > >> > >>>>>> review time:
> > >> > >>>>>>>
> > >> > >>>>>>> #921, foundation for batch size limitation
> > >> > >>>>>>>
> > >> > >>>>>>> The key issue with each of the above
is that they each need
> a
> > >> > >>>>> committer
> > >> > >>>>>> to review. Some have reviews from non-committers.
Any
> > volunteers?
> > >> > >>>>>>>
> > >> > >>>>>>> Thanks,
> > >> > >>>>>>>
> > >> > >>>>>>> - Paul
> > >> > >>>>>>>
> > >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles
Givre <
> cgivre@gmail.com>
> > >> > wrote:
> > >> > >>>>>>>>
> > >> > >>>>>>>> Hi Arina,
> > >> > >>>>>>>> I’d like to include Drill-5834,
Adding network functions.
> > >> > >>>>>>>> https://github.com/apache/drill/pull/971
<
> > >> > >> https://github.com/apache/
> > >> > >>>>>> drill/pull/971>
> > >> > >>>>>>>>
> > >> > >>>>>>>> Hopefully I didn’t violate too
many coding standards this
> > time
> > >> ;-)
> > >> > >>>>>>>> —C
> > >> > >>>>>>>>
> > >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina
Yelchiyeva <
> > >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
> > >> > >>>>>>>>>
> > >> > >>>>>>>>> I want to include DRILL-5337
(OpenTSDB plugin), I'll try
> to
> > >> > finish
> > >> > >>>>> code
> > >> > >>>>>>>>> review during this week.
> > >> > >>>>>>>>>
> > >> > >>>>>>>>> Kind regards
> > >> > >>>>>>>>> Arina
> > >> > >>>>>>>>>
> > >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM,
Arina Ielchiieva <
> > >> > arina@apache.org
> > >> > >>>
> > >> > >>>>>> wrote:
> > >> > >>>>>>>>>
> > >> > >>>>>>>>>> Hi Drillers,
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>>> It's been several months
since the last release and it is
> > >> time
> > >> > to
> > >> > >>>>> do
> > >> > >>>>>> the
> > >> > >>>>>>>>>> next one. I am volunteering
to be the release manager.
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>>> If there are any issues on
which work is in progress,
> that
> > >> you
> > >> > >>>>> feel we
> > >> > >>>>>>>>>> *must* include in the release,
please post in reply to
> this
> > >> > >> thread.
> > >> > >>>>>> Based
> > >> > >>>>>>>>>> on your input we'll define
release cut off date.
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>>> Kind regards
> > >> > >>>>>>>>>> Arina
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>
> > >> > >>>>>>>
> > >> > >>>>>>
> > >> > >>>>>>
> > >> > >>>>>
> > >> > >>>>
> > >> > >>>>
> > >> > >>
> > >> > >>
> > >> >
> > >> >
> > >>
> > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message