beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ib...@apache.org
Subject [beam] branch master updated (6453e85 -> 4d38e39)
Date Mon, 04 May 2020 18:54:55 GMT
This is an automated email from the ASF dual-hosted git repository.

ibzib pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 6453e85  Merge pull request #11333 from jhnmora000/master
     new 497cd03  Make BatchGroupAlsoByWindowViaIteratorsFn extend the ElementByteSizeObservableIterable
so that size estimation is lazy
     new 573289a  Do not attempt to estimate sizes of group-by-key values behind a key; such
iterables can have enormous sizes and size estimates would cause reading the data multiple
times.  Furthermore, the size of the entire group-by-key collection is already known precisely
at read time (and encoded into corresponding counters), which means the estimation is in fact
not only expensive but redundant and unnecessary.
     new 0cd43d1  remove comments
     new 33091d2  Make BatchGroupAlsoByWindowViaIteratorsFn extend the ElementByteSizeObservableIterable
so that size estimation is lazy
     new 62e4df7  revert changes to grouping shuffle reader and iterable like coder
     new fc180dd  fix merge conflicts
     new dd9ab00  remove obsolete class
     new 4d38e39  Merge pull request #11598 from tudorm/no-expensive-size-estimation-gbk

The 26821 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../util/BatchGroupAlsoByWindowViaIteratorsFn.java      | 17 +++++++++++++----
 1 file changed, 13 insertions(+), 4 deletions(-)


Mime
View raw message