beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From pabloem <>
Subject [GitHub] incubator-beam pull request #1419: [BEAM-147] Adding Metrics API to Python S...
Date Tue, 22 Nov 2016 22:33:03 GMT
GitHub user pabloem opened a pull request:

    [BEAM-147] Adding Metrics API to Python SDK

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
     - [x] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [x] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](

You can merge this pull request into a Git repository by running:

    $ git pull metrics-api

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1419
commit 937cf69e958d4a82fb274f311de248930298db69
Author: Robert Bradshaw <>
Date:   2016-07-22T21:32:33Z

    Fix multi-input named PTransforms.
    Now delegate the __ror__ logic entirely for the naming wrapper.

commit 031c4cce0b9eae0d50a49f43ffeced1edbfd2f8f
Author: Robert Bradshaw <>
Date:   2016-07-22T21:34:58Z

    Move names out of transform constructors.
    sed -i -r 's/[|] (\S+)[(](["'"'"'][^"'"'"']+.)(, +|([)]))/| \2 >> \1(\4/g'
    Small number of tests will need to be fixed by hand.

commit 7c186ce4ce18c98cf3979b6f0f07c72a47b42ec9
Author: Robert Bradshaw <>
Date:   2016-07-22T22:55:26Z

    Fix error messages for externally named PTransforms.

commit 362f2e9e4398662d55a2a4e6399f43155c58ed24
Author: Ahmet Altay <>
Date:   2016-07-22T23:03:08Z

    fix pipeline test

commit 2ff5630be06034e25d60e105bbe1a718ae06b4d6
Author: Chamikara Jayalath <>
Date:   2016-07-22T23:04:29Z

    Fixes examples

commit 01830510bded3c22ddd96937f5d83547702a4385
Author: Robert Bradshaw <>
Date:   2016-07-22T23:05:23Z

    Cleanup and fix combiners_test.

commit 2a59a121441a003bad949ae6a23d58a9cf2b3059
Author: Robert Bradshaw <>
Date:   2016-07-22T23:24:48Z

    Fix label-sensitive test.

commit b15d35ca6e585e75153e05d96403336889cc6894
Author: Robert Bradshaw <>
Date:   2016-07-23T01:35:22Z

    Lint fixes.

commit c5b5b14d35fc7f6b0a576f0fca19b730015e1282
Author: Robert Bradshaw <>
Date:   2016-07-23T08:07:44Z

    fixup: failing tests expecting name

commit e3c078fe28553b7e7317316b6df51b4c570573ba
Author: Robert Bradshaw <>
Date:   2016-07-23T08:32:23Z

    Final cleanup pass.

commit 38d9dea2e62af280e4b9c258cedee70d6bcaa8ca
Author: Robert Bradshaw <>
Date:   2016-07-23T23:43:47Z

    Closes #718

commit ac3249fe51e9674149ae9cccd48c7290aa8bf34d
Author: Robert Bradshaw <>
Date:   2016-07-23T00:33:57Z

    Make DoFnRunner a Receiver.

commit d20cf64287fdd22b1efa1a3afe346a0a1d5cf924
Author: Robert Bradshaw <>
Date:   2016-07-23T07:37:42Z

    Receiver and LoggingContext adapters.
    This allows for cdef calls iff the right type is passed in.

commit de35f28294dfb4f47b429635eff843b38279e240
Author: Robert Bradshaw <>
Date:   2016-07-23T07:54:11Z

    Allow passing logging context directly.
    This is better than passing a logger module with a specific class.

commit 153916fe9f641f5fe5e8d473caef67f449ee6bca
Author: Robert Bradshaw <>
Date:   2016-07-25T19:02:02Z

    Closes #721

commit 8a7bc71dee1e3f9f17c29e5e558870a6bc5f4880
Author: Charles Chen <>
Date:   2016-07-26T01:22:08Z

    Fix SDK name and version sent to the Cloud Dataflow service

commit 76f3864b61ad9e2ac9a2e81e7a0d5993db5fde6c
Author: Charles Chen <>
Date:   2016-07-26T01:36:45Z

    Update docstring.

commit 26ff6579531d598e91b220fa21ec9bd7f9220f78
Author: Robert Bradshaw <>
Date:   2016-07-26T04:11:31Z

    Closes #730

commit 2f4054ba37da1c1100f45a572d96e7a6e2e60152
Author: Charles Chen <>
Date:   2016-07-25T18:44:22Z

    Make TextFileReader observable
    This allows future implementation of size tracking for elements in side input sources.

commit 53ab635c75e4b94b3930a601911a717ddc499efe
Author: Robert Bradshaw <>
Date:   2016-07-28T18:05:56Z

    Closes #726

commit adb3ed93053c83b4e28e7baa879e9aee82f02785
Author: Robert Bradshaw <>
Date:   2016-07-27T17:09:49Z

    Better top implementation.
    When selecting the top k of n, it is common that k << n.
    Using a heap is O(n log k) while select algorithms can
    achieve O(n + k log k).
    This also avoids the ugliness that heapq does not take the
    comparator as an argument, resulting in _HeapItem classes that
    were cumbersome and expensive to serialize.

commit 866a09d6c5c4c1c3c39d3a1f2e7b4cb7ec319f6f
Author: Robert Bradshaw <>
Date:   2016-07-27T19:23:02Z

    Allow Top operations to take key argument rather than compare.
    Also support ordering by the natural ordering if neither is specified,
    and a reverse option.  This is both an API and performance improvement.

commit b4716d9dcf9c3f198fc72e181adc0bae8b6fa818
Author: Robert Bradshaw <>
Date:   2016-07-28T18:08:06Z

    Closes #741

commit 7d2fb1f88d1a2370dd4053f3a1738cbb9838cc2f
Author: Robert Bradshaw <>
Date:   2016-07-28T01:29:59Z

    Optimize Map and Flatmap when there are no side inputs.
    varargs and kwargs are expensive, even when they're empty.
    This is especially true for otherwise one-argument Python calls
    which are special cased in CPython.

commit 351c3831de1bdcfcb19b2f24f9f0b6a19e77e421
Author: Robert Bradshaw <>
Date:   2016-07-28T18:09:49Z

    Closes #748

commit a1f1fa06ee8683273182548e7eb2d6612040d2bf
Author: Marian Dvorsky <>
Date:   2016-07-28T20:02:15Z

    Increased the GCS buffer size from 1MB to 8MB and introduced a 128kB buffer for the pipe.

commit c155ef0ebc88ac34a3681b8bff6152e1857da847
Author: Robert Bradshaw <>
Date:   2016-07-29T01:17:43Z

    Closes #752

commit 889f700d4568773743ef0cfe0ca0fd8d55e56c99
Author: Ahmet Altay <>
Date:   2016-07-29T20:45:57Z

    Fix typo in combiners test.

commit 5541c0305c4129741579fbbed54b3194f00e3cf6
Author: Dan Halperin <>
Date:   2016-07-29T20:55:22Z

    Closes #760

commit 7d50d8040585e0cea5bc02de4cb199f29c1472fc
Author: Chamikara Jayalath <>
Date:   2016-07-29T22:40:39Z

    Deletes some code that is not used by SDK.
    Also deletes corresponding tests.


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message