beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (BEAM-3141) Make coders & streams work in Python 3
Date Sun, 05 Nov 2017 07:10:00 GMT


ASF GitHub Bot commented on BEAM-3141:

GitHub user holdenk opened a pull request:

    [BEAM-3141][WIP] Support the coders in Python 3

    This adds support for the coders in Python 3 as well as fixes some other issues that were
blocking `GameStatsTest`/

You can merge this pull request into a Git repository by running:

    $ git pull BEAM-3141-coder-py3-support-r2

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #4078
commit f3dd6257e3765bf9117207fa8173027f92b64c60
Author: Holden Karau <>
Date:   2017-11-03T18:18:26Z

    Fix unicode imports and NoneType

commit 6f7f8aa6ea9b42f7ed39af68ccd806bc16173b1c
Author: Holden Karau <>
Date:   2017-11-03T18:31:06Z

    Swap the avroio over to BytesIO

commit 32f39f1e9023faea87a23c4bf9bd31897d9b2f8f
Author: Holden Karau <>
Date:   2017-11-03T18:31:24Z

    Swithc apiclinet to io StringIO from StringIO StringIO

commit 630d40d74eec5e3af693e5ab0fba3e4b3163ba62
Author: Holden Karau <>
Date:   2017-11-03T18:39:31Z

    Switch required packages based on Python version (currently only impacting avro) and add
future geq 0.16.0

commit 9bd4e7f20770d6276ea16b58dfdb041210ae1a15
Author: Holden Karau <>
Date:   2017-11-03T23:07:27Z

    Rewrite lambda with expansion

commit f58668416f3f451166dbe644ab56581c4902d6b6
Author: Holden Karau <>
Date:   2017-11-03T23:07:42Z

    Fix items and builtin import and a long import

commit da9ebb7667df4992512177d1d0e8b9ce4cafc62e
Author: Holden Karau <>
Date:   2017-08-20T21:11:07Z

    Rich comparisions requirement

commit dfc4e9057acb417e261a5e59399e5e943861cc3d
Author: Holden Karau <>
Date:   2017-08-20T21:42:33Z

    Add __hash__ methods in places where needed (in progress)

commit ca1f224d080ea37fd0de3582e9a7a5847f476f34
Author: Holden Karau <>
Date:   2017-08-21T09:03:52Z

    Provide eq/hashing/sorting for TimestampedValue

commit ea502b5a95b42ded289a97bc59a3cfbd2b9e05d8
Author: Holden Karau <>
Date:   2017-08-21T18:44:37Z

    If we are passed in bytes for the lookup in pipeline_context do the lookup as a string

commit fee6a65eaef0b85386fa42cd02ef45da8e370d51
Author: Holden Karau <>
Date:   2017-08-21T19:08:44Z

    Provide a base ne using eq for windows

commit 099e115f190d86352cc9b01a0b4feb48b3442192
Author: Holden Karau <>
Date:   2017-11-03T23:11:29Z

    Switch filesystem to io.StringIO

commit b0c7cda8626b90a7bd260077f54da5c07ba2b3c4
Author: Holden Karau <>
Date:   2017-11-03T23:47:13Z

    Fix cirular dep introduced through Py3 import changes for CreatePTransformOverride.

commit b0af9cca420d97b9037be91ddba9719a01a272ad
Author: Holden Karau <>
Date:   2017-11-04T00:00:34Z

    Change slow_stream to bytes

commit 5890721770aca710d5f8f5194ade7a9f2a19fbc5
Author: Holden Karau <>
Date:   2017-11-04T04:40:17Z

    Handle slow_stream in py2 again

commit bc30732264463b12a49f445e0f369e361e5fb823
Author: Holden Karau <>
Date:   2017-11-04T04:58:44Z

    Selective fixes while running through,
fix some rethrows. lambda expansion, imports, and metaclass

commit b2424e790e01d1a758458f052f37648850719705
Author: Holden Karau <>
Date:   2017-11-04T05:00:14Z

    metaclass rewrite rule

commit fb63800079b3b44e4b6ec59844c20813b1ba449a
Author: Holden Karau <>
Date:   2017-11-04T06:36:00Z

    Apply futurize on gen_protos

commit 767c1cc30d32edf21edf1916a47a8f5c779512fd
Author: Holden Karau <>
Date:   2017-11-04T07:16:12Z

    queue and raise rewrites

commit e8e40ac46097fd3b4ecc7f40383031755a0b265f
Author: Holden Karau <>
Date:   2017-11-04T07:18:10Z

    futurize -wn -f libfuturize.fixes.fix_future_standard_library_urllib ./apache_beam

commit fe278de3039ceaae7af819cb119bb31f25d679fa
Author: Holden Karau <>
Date:   2017-11-04T08:04:59Z

    Finish up getting to
run, fix serialized values map over, switch some exception re-throws, iteritems, and handle
peaking at the eval context.

commit f2c78e6f0b66b11292035eac224914dc439d175c
Author: Holden Karau <>
Date:   2017-11-04T08:21:04Z

    Fix the write_byte on slow stream to just use bytes rather than encode

commit 8dbf4e72cdb5a4bf6a4280f472acca85ef3c991c
Author: Holden Karau <>
Date:   2017-11-04T08:25:14Z

    Fix some bytes coders tests to use bytes in py3

commit d43b70419c883ad30183893d967456a78595f11d
Author: Holden Karau <>
Date:   2017-11-04T08:25:38Z

    Change the fall through for encoding a bit and update past imports

commit 5c102b70cce3ad49c635d4ea52432356ddf00f50
Author: Holden Karau <>
Date:   2017-11-04T08:25:57Z

    Only wrap in bytes for py3

commit 669c3f90c1b71cc34f89c9b3e52e95ac385b1333
Author: Holden Karau <>
Date:   2017-11-05T04:09:21Z

    Fix remaining coder issues accross py2/3


> Make coders & streams work in Python 3
> --------------------------------------
>                 Key: BEAM-3141
>                 URL:
>             Project: Beam
>          Issue Type: Sub-task
>          Components: sdk-py-core
>            Reporter: holdenk
>            Assignee: Ahmet Altay
> Fix coders & streams support in Python 3.

This message was sent by Atlassian JIRA

View raw message