beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Solomon Duskis (JIRA)" <>
Subject [jira] [Commented] (BEAM-2395) BigtableIO for Python SDK
Date Tue, 20 Jun 2017 19:01:00 GMT


Solomon Duskis commented on BEAM-2395:

The python cloud bigtable client is missing some key features that the java client has relating
to robustness and performance.  Specifically, the Java client has a "smart retries" feature
that allows writes and reads to proceed despite temporary error conditions.  The python client
also needs use the "bulk write" API for performance purposes. 

Without those features, a python Cloud Bigtable connector should not be considered ready for
production.  FWIW, there are ongoing efforts to add those features.

> BigtableIO for Python SDK
> -------------------------
>                 Key: BEAM-2395
>                 URL:
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-py
>            Reporter: Matthias Baetens
>            Assignee: Matthias Baetens
>              Labels: features
> Developing a read and write IO for BigTable for the Python SDK. 
> Working / design document can be found here:

This message was sent by Atlassian JIRA

View raw message