beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Halperin (JIRA)" <>
Subject [jira] [Updated] (BEAM-46) Unbounded sink for Google Cloud Bigtable
Date Sat, 25 Jun 2016 01:52:16 GMT


Daniel Halperin updated BEAM-46:
    Assignee: Ian Zhou

> Unbounded sink for Google Cloud Bigtable
> ----------------------------------------
>                 Key: BEAM-46
>                 URL:
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-java-gcp
>            Reporter: Daniel Halperin
>            Assignee: Ian Zhou
> Google Cloud Bigtable is currently in Beta. A bounded
sink is included in the initial code for Beam, and uses asynchronous row mutations (with bounded
memory) for maximum throughput.
> The unbounded sink code is in principle not too different. The key areas of focus are
better connection management, thread management, and fault tolerance (e.g., so connections
are not leaked if bundles fail) in the unbounded case in which there are hundreds of active
threads and very small bundles.

This message was sent by Atlassian JIRA

View raw message