beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ismaël Mejía (JIRA) <>
Subject [jira] [Commented] (BEAM-1678) Create MemcachedIO
Date Sat, 11 Mar 2017 05:31:04 GMT


Ismaël Mejía commented on BEAM-1678:

Yes, I know all IOs are PTransforms, and this is even more explicitly with the SDF API ;)
I clarified that this was an IO because for me it was so obvious that such transform made
sense, that I thought that somehow the question you made was because the name 'cache' was
deceiving and people could think this was a different transform.

The signature you propose is more or less what I had in mind, I was thinking about a more
user friendly PTransform<PCollection<KV<K, V>>, PDone> like KafkaIO does,
but maybe I can support both I have to figure this out.

Now the open question after this discussion is authorization because 'vanilla' Memcached uses
no auth by default, and you can configure eventually SASL, but I am pretty sure every other
provider is a different beast. I will have to investigate more, for the moment maybe I will
focus first on the basic Memcached store.

> Create MemcachedIO
> ------------------
>                 Key: BEAM-1678
>                 URL:
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-extensions
>            Reporter: Ismaël Mejía
>            Assignee: Ismaël Mejía
>            Priority: Minor

This message was sent by Atlassian JIRA

View raw message