beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ismaël Mejía (JIRA) <j...@apache.org>
Subject [jira] [Commented] (BEAM-1678) Create MemcachedIO
Date Sat, 11 Mar 2017 05:31:04 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906093#comment-15906093
] 

Ismaël Mejía commented on BEAM-1678:
------------------------------------

Yes, I know all IOs are PTransforms, and this is even more explicitly with the SDF API ;)
I clarified that this was an IO because for me it was so obvious that such transform made
sense, that I thought that somehow the question you made was because the name 'cache' was
deceiving and people could think this was a different transform.

The signature you propose is more or less what I had in mind, I was thinking about a more
user friendly PTransform<PCollection<KV<K, V>>, PDone> like KafkaIO does,
but maybe I can support both I have to figure this out.

Now the open question after this discussion is authorization because 'vanilla' Memcached uses
no auth by default, and you can configure eventually SASL, but I am pretty sure every other
provider is a different beast. I will have to investigate more, for the moment maybe I will
focus first on the basic Memcached store.


> Create MemcachedIO
> ------------------
>
>                 Key: BEAM-1678
>                 URL: https://issues.apache.org/jira/browse/BEAM-1678
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-extensions
>            Reporter: Ismaël Mejía
>            Assignee: Ismaël Mejía
>            Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message