flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3311) Add a connector for streaming data into Cassandra
Date Wed, 06 Apr 2016 09:20:25 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15228003#comment-15228003
] 

ASF GitHub Bot commented on FLINK-3311:
---------------------------------------

Github user zentol commented on a diff in the pull request:

    https://github.com/apache/flink/pull/1771#discussion_r58675302
  
    --- Diff: flink-streaming-connectors/flink-connector-cassandra/src/test/resources/cassandra.yaml
---
    @@ -0,0 +1,43 @@
    +################################################################################
    +#  Licensed to the Apache Software Foundation (ASF) under one
    +#  or more contributor license agreements.  See the NOTICE file
    +#  distributed with this work for additional information
    +#  regarding copyright ownership.  The ASF licenses this file
    +#  to you under the Apache License, Version 2.0 (the
    +#  "License"); you may not use this file except in compliance
    +#  with the License.  You may obtain a copy of the License at
    +#
    +#      http://www.apache.org/licenses/LICENSE-2.0
    +#
    +#  Unless required by applicable law or agreed to in writing, software
    +#  distributed under the License is distributed on an "AS IS" BASIS,
    +#  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    +#  See the License for the specific language governing permissions and
    +# limitations under the License.
    +################################################################################
    +cluster_name: 'Test Cluster'
    +commitlog_sync: 'periodic'
    +commitlog_sync_period_in_ms: 10000
    +commitlog_segment_size_in_mb: 16
    +partitioner: 'org.apache.cassandra.dht.RandomPartitioner'
    +endpoint_snitch: 'org.apache.cassandra.locator.SimpleSnitch'
    +commitlog_directory: $PATH\commit'
    +data_file_directories:
    +    - $PATH\data'
    +saved_caches_directory: $PATH\cache'
    --- End diff --
    
    the simple explanation would be that the EmbeddedCassandraService can resolve the path
properly regardless of platform.


> Add a connector for streaming data into Cassandra
> -------------------------------------------------
>
>                 Key: FLINK-3311
>                 URL: https://issues.apache.org/jira/browse/FLINK-3311
>             Project: Flink
>          Issue Type: New Feature
>          Components: Streaming Connectors
>            Reporter: Robert Metzger
>            Assignee: Andrea Sella
>
> We had users in the past asking for a Flink+Cassandra integration.
> It seems that there is a well-developed java client for connecting into Cassandra: https://github.com/datastax/java-driver
(ASL 2.0)
> There are also tutorials out there on how to start a local cassandra instance (for the
tests): http://prettyprint.me/prettyprint.me/2010/02/14/running-cassandra-as-an-embedded-service/index.html
> For the data types, I think we should support TupleX types, and map standard java types
to the respective cassandra types.
> In addition, it seems that there is a object mapper from datastax to store POJOs in Cassandra
(there are annotations for defining the primary key and types)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message