How to use Kafka Connect for Cassandra without Confluent

Question

How can we use Kafka Connect with Cassandra without using Confluent frameworks.

Answer 1

Kafka Connect - . Confluent offers only connectors. If you do not want to use Confluent Open Source (but why not?), You can use all of these connectors with vanilla Apache Kafka.

Several Casandra connectors are available: https://www.confluent.io/product/connectors/

Btw: None of the Casandra connectors listed are supported by Confluent.

, .

Answer 2

DataMountaineer Stream Reactor Cassandra Source and Sink, Kafka Connect.

jar () Kafka libs, :

{
"name": "cassandra-NAME",
"config": {
    "tasks.max": "1",
    "connector.class": "com.datamountaineer.streamreactor.connect.cassandra.source.CassandraSourceConnector",
    "connect.cassandra.key.space": "KEYSPACE",
    "connect.cassandra.source.kcql": "INSERT INTO KAFKA_TOPIC SELECT column1, timestamp_col FROM CASSANDRA_TABLE PK timestamp_col",
    "connect.cassandra.import.mode": "incremental",
    "connect.cassandra.contact.points": "localhost",
    "connect.cassandra.port": 9042,
    "connect.cassandra.import.poll.interval": 10000
}}

Kafka Connect

bin/connect-distributed.sh config/connect-distributed.properties

Cassandra Kafka Connect JSON, ( , connect-cassandra-source.json)

curl -X POST -H "Content-Type: application/json" -d @config/connect-cassandra-source.json localhost:8083/connectors

, timeuuid . .

Answer 3

, Kafka Connect api Cassandra Drivers DataStax Kafka-cassandra.