Confluent Kafka Sink connector for MySQL

##Download Confluent Community version.

## Install Confluent Kafka Local. (Untar setup file)

tar -xvf confluent-community-5.3.1–2.12.tar

##Setup Conflunet Cli.

curl -L | sh -s — -b ~/confluent-5.3.1/bin

##Include Confluent bin into PATH.

export PATH=${PATH}:~/confluent-5.3.1/bin

## Start Conflunet

confluent local start
Confluent Start message.

##Download MySQL Jar file place under

cp mysql-connector-java-5.1.48.jar ~/confluent-5.3.1/share/java/kafka-connect-jdbc
cp mysql-connector-java-5.1.48-bin.jar ~/confluent-5.3.1/share/java/kafka-connect-jdbc
MySQL Jar Files

## Create sink MySQL property file for Confluent connector and place it under ~/confluent-5.3.1/etc/kafka-connect-jdbc/


## Load MySQL Connector : test_mysql_sink

confluent local load test_mysql_sink -- -d
Output Message.

##Check status of Connector.

confluent local status test_mysql_sink

##Now Produce Avro Messages:

Note: Change topic name at line #33 to orders from Test_MovieData

## Logon to MySQL and verify that the Order table is created under demo schema and records are loaded.

if you get Java Error while start confluent then install java 1.8

The local commands are intended for a single-node development environment
only, NOT for production usage.
Current Java version ‘12’ is unsupported at this time. Confluent CLI will exit.ERROR: The Confluent CLI requires Java version 1.8 or 1.11.
See .
If you have multiple versions of Java installed, you may need to set JAVA_HOME to the version you want Confluent to use.


export JAVA_HOME=$(/usr/libexec/java_home -v 1.8)


Confluent Kafka Python.



Lead Data Engineer@Nisum Technologies

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store