MySQL CDC

MySQL delivers a very fast, multithreaded, multi-user, and robust SQL (Structured Query Language) database server. It is intended for mission-critical, heavy-load production systems as well as for embedding into mass-deployed software. MySQL is one of the most popular database management systems in the world, successfully powering many applications. MySQL is typically used for managing the core (or transactional) data of applications, such as products or sales in an e-commerce shop, and is often complemented with other data systems, e.g., a data warehouse for analytics, a search engine for search, etc.

The traditional approach to syncing MySQL with complementary data stores is batch-based, where pipelines extract data from the MySQL database system and send it to downstream data stores. Change data capture (CDC) is a modern alternative to inefficient bulk imports. CDC extracts change events (INSERTs, UPDATEs, and DELETEs) in real-time from data stores, such as MySQL, and provides them to a data pipeline.

Getting Started

Connections come in two flavors: source and sink. Source connections read from an external system and write to a Decodable stream, while sink connections read from a stream and write to an external system. MySQL CDC connectors can only be used in the source role.

Configure As A Source

To create and configure a connector for MySQL CDC, sign in to the Decodable Web Console, navigate to the Connections tab, click on New Connection, and follow the steps below. For examples of using the command line tools or scripting, see the How To guides.

  1. The connector type will default to source, since that is the only option for MySQL CDC connectors.

  2. Specify the hostname to connect to your MySQL database. For example, mysql-server.

  3. Optionally specify the port number to use when connecting to the host. By default, the port number is 3306.

  4. Provide the name of the database for the connection.

  5. Specify the name of the database table for the connection.

  6. Provide the username of the database on whose behalf the connection is being made.

  7. Provide the database user's password.

There are multiple ways to implement change data capture (CDC) with MySQL. For more detailed information, see the MySQL Getting Started guide and related documentation.

Reference

Connector namemysql-cdc
Typesource
Delivery guaranteeexactly once

The MySQL CDC source connects to a MySQL table through ****** connections.

Properties

The following properties are supported by the MySQL CDC connector.

PropertyDispositionDescription
proprequiredProp desc.

Did this page help you?