StreamNative sink integration

This is a supported integration which requires manual configuration.

Contact Decodable support if you are interested in native support with a Decodable connector.

Sending a Decodable data stream to StreamNative is accomplished in two stages:

  1. Creating a sink connector from Decodable to a data source that’s supported by StreamNative

  2. Adding that data source to your StreamNative configuration. Decodable and StreamNative mutually support several technologies, including the following:

    • Amazon Kinesis

    • Apache Kafka

Add a Kafka sink connector

Follow the configuration steps provided for the Apache Kafka sink connector.

Create Kafka data source

The Kafka source connector pulls messages from Kafka topics and persists the messages to Pulsar topics hosted in StreamNative Cloud. Before using the Kafka source connector, you need to create a configuration file using JSON or YAML. As an example of using the Kafka source connector, you can use the following steps:

  1. Download a Kafka client and a Kafka connector.

  2. Create a network.

  3. Pull a ZooKeeper image and start ZooKeeper.

  4. Pull a Kafka image and start Kafka.

  5. Pull a Pulsar image and start Pulsar standalone.

  6. Create a producer file kafka-producer.py.

  7. Create a consumer file pulsar-client.py.

  8. Copy the configuration files to Pulsar.

  9. Open a new terminal window and start the Kafka source connector in local run mode.

  10. Open a new terminal window and run the consumer.

For more detailed information, see StreamNative’s Kafka documentation.