StreamNative Cloud provides an easy-to-use and fully-managed Pulsar service in the public cloud. It’s API-driven for easy integration with continuous-delivery pipelines. Securely connect to clusters based on OAuth 2.0 and TLS. Automated cluster upgrades mean zero downtime for your enterprise. You can sign up for StreamNative Cloud through the StreamNative website to create and manage StreamNative Cloud resources and Pulsar components. You can also use the StreamNative Cloud CLI tool (snctl) for managing StreamNative Cloud resources.
Sending a Decodable data stream to StreamNative is accomplished in two stages, first by creating a sink connector to a data source that is supported by StreamNative, and then by adding that data source to your StreamNative configuration. Decodable and StreamNative mutually support several technologies, including the following:
- Amazon Kinesis
- Apache Kafka
This example demonstrates using Kafka as the sink from Decodable and the source for StreamNative. Sign in to the Decodable Web Console and follow the configuration steps provided for the Kafka Connector to create a
sink connector. For examples of using the command line tools or scripting, see the How To guides.
The Kafka source connector pulls messages from Kafka topics and persists the messages to Pulsar topics hosted in StreamNative Cloud. Before using the Kafka source connector, you need to create a configuration file using JSON or YAML. As an example of using the Kafka source connecter, you can use the following steps:
Download a Kafka client and a Kafka connector.
Create a network.
Pull a ZooKeeper image and start ZooKeeper.
Pull a Kafka image and start Kafka.
Pull a Pulsar image and start Pulsar standalone.
Create a producer file kafka-producer.py.
Create a consumer file pulsar-client.py.
Copy the configuration files to Pulsar.
Open a new terminal window and start the Kafka source connector in local run mode.
Open a new terminal window and run the consumer.
For more detailed information, please refer to StreamNative's Kafka documentation.
Updated about 1 year ago