Apache® Pulsar™ is a cloud-native, multi-tenant, high-performance solution for server-to-server messaging and queuing built on the publisher-subscribe (pub-sub) pattern. Pulsar combines the best features of a traditional messaging system like RabbitMQ with those of a pub-sub system like Apache Kafka, scaling up or down dynamically without downtime. It's used by thousands of companies for high-performance data pipelines, microservices, instant messaging, data integrations, and more.
- Serverless functions
- Horizontally scalable
- Low latency with durability
Connections come in two flavors: source and sink. Source connections read from an external system and write to a Decodable stream, while sink connections read from a stream and write to an external system. Pulsar connectors can be used in either role, performing as either a
source or a
sink. The configuration is identical for both roles.
To create and configure a connector for Pulsar, sign in to the Decodable Web Console, navigate to the Connections tab, click on
New Connection, and follow the steps below. For examples of using the command line tools or scripting, see the How To guides.
Select a connector type, either
sink, which will determine whether data is being streamed into Decodable for processing by one or more pipelines, or streamed out to an external system.
Specify the broker service URL that will be used to connect to your Pulsar broker. For example,
Specify the admin web service URL that will be used to connect to your Pulsar admin endpoint. For example,
Provide the name of your Pulsar topic.
Optionally provide the JWT token if one is needed for authentication.
The value format will default to
JSON, since that is the only option for Pulsar connectors.
For more detailed information about Apache Pulsar, see the Pulsar Getting Started guide and related documentation.
To create a Pulsar connector for use as a
sink, all the configuration steps above apply.
|Delivery guarantee||at least once|
|Compatibility||Pulsar 2.9.x or above|
The Pulsar connector streams data into or out of an Apache Pulsar® topic.
The following properties are supported by the Kinesis connector.
|required||Fully qualified pulsar topic name|
|required||The broker service URL.|
|required||The admin web service URL.|
|required||Must be |
|optional||JWT token for authentication.|
json, the following properties are optionally allowed:
|Specify the timestamp format for |
|Must be |
For example, a number encoded
Updated 4 months ago