Astra Streaming is a multi-cloud streaming-as-a-service product built on Apache Pulsar by DataStax. Pulsar is a cloud-native, multi-tenant, high-performance solution for server-to-server messaging and queuing built on the publisher-subscribe (pub-sub) pattern. Pulsar combines the best features of a traditional messaging system like RabbitMQ with those of a pub-sub system like Apache Kafka, scaling up or down dynamically without downtime. It's used by thousands of companies for high-performance data pipelines, microservices, instant messaging, data integrations, and more.
DataStax delivers Pulsar through its Astra Streaming product, which provides a fully-managed SaaS with boundless scale, massive throughput, and low latency.
Connections come in two flavors: source and sink. Source connections read from an external system (Astra stream, in this case) and write to a Decodable stream, while sink connections read from a stream and write to an external system (Astra stream). Astra connectors can be used in either role, performing as either a
source or a
sink. The configuration is identical for both roles.
To create and configure a connector for Astra Streaming, sign in to the Decodable Web Console, navigate to the Connections tab, click on
New Connection, and follow the steps below. For examples of using the command line tools or scripting, see the How To guides.
Select a connector type, either
sink, which will determine whether data is being streamed into Decodable for processing by one or more pipelines, or streamed out to an external system.
Specify the broker service URL that will be used to connect to your Astra broker. For example,
Specify the admin web service URL that will be used to connect to your Astra admin endpoint. For example,
Provide the fully-qualified name of your Astra topic. For example,
Provide the JWT token needed for authentication to your Astra stream.
The value format will default to
JSON, since that is the only option for Astra connectors.
For more detailed information about DataStax Astra Streaming, see the product website for related documentation.
To create an Astra connector for use as a
sink, all the configuration steps above apply.
|Delivery guarantee||at least once|
|Compatibility||Pulsar 2.9.x or above|
The following properties are supported by the Kinesis connector.
|required||Fully qualified Astra streaming topic name|
|required||The broker service URL.|
|required||The admin web service URL.|
|required||Must be |
|required||JWT token for authentication.|
Updated about 2 months ago