DataStax Astra Streaming
Use the DataStax Astra Streaming Connector to get data from or send data to an Astra stream.
Overview
Connector name | astra-streaming |
---|---|
Type | source , sink |
Delivery guarantee | at least once |
Compatibility | Pulsar 2.9.x or above |
Create a connection to an Astra stream with the DataStax Astra Streaming Connector
Follow these steps to get data from or send data to DataStax Astra.
- From the Connections page, select the DataStax Astra Streaming Connector and complete the following fields.
Field | Description |
---|---|
Connection Type | Select whether you want to connect to an Astra stream as a source or a sink. If you select source, then Decodable will read data from the Astra topic provided. If you select sink, then Decodable will send data to the Astra topic provided. |
Broker Service URL | The URL to connect to your Astra Streaming broker. For example, pulsar+ssl://broker.example.com:6651 . |
Admin Web Service URL | The URL to connect to your Astra Streaming admin endpoint. For example, <https://broker.example.com> . |
Topic | The fully-qualified name of the Astra topic. For example, persistent://stream/namespace/topic-name . |
Authentication Token | The JWT web token to use for authentication. |
Value Format | The format for data in the Astra topic. Must be one of the following: - JSON - AVRO - Debezium (JSON) If you want to send CDC data through this connector, then you must select Debezium (JSON). |
-
Select the stream that you’d like to connect to this connector. Then, select Next.
-
Define the connection’s schema. Decodable can auto-populate the connection’s schema using Pulsar's schema registry. In most cases, you’ll want to select Schema Registry to automatically populate the connection’s schema. However, if you would like to manually enter the schema, select New Schema or Structured Schema Definition.
- If you want to auto-populate the connection schema using Pulsar's schema registry, you’ll also need to provide the name of your Pulsar tenant, the namespace where your topic is, and the version of the schema that you’d like to use.
-
Select Next when you are finished providing defining the connection’s schema.
-
Give the newly created connection a Name and Description and select Save.
Properties
The following properties are supported by the Kinesis connector.
Property | Disposition | Description |
---|---|---|
topic | required | Fully qualified Astra streaming topic name. Example: persistent://decodable/default/test |
service-url | required | The broker service URL. Example: pulsar+ssl://broker.example.com:6651 |
admin-url | required | The admin web service URL. Example: <https://broker.example.com > |
format | required | The format for data in the Astra topic. Must be one of the following: - JSON - AVRO - Debezium (JSON) If you want to send CDC data through this connector, then you must select Debezium (JSON). |
token | required | JWT token for authentication. Example: eyJhbGciOiJIUzI1NiJ9... |
Updated about 1 month ago