Data Generator source connector

Features

The Datagen connector can be used as a source to generate sample data based on a specified data.type. Use the Datagen connector when you want to test pipeline SQL statements using random data without setting up connections to external systems.

Connector name

datagen

Delivery guarantee

At most once

Supported task sizes

S, M, L

Stream output type

Append

Configuration properties

Property Description Required Default

Property	Description	Required	Default
`data.type`	The type of sample data that you want this connection to emit. Must be one of the following: `envoy`: Emits records formatted in Envoy’s default layout pattern. `counter`: Emits records with `counter` and `time` fields. The `counter` field is a monotonically increasing `BIGINT` and the `time` field is a timestamp encoded as a `STRING`.	Yes
`delay`	The delay in milliseconds to wait between generating a record. Must be greater than 99.	—	`500`
`value.format`	The format that the data will be written in. Must be `JSON`.	—	`JSON`

data.type

The type of sample data that you want this connection to emit. Must be one of the following:

envoy: Emits records formatted in Envoy’s default layout pattern.
counter: Emits records with counter and time fields. The counter field is a monotonically increasing BIGINT and the time field is a timestamp encoded as a STRING.

Yes

delay

The delay in milliseconds to wait between generating a record. Must be greater than 99.

—

500

value.format

The format that the data will be written in. Must be JSON.

—

JSON