Data Generator

Connector name: datagen
Types: source
Delivery guarantee: at most once

The Datagen connector generates sample data based on specified data.type. This is useful when developing queries locally without setting up connections to external systems such as Kafka.

Properties

data.type (required) - the type of data to generate.
Valid values include:

  • envoy: The sample data is in Envoy's default layout pattern.
  • counter: The sample data includes records with counter and time fields.
    • counter is a monotonically increasing bigint.
    • time is a timestamp encoded as a string.

delay - Specifies the delay in milliseconds between the generated records. The effective number must be greater than or equal to 100. If delay is less than 100, 100 is used.
Default value: 100