Decodable Logo
Community Slack Start Free

Decodable Docs

    • Getting Started
      • Quickstart: Decodable in 10 minutes
        • Step 1: Activate the connection
        • Step 2: Preview data
        • Step 3: Create a pipeline to apply a schema to the data
        • Step 4: Preview your pipeline results
        • Step 5: Build an aggregation pipeline
        • Step 6: Summary and what’s next
      • Set up a Decodable account
      • Checklist: Set up an end-to-end workflow using Decodable
    • Connect to sources and sinks
      • Source connectors
        • Apache Kafka
          • How To: Set up mutual TLS (mTLS) authentication with Apache Kafka
          • How To: Set up SASL Authentication with Apache Kafka
          • How To: Set up TLS encryption with Apache Kafka
          • How to: Set up the Protobuf key and value format (tech preview)
        • Apache Pulsar
        • Amazon DynamoDB CDC
        • Amazon Kinesis
        • Amazon S3
        • Amazon S3 Lambda
        • Confluent Cloud
        • Data Generator
        • Datastax Astra Streaming
        • Google Cloud Pub/Sub
        • Microsoft SQL Server CDC
        • MongoDB CDC
        • MySQL CDC
        • Oracle CDC
        • Postgres CDC
        • Redpanda
        • REST
      • Sink connectors
        • Apache Druid
        • Apache Hudi
        • Apache Iceberg
        • Apache Kafka
          • How to: Set up the Protobuf key and value format (tech preview)
        • Apache Pinot
        • Apache Pulsar
        • Amazon Kinesis
        • Amazon Redshift
        • Amazon S3
        • ClickHouse
        • Confluent Cloud
        • Datadog
        • Datastax Astra Streaming
        • Delta Lake
        • Elasticsearch
        • Google Cloud Pub/Sub
        • Imply Enterprise
        • Imply Polaris
        • InfluxDB
        • Microsoft SQL Server
        • MongoDB
        • MySQL
        • OpenSearch
        • Oracle
        • Postgres
        • Redis
        • Redpanda
        • SingleStore DB
        • Snowflake
        • StarTree
        • StreamNative
      • Managing connections
        • Creating a connection
        • Listing connections
        • Editing a connection
        • Deleting a connection
      • Reference
        • Connector concepts
        • Network connectivity
        • Starting state
    • Create and manage streams
      • About Change Data Capture and Change Streams
      • Create and manage Streams
    • Process and transform data with pipelines
      • Create Pipelines using SQL
      • Create Pipelines using your own Apache Flink jobs
      • Edit or delete Pipelines
      • Offsets and starting state
      • Joining streaming data
        • Regular joins
        • Time-based lookup joins
      • SQL functions
        • Aggregate
        • Arithmetic
        • Collection
        • Comparison
        • Conditional
        • Grouping
        • Hash
        • JSON
        • Logical
        • Stream Conversion
        • String
        • Table-Valued
        • Temporal
        • Type Conversion
        • Value Access
        • Value Construction
        • XML
      • Windowing in SQL
      • Pipelines examples for the most popular data transformations
      • Manage state with snapshots
    • Declarative configuration
      • Create and update resources
        • Generate connection definitions
      • Query existing resources
      • Resource definitions
    • Decodable CLI
      • Downloads
      • Upgrade
      • Using the Decodable CLI tutorial
      • Managing multiple profiles
      • Tips and tricks
      • Use the CLI from scripts
      • Integrate with GitHub Actions
    • Administer
      • Roles, groups, and permissions
      • Task count and sizes
      • Manage Secrets
      • Manage schemas
      • Manage tags
      • Schema migrations
      • Connecting with dbt
      • Scale to Zero
    • Operations
      • Connections guide for CDC connectors
    • Monitoring
      • System events and metrics
    • Deployment
      • Bring Your Own Cloud (BYOC) Setup
      • BYOC Cloud Resources - AWS
      • Shared Responsibility Model
    • Reference
      • API
        • Control Plane
        • Data Plane
        • Pipeline SDK
      • Available regions and IP addresses
      • Access AWS resources from your Decodable account
      • Decodable data types
      • Terminology
      • Frequently asked questions
      • Known issues and limitations
      • Credits
    • Guides and Tutorials
      • Tutorials
        • Ingest data into your data warehouse, data lake, or OLAP database
        • Transform data between Kafka topics
        • Create a curated stream of data for other teams
        • Replicate data from a database to your data warehouse or data lake using Debezium-powered CDC
      • Examples
      • Solution Guides
    • Getting help