This guide steps you through an end-to-end example of using Decodable to parse real-time log data in the Envoy HTTP server format. The goal is to help you become familiar with the platform so that you can start implementing your own use case.

By the end of the tutorial, you should have a workflow that resembles the following diagram.

You will learn how to:

• Use connections to get data into a Decodable stream.
  A stream transports records within Decodable and is conceptually similar to a "topic" in Kafka or a "stream" in AWS Kinesis.
• Create pipelines using SQL to transform data from a stream as follows:
  • Extract information from HTTP log data into separate data fields with the correct data types.
  • Perform aggregations on data.

Prerequisites

This tutorial assumes that you have already created a Decodable account and have logged in successfully. If you haven't created an account yet, sign-up for a free Decodable account here.