Rockset is a real-time analytics database which enables queries on massive, semi-structured data without operational burden. Rockset is serverless and fully managed. It offloads the work of managing configuration, cluster provisioning, denormalization, and shard/index management. Rockset is also SOC 2 Type II compliant and offers encryption at rest and in flight, securing and protecting any sensitive data.
Rockset is compute-optimized, making it suitable for serving high-concurrency applications in the sub-100 terabyte range (or larger with roll-ups, e.g., 100s of TBs). It’s not a data warehouse and is not suitable for occasional queries on a PB-scale dataset.
Sending a Decodable data stream to Rockset is accomplished in two stages, first by creating a sink connector to a data source that is supported by Rockset, and then by adding that data source to your Rockset configuration. Decodable and Rockset mutually support the following technologies:
- Amazon Kinesis
- Amazon S3
- Apache Kafka
- Confluent Cloud
This example demonstrates using Kafka as the sink from Decodable and the source for Rockset. Sign in to the Decodable Web Console and follow the configuration steps provided for the Kafka Connector to create a
sink connector. For examples of using the command line tools or scripting, see the How To guides.
Rockset supports Kafka clusters in Confluent Cloud as well as Confluent Platform or Apache Kafka. To use Confluent Cloud with Rockset, follow these steps:
- Identify your bootstrap server URL. You can find this on Confluent Cloud by navigating to Cluster settings > Identification.
- Identify your Confluent Cloud cluster’s API key and secret. You can create a new API key or use an existing one from the API keys tab under Data integration.
- Input these fields into the Kafka integration creation form and save your integration.
For more information, please refer to Rockset's Kafka documentation.
Updated 5 months ago