Rockset Unveils Real-Time SQL Analytics for Raw Events from Apache Kafka
September 30, 2019

Rockset announced the capability to analyze raw events from Apache Kafka in real time.

Kafka, backed by Confluent, is one of the most popular distributed streaming platforms and capable of handling trillions of events a day. Rockset takes an entirely new approach to ingesting, analyzing and serving data so that developers and business stakeholders can run powerful SQL analytics, including joins, on raw event data from Kafka. With this release, Rockset is also announcing a partnership with Confluent, with Rockset’s Kafka Connect Plugin listed as a Verified Gold Connector in Confluent Hub.

Increasingly, businesses are capturing real-time data to drive intelligent actions on the fly. However, traditional databases are not built to handle semi-structured data, making it difficult to operationalize event data like this in real time. In an effort to solve this issue and unlock analytics, considerable data engineering effort goes into building complex data pipelines that schematize and load NoSQL data from Kafka event streams into SQL-based systems. These pipelines are difficult to build, expensive to maintain and hours behind in terms of insights into events - making “real-time” operational analytics on event data next to impossible.

Rockset complements Kafka’s KSQL stream processing capabilities by serving as the “sink” that ingests the processed stream. With Rockset, new event data from Kafka is automatically represented as a dynamic SQL table and available for querying in seconds. Rockset uses Converged Indexing™ and a Distributed SQL Processing Engine under the hood to enable customers to filter, aggregate and join across different datasets from different sources in milliseconds, without upfront schema definitions.

“When you embrace modern real-time technologies like Kafka, you discover that NoSQL databases do not support the type of powerful analytics you need, and that’s when you turn to SQL databases. But it will take you hours to extract-transform-load these events into a traditional SQL database and that is just not fast enough for real-time use cases,” said Venkat Venkataramani, co-founder and CEO of Rockset. “Our goal is to give Kafka users the speed and simplicity they need for deriving maximum value from their event streams in seconds.”

With this release, Rockset supports the ability to:

- Visualize event data in leading real-time SQL dashboards with JDBC support, including Tableau, Apache Superset, Redash and Grafana.

- Create developer APIs for building microservices and applications for the Internet of Things (IoT), e-commerce, operational monitoring and more.

- Join Kafka event streams with business data in Amazon DynamoDB, Amazon Kinesis, Amazon S3, Google Cloud Storage and more.

Share this

Industry News

August 08, 2022

Contrast Security announced that software composition analysis (SCA) is now available for free in CodeSec.

CodeSec offers free application security testing and SCA in a single, developer-friendly interface.

The new SCA feature will enable developers to easily identify vulnerable third-party libraries quickly and accurately, getting secure code moving in minutes.

August 08, 2022

CloudBees announced Anuj Kapur as President and CEO.

August 08, 2022

ShiftLeft named Stuart McClure as CEO.

August 04, 2022

Cribl announced a new partnership with SentinelOne. The partnership enables SentinelOne customers to leverage Cribl's observability product suite to streamline cybersecurity triage, optimize data collection, and provide security teams control of their data.

August 04, 2022

Seemplicity partnered with Checkmarx. The partnership will see the Checkmarx One Platform integrated within Seemplicity's Productivity Platform, allowing joint customers to simplify the entire find-to-fix lifecycle and ultimately accelerate the time to remediation of vulnerabilities found throughout the software development lifecycle (SDLC).

August 04, 2022

Rafay Systems announced new capabilities that empower enterprise platform teams to provide developer self-service for faster application deployments with the necessary guardrails enterprises require.

August 03, 2022

Armory announced the availability of its CD Self-Hosted and Managed 2.28 product release.

August 03, 2022

mabl announced the release of enhanced branching capabilities that enable software development teams to easily create test branches, compare different versions of tests, and resolve conflicts in parallel with development and at the rapid pace of CI/CD.

August 03, 2022

Appdome announced the immediate availability of ThreatScope, a Mobile Security Operations Center (SOC) that's fully integrated inside the Appdome DevSecOps build system.

August 02, 2022

Traceable AI announced the addition of extended Berkeley Packet Filter (eBPF) data to its platform.

August 02, 2022

Harness announced the general availability of Harness Security Testing Orchestration (STO).

August 02, 2022

LambdaTest announced the availability of HyperExecute, a lightning-quick intelligent test orchestration platform, in the Microsoft Azure Marketplace, an online store providing applications and services for use on Azure.

August 01, 2022

Retool announced major updates to its free plan for developers, which now allows teams of up to five users to build unlimited apps.

August 01, 2022

Hazelcast announced the beta release of a new serverless offering under its Viridian cloud portfolio.

Hazelcast Viridian Serverless enables companies to take immediate action on real-time data by speeding app development, simplifying provisioning, and enabling flexible and robust integration of real-time data into applications.

August 01, 2022

Exadel announced the recent acquisition of software engineering company Motion Software, which specializes in blockchain, AI, analytics, healthcare, and eLearning, and is the creator of a remote work platform that enables tech companies to engage with top digital talent worldwide.