DEVOPSdigest

StreamSets announced a partnership with Databricks to empower data teams with rapid, no-code development using Apache Spark and Delta Lake for modern analytics and data science at scale.

“Delta Lake builds on our history of innovation by providing an open-source storage layer for data lakes with support for transactions and massive scale,” said Pankaj Dugar, VP of ISV and Technology Partners, Databricks. “We are excited to partner with StreamSets and make Delta Lake and Apache Spark even more accessible through their DataOps platform.”

The joint solution of the StreamSets DataOps Platform and Delta Lake on Databricks helps organizations apply a DataOps mentality to their critical data science and advanced analytics projects.

Specifically, the StreamSets DataOps Platform makes it easy to ingest, integrate and monitor data moving into Databricks by mitigating data drift and operationalizing the process through its full life cycle. As a result, the Databricks customer has more operational control, greater visibility and deeper insights into data — all within a single, highly integrated solution.

Further, given StreamSets Transformer’s unique, Spark-native approach to data processing, even Spark non-experts can benefit from the power of Databricks. With the combined approach, the two companies are enabling more data to be delivered faster to drive analytics.

“This partnership with Databricks is key to expanding our solution to new sets of data and AI applications, as we’re forming an alliance with a company whose reputation as an innovator is unmatched,” said Jobi George, GM of Cloud Business at StreamSets. “Together, StreamSets and Databricks are bringing the full power of Spark and the Databricks platform to a new spectrum of users, easing the drive toward digital transformation.”

The joint solution is available immediately.