The Future Is Smart: Cloud Native + AI
April 21, 2022

Tobi Knaup
D2iQ

Leading organizations around the world are adopting cloud native technologies to build next- generation products and achieve the agility that they need to stay ahead of their competition. Although cloud native and Kubernetes are very disruptive technologies, there is another technology that is probably the most disruptive technology of our generation — artificial intelligence (AI) and its subset, machine learning (ML).

We already see AI in digital assistants like Siri and Alexa, chatbots on websites and recommendation engines on retail sites. In the near future, AI will be embedded in almost all the products that surround us, from self-driving cars to next-generation medical devices.

Organizations that are building cloud-native applications today will need to evolve their capabilities to manage AI workloads because the next generation of cloud-native applications will have AI at their core. We call those "smart cloud-native" applications because they have AI built in.

Kubernetes a Perfect Match for AI

Kubernetes has become the enterprise cloud-native platform of choice and is a natural fit for running AI and ML workloads for a number of reasons:

■ Kubernetes can easily scale to meet the resource needs of AI/ML training and production workloads.

■ Kubernetes enables sharing of expensive and limited resources like graphics processing units between developers to speed up development and lower costs.

■ Kubernetes provides a layer of abstraction that enables data scientists to access the services they require without worrying about the details of the underlying infrastructure.

■ Kubernetes gives organizations the agility to deploy and manage AI/ML operations across public clouds, private clouds, on-premise, and secure air-gap locations, and to easily change and migrate deployments without incurring excess cost. A smart cloud-native business application consists of a number of components, including microservices, data services, and AI/ML pipelines. Kubernetes provides a single consistent platform on which to run all workloads, rather than in silos, which simplifies deployment and management and minimizes cost.

■ As an open-source cloud-native platform, Kubernetes enables organizations to apply cloud-native best practices and take advantage of continuous open-source innovation. Many of the modern AI/ML technologies are open source as well and come with native Kubernetes integration.

Smart Cloud-Native Challenges

Organizations that want to build smart cloud-native apps must also learn how to deploy those workloads in the cloud, in data centers, and at the edge. AI as a field is relatively young, so the best practices for putting AI applications into production are few and far between. The good news is that many of the best practices that exist around putting cloud native applications into production transfer easily to AI applications.

However, AI-driven smart cloud-native applications pose additional challenges for operators once in production because AI and ML pipelines are complex workloads made up of many components that run elastically and need to be updated frequently. This means that organizations need to start building operational capabilities around those AI workloads.

Cloud-native technologies have been around for about a decade, and enterprises are increasingly moving their most mission-critical workloads to cloud-native platforms like Kubernetes. This creates a slew of new challenges for organizations:

■ First, because those workloads are so mission-critical, it puts a much higher burden on operations teams to keep those workloads running 24/7 while making sure they are resilient, can scale, and are secure.

■ Second, those workloads tend to include more sophisticated technologies like data workloads, AI workloads, and machine learning workloads, which have their own operational challenges.

■ Third, modern cloud-native applications tend to run on a broad range of infrastructures, from a cloud provider or multiple cloud providers to data centers and edge deployments.

A Firm and Future-Proof Foundation

Organizations that want to adopt cloud-native technology must figure out how to address these challenges. To do this they need to change their workflows and culture to take full advantage of cloud native’s potential. They must learn how to build applications in a cloud-native way and to adopt the technologies that enable them to put those applications into production in a resilient and repeatable way.

The speed of innovation in the cloud-native ecosystem is unparalleled. Organizations that can keep pace with that innovation and learn how to adopt cloud-native and AI technologies will be able to build highly differentiated products that can put them ahead of their competition. They will be able to build their next-generation products much faster and in a more agile way, and they will be able to leverage AI to build smarter products.

Tobi Knaup is Co-Founder and CEO of D2iQ
Share this

Industry News

June 01, 2023

Couchbase announced a broad range of enhancements to its Database-as-a-Service Couchbase Capella™.

June 01, 2023

Remote.It release of Docker Network Jumpbox to enable zero trust container access for Remote.It users.

June 01, 2023

Platformatic launched a suite of new enterprise-grade products that can be self-hosted on-prem, in a private cloud, or on Platformatic’s managed cloud service:

May 31, 2023

Parasoft announced the release of C/C++test 2023.1 with complete support of MISRA C 2023 and MISRA C 2012 with Amendment 4.

May 31, 2023

Rezilion announced the release of its new Smart Fix feature in the Rezilion platform, which offers critical guidance so users can understand the most strategic, not just the most recent, upgrade to fix vulnerable components.

May 31, 2023

Zesty has partnered with skyPurple Cloud, the public cloud operations specialists for enterprises.

With Zesty, skyPurple Cloud's customers have already reduced their average monthly EC2 Linux On-Demand costs by 44% on AWS.

May 30, 2023

Red Hat announced Red Hat Trusted Software Supply Chain, a solution that enhances resilience to software supply chain vulnerabilities.

May 30, 2023

Mirantis announced Lens Control Center, to enable large businesses to centrally manage Lens Pro deployments by standardizing configurations, consolidating billing, and enabling control over outbound network connections for greater security.

May 25, 2023

Red Hat announced new capabilities for Red Hat OpenShift AI.

May 25, 2023

Pipedrive announced the launch of Developer Hub, a centralized online app development platform for technology partners and developers.

May 25, 2023

Delinea announced the latest version of Cloud Suite, part of its Server PAM solution, which provides privileged access to and authorization for servers.

May 24, 2023

Red Hat announced Red Hat Service Interconnect, simplifying application connectivity and security across platforms, clusters and clouds.

May 24, 2023

Teleport announced Teleport 13, the latest version of its Teleport Access Platform to enhance security and reduce operational overhead for DevOps teams responsible for securing cloud infrastructure.

May 24, 2023

Kasten by Veeam announced the release of its new Kasten K10 V6.0 Kubernetes data protection platform.

May 23, 2023

Red Hat announced Red Hat Developer Hub, an enterprise-grade, unified and open portal designed to streamline the development process through a supported and opinionated framework.