CircleCI Introduces gen2 GPUs
November 29, 2023

CircleCI implemented a gen2 GPU resource class, leveraging Amazon Elastic Compute Cloud (Amazon EC2) G5 instances, offering the latest generation of NVIDIA GPUs and new images tailored for artificial intelligence/machine learning (AI/ML) workflows.

These under-the-hood enhancements put cost-effective, powerful resources at developers' fingertips to accelerate AI innovation. Additionally, the company launched key new features for teams building Large Language Model (LLM)-powered applications: inbound webhooks, including support for tools like Hugging Face, and an integration with evaluation platform LangSmith. The company also released a CircleCI Orb for Amazon SageMaker to help software teams deploy and monitor ML models at scale.

As organizations race to build, deploy, and manage AI-enabled applications on a commercial scale, they’re grappling with how to get started. With its new inbound webhooks and evaluation platform integrations, CircleCI is redefining what CI/CD tools do to manage the novel complexity that AI/ML introduces so that teams can confidently go from idea to innovation.

CircleCI’s latest features are pivotal in helping teams manage the complexity of developing AI-powered applications by providing a structured, automated pipeline spanning from building and testing to training and monitoring them. Its new inbound webhooks are entirely adaptable to all sources of change, making it the most change-agnostic CI/CD tool on the market. This also marks a necessary departure from a version control-centric approach to now allowing users to trigger pipelines through various sources. This shift is crucial as AI-powered applications live outside the repository, with code, data, and the LLM all interacting to drive novel product experiences for end consumers. Therefore, engineering teams must rethink how they test, release, and retrain their applications.

The custom Hugging Face integration is a new trigger to kick off pipelines. Developers can now run automated workflows any time a model on Hugging Face changes, so engineering teams can be confident that their application continues to behave as expected. The LangSmith integration is the first of many evaluation platforms to be supported on CircleCI, enabling robust testing for non-deterministic outcomes. Testing AI-enabled applications is new territory for professional software teams, and these new capabilities from CircleCI will dramatically up-level developer confidence when building and validating LLM-powered software.

“Software teams are building the next wave of AI-powered applications that solve specific customer pain points,” said Rob Zuber, CTO at CircleCI. “While many teams find it difficult to get started, at the end of the day, we’re still building software. You already have 95% of the tools needed to do it. By supporting AI product builders with CircleCI’s comprehensive CI/CD tooling, engineering teams can confidently build upon years of key learnings while also addressing the novel changes AI introduces.”

CircleCI also introduced its new Orb for Amazon SageMaker to help teams using Amazon SageMaker ship their model to production. The Orb enables basic deployment to Amazon SageMaker, monitors deployments for problems, and quickly rolls back endpoints should something go awry. It also executes different deployment strategies, namely canary and blue/green style deployments.

Share this

Industry News

February 22, 2024

Check Point® Software Technologies Ltd. introduces Check Point Quantum Force series: an innovative lineup of ten high-performance firewalls designed to meet and exceed the stringent security demands of enterprise data centers, network perimeters, campuses, and businesses of all dimensions.

February 22, 2024

Tabnine announced that Tabnine Chat — the enterprise-grade, code-centric chat application that allows developers to interact with Tabnine AI models using natural language — is now available to all users.

February 22, 2024

Avaamo released Avaamo LLaMB™, a new low-code framework for building generative AI applications in the enterprise safely, securely, and fast.

February 21, 2024

CAST announced the winter release of CAST Imaging, an imaging system for software applications, with significant user experience (UX) enhancements and new features designed to simplify and accelerate processes for engineers who develop, maintain, modernize, complex software applications.

February 21, 2024

Pulumi now offers native ways to manage Pinecone indexes, including its latest serverless indexes.

February 21, 2024

Orkes, whose platform offers the fastest way to scale distributed systems, has raised $20 million in new funding.

February 20, 2024

JFrog and Carahsoft Technology announced a partnership that empowers U.S. Government organizations to safeguard their software supply chains with automated DevSecOps workflows to secure software services consumed by citizens.

February 20, 2024

Multiplayer, a collaborative tool for teams that work on system design and distributed software, announced its public beta.

February 20, 2024

DataStax announced its out-of-the-box retrieval augmented generation (RAG) solution, RAGStack, is now generally available powered by LlamaIndex as an open source framework, in addition to LangChain.

February 20, 2024

UiPath announced new features in its platform designed to enable developers to build, test, and accelerate implementation of automations.

February 15, 2024

Kong announced a suite of open-source AI plugins for Kong Gateway 3.6 that can turn any Kong Gateway deployment into an AI Gateway, offering unprecedented support for multi-Language Learning Models (LLMs) integration.

February 15, 2024

ngrok unveiled early access to its API gateway-as-a-service.

February 15, 2024

Tabnine announced a strategic partnership with DigitalOcean.

February 15, 2024

Salt Security announced that the Salt Security API Protection Platform is now available for purchase in the CrowdStrike Marketplace, a one-stop destination for the world-class ecosystem of CrowdStrike compatible security products.

February 14, 2024

Perforce Software signed a definitive agreement to acquire Delphix.