CircleCI Introduces gen2 GPUs
November 29, 2023

CircleCI implemented a gen2 GPU resource class, leveraging Amazon Elastic Compute Cloud (Amazon EC2) G5 instances, offering the latest generation of NVIDIA GPUs and new images tailored for artificial intelligence/machine learning (AI/ML) workflows.

These under-the-hood enhancements put cost-effective, powerful resources at developers' fingertips to accelerate AI innovation. Additionally, the company launched key new features for teams building Large Language Model (LLM)-powered applications: inbound webhooks, including support for tools like Hugging Face, and an integration with evaluation platform LangSmith. The company also released a CircleCI Orb for Amazon SageMaker to help software teams deploy and monitor ML models at scale.

As organizations race to build, deploy, and manage AI-enabled applications on a commercial scale, they’re grappling with how to get started. With its new inbound webhooks and evaluation platform integrations, CircleCI is redefining what CI/CD tools do to manage the novel complexity that AI/ML introduces so that teams can confidently go from idea to innovation.

CircleCI’s latest features are pivotal in helping teams manage the complexity of developing AI-powered applications by providing a structured, automated pipeline spanning from building and testing to training and monitoring them. Its new inbound webhooks are entirely adaptable to all sources of change, making it the most change-agnostic CI/CD tool on the market. This also marks a necessary departure from a version control-centric approach to now allowing users to trigger pipelines through various sources. This shift is crucial as AI-powered applications live outside the repository, with code, data, and the LLM all interacting to drive novel product experiences for end consumers. Therefore, engineering teams must rethink how they test, release, and retrain their applications.

The custom Hugging Face integration is a new trigger to kick off pipelines. Developers can now run automated workflows any time a model on Hugging Face changes, so engineering teams can be confident that their application continues to behave as expected. The LangSmith integration is the first of many evaluation platforms to be supported on CircleCI, enabling robust testing for non-deterministic outcomes. Testing AI-enabled applications is new territory for professional software teams, and these new capabilities from CircleCI will dramatically up-level developer confidence when building and validating LLM-powered software.

“Software teams are building the next wave of AI-powered applications that solve specific customer pain points,” said Rob Zuber, CTO at CircleCI. “While many teams find it difficult to get started, at the end of the day, we’re still building software. You already have 95% of the tools needed to do it. By supporting AI product builders with CircleCI’s comprehensive CI/CD tooling, engineering teams can confidently build upon years of key learnings while also addressing the novel changes AI introduces.”

CircleCI also introduced its new Orb for Amazon SageMaker to help teams using Amazon SageMaker ship their model to production. The Orb enables basic deployment to Amazon SageMaker, monitors deployments for problems, and quickly rolls back endpoints should something go awry. It also executes different deployment strategies, namely canary and blue/green style deployments.

Share this

Industry News

December 19, 2024

Check Point® Software Technologies Ltd. has been recognized as a Leader in the 2024 Gartner® Magic Quadrant™ for Email Security Platforms (ESP).

December 19, 2024

Progress announced its partnership with the American Institute of CPAs (AICPA), the world’s largest member association representing the CPA profession.

December 18, 2024

Kurrent announced $12 million in funding, its rebrand from Event Store and the official launch of Kurrent Enterprise Edition, now commercially available.

December 18, 2024

Blitzy announced the launch of the Blitzy Platform, a category-defining agentic platform that accelerates software development for enterprises by autonomously batch building up to 80% of software applications.

December 17, 2024

Sonata Software launched IntellQA, a Harmoni.AI powered testing automation and acceleration platform designed to transform software delivery for global enterprises.

December 17, 2024

Sonar signed a definitive agreement to acquire Tidelift, a provider of software supply chain security solutions that help organizations manage the risk of open source software.

December 17, 2024

Kindo formally launched its channel partner program.

December 16, 2024

Red Hat announced the latest release of Red Hat Enterprise Linux AI (RHEL AI), Red Hat’s foundation model platform for more seamlessly developing, testing and running generative artificial intelligence (gen AI) models for enterprise applications.

December 16, 2024

Fastly announced the general availability of Fastly AI Accelerator.

December 12, 2024

Amazon Web Services (AWS) announced the launch and general availability of Amazon Q Developer plugins for Datadog and Wiz in the AWS Management Console.

December 12, 2024

vFunction released new capabilities that solve a major microservices headache for development teams – keeping documentation current as systems evolve – and make it simpler to manage and remediate tech debt.

December 11, 2024

CyberArk announced the launch of FuzzyAI, an open-source framework that helps organizations identify and address AI model vulnerabilities, like guardrail bypassing and harmful output generation, in cloud-hosted and in-house AI models.

December 11, 2024

Grid Dynamics announced the launch of its developer portal.

December 10, 2024

LTIMindtree announced a strategic partnership with GitHub.