Docker Announces GenAI Stack
October 10, 2023

Docker, together with partners Neo4j, LangChain, and Ollama, announced a new GenAI Stack designed to help developers get a running start with generative AI applications in minutes.

Eliminating the need to search for and cobble together and configure technologies from different sources, the GenAI Stack is pre-configured, ready-to-code, and secure with large language models (LLMs) from Ollama, vector and graph databases from Neo4j, and the LangChain framework. Docker also announced today its first AI-powered product, Docker AI.

“Developers are excited by the possibilities of GenAI, but the rate of change, number of vendors, and wide variation in technology stacks makes it challenging to know where and how to start,” said Docker CEO Scott Johnston. “Today’s announcement eliminates this dilemma by enabling developers to get started quickly and safely using the Docker tools, content, and services they already know and love together with partner technologies on the cutting edge of GenAI app development.”

The GenAI Stack addresses popular GenAI use cases using trusted open source content on Docker Hub. Demoed on stage at DockerCon,the GenAI Stack is among a range of new AI/ML capabilities, content, and partnerships announced by Docker with the aim of helping developers quickly and securely take advantage of the power of AI/ML in their applications. Components include:

- Pre-configured open source LLMs such as Llama 2, Code Llama, Mistral, or private models such as OpenAI’s GPT-3.5 and GPT-4;

- Help from Ollama for developers to get up and running locally with open source LLMs;

- Neo4j as the default database for graph and native vector search that uncovers explicit and implicit patterns and relationships in data, making AI/ML models faster and more accurate, and acting as long-term memory for these models;

- Neo4j knowledge graphs that serve as the knowledge base to ground LLMs for more accurate GenAI predictions and outcomes;

- LangChain orchestration between the LLM, application, and database with vector index, and serving as the framework for developing context-aware reasoning applications powered by LLMs; and

- A series of supporting tools, code templates, how-to’s, and GenAI best practices.

Easy out-of-the-box setup empowers developers with numerous capabilities, such as effortless data loading and vector index population, enabling developers to seamlessly import data, create vector indices, embed questions and answers, and store them within the vector index. Developers can do enhanced querying and result enrichment for applications that can both summarize data and showcase knowledge retrieval through flexible knowledge graphs. They can also generate diverse responses across various formats, such as bulleted lists, chain of thought, GitHub issues, PDFs, poems, and more. In addition, developers can compare results achieved between LLMs on their own, LLMs with vector, and LLMs with vector and knowledge graph integration.

Share this

Industry News

December 19, 2024

Check Point® Software Technologies Ltd. has been recognized as a Leader in the 2024 Gartner® Magic Quadrant™ for Email Security Platforms (ESP).

December 19, 2024

Progress announced its partnership with the American Institute of CPAs (AICPA), the world’s largest member association representing the CPA profession.

December 18, 2024

Kurrent announced $12 million in funding, its rebrand from Event Store and the official launch of Kurrent Enterprise Edition, now commercially available.

December 18, 2024

Blitzy announced the launch of the Blitzy Platform, a category-defining agentic platform that accelerates software development for enterprises by autonomously batch building up to 80% of software applications.

December 17, 2024

Sonata Software launched IntellQA, a Harmoni.AI powered testing automation and acceleration platform designed to transform software delivery for global enterprises.

December 17, 2024

Sonar signed a definitive agreement to acquire Tidelift, a provider of software supply chain security solutions that help organizations manage the risk of open source software.

December 17, 2024

Kindo formally launched its channel partner program.

December 16, 2024

Red Hat announced the latest release of Red Hat Enterprise Linux AI (RHEL AI), Red Hat’s foundation model platform for more seamlessly developing, testing and running generative artificial intelligence (gen AI) models for enterprise applications.

December 16, 2024

Fastly announced the general availability of Fastly AI Accelerator.

December 12, 2024

Amazon Web Services (AWS) announced the launch and general availability of Amazon Q Developer plugins for Datadog and Wiz in the AWS Management Console.

December 12, 2024

vFunction released new capabilities that solve a major microservices headache for development teams – keeping documentation current as systems evolve – and make it simpler to manage and remediate tech debt.

December 11, 2024

CyberArk announced the launch of FuzzyAI, an open-source framework that helps organizations identify and address AI model vulnerabilities, like guardrail bypassing and harmful output generation, in cloud-hosted and in-house AI models.

December 11, 2024

Grid Dynamics announced the launch of its developer portal.

December 10, 2024

LTIMindtree announced a strategic partnership with GitHub.