Llama Stack

A streamlined developer experience enabling seamless AI application development.

Build Once, Deploy Anywhere

What is Llama Stack?

Llama Stack is a comprehensive system that provides a uniform set of tools for building, scaling, and deploying generative AI applications, enabling developers to create, integrate, and orchestrate multiple AI services and capabilities into an adaptable setup.

Llama Stack codifies best practices across the Llama ecosystem. With the release of the Llama 4 herd of models, you can use Llama Stack to build innovative, personalized applications with the most accessible and scalable generation of Llama.

Learn more

Overview Docs Experience Llama Protections Resources

Overview

Llama Stack Provides

Flexible Deployment Options

Consistent Application Behavior

Robust Distribution Partner Network

Standardized APIs

Provides consistent interfaces for building and deploying AI applications.

Flexible Deployment Options

Supports local development, cloud, on-premises, and mobile environments.

Pre-built Tools

Offers tools for inference, safety monitoring, and memory management.

Scalable Infrastructure

Facilitates easy scaling of AI applications.

Strong Partner Network

Collaborates with various providers to offer specialized services.

Telemetry and Monitoring

Includes built-in support for tracing requests, evaluating model outputs.

Our approach

Docs

Need help getting started building on Llama Stack? Check out our documentation.

Learn more

Cookbooks

The tools and resources you need to build with Llama Stack. Access prepackaged, verified provider distributions and mobile SDKs with iOS and Android support.

Learn more

Llama Stack: a streamlined developer experience

Build faster, deploy anywhere and get the most out of the latest Llama models on day 1.

Learn more

For developers

Best practices included

Optimized support for agentic tool calling, safety guardrails, inference and much more, significantly lowering development costs.

Develop in your preferred language

Choose from python, node, kotlin, and swift programming languages to quickly build
your applications.

Choose from python, node, kotlin, and swift programming languages to quickly build your applications.

Develop & deploy anywhere

With a common API, choose any distribution and deploy on-prem, locally hosted, or even on-device at the edge.

For partners & distributors

A standard API

Requires fewer model level changes across versions accelerating time to market for new models and lowering engineering investment.

Interoperability with the ecosystem

Leverage the fast moving Llama ecosystem by building on a common API and incorporate new components faster.

Support for agentic components

Llama Stack releases natively support tool calling, safety guardrails, retrieval augmented generation, an inference loop and other agentic functionality.

For developers

Best practices included

Optimized support for agentic tool calling, safety guardrails, inference and much more, significantly lowering development costs.

Develop in your preferred language

Choose from python, node, kotlin, and swift programming languages to quickly build your applications.

Develop & deploy anywhere

With a common API, choose any distribution and deploy on-prem, locally hosted, or even on-device at the edge.

For Partners & Distributors

A standard API

Requires fewer model level changes across versions accelerating time to market for new models and lowering engineering investment.

Interoperability with the ecosystem

Leverage the fast moving Llama ecosystem by building on a common API and incorporate new components faster.

Support for agentic components

Llama Stack releases natively support tool calling, safety guardrails, retrieval augmented generation, an inference loop and other agentic functionality.