Llama Stack
A streamlined developer experience enabling seamless AI application development. Build once, deploy anywhere.Cookbooks
Capabilities
Llama Stack SDKs have differentiating features and capabilities that empower developers to create AI applications with ease from RAG to innovative applications tailored for mobile use cases.
RAG
Easily add RAG to your apps with our mobile framework and customize tailored models with user-specific context. Available in local and remote inference modes. Check out more on GitHub.
Multi-image inference
Utilize multi-image inference to build experiences that process and analyze multiple images at once. Available in remote inference mode only. Learn more on GitHub.
Custom tool calling
Mobile framework supports unique tool calls like creating a calendar event all within your device’s app. Available in local and remote inference mode. Learn more on GitHub.
Llama Stack: a streamlined developer experience
Build faster, deploy anywhere and get the most out of the latest Llama models on day one.
Learn more
Our partner ecosystem
Llama Stack provides
Standardized APIs
Provides consistent interfaces for building and deploying AI applications.Flexible deployment options
Supports local development, cloud, on-premises, and mobile environments.Pre-built tools
Your data is not used for advertising or ad targeting.Scalable infrastructure
Facilitates easy scaling of AI applications.Strong partner network
Collaborates with various providers to offer specialized services.Telemetry and monitoring
Includes built-in support for tracing requests, evaluating model outputs.SAFETY