Documentation
Llama Protections
Llama Protections
Llama Protections
LLAMA 3.1 8B
*All results are self-reported and not identifiably repeatable. Generally, expected individual results will differ.
Smartly is an AI-powered advertising technology company that manages nearly five billion dollars in ad spending for more than 700 brands worldwide. Its platform seamlessly integrates the capabilities of media, creative and intelligence to reach and engage consumers and learn what performs best. Providing excellent customer service and technical support is a core Smartly value and competitive advantage in the marketplace.
The Smartly Support Operations team works behind the scenes to provide world-class technical and customer support. In addition to serving customers, the team managed support processes and communications, including manually creating tickets and composing resolution messages. As the Smartly platform grew, support processes became unmanageable, driving the team to look for ways to reduce workloads and save time with AI.
After testing several competing models for the application, Smartly chose open-source Llama, which showed superior performance, flexibility and ease of integration.
Using Llama 3.1 8B, the team created an agent capable of populating multiple ticketing platforms, retrieving engineering and support notes and then summarizing complex technical issues. Thanks to Llama’s nuanced natural language understanding, the application could also generate customer resolution messages that maintained a professional, on-brand tone while clearly explaining technical topics.
The Smartly agent ingests customer issues and generates trouble tickets automatically.
Llama 3.1 8B required no training or fine-tuning. The team delivered the quality responses they needed using basic prompt engineering and few-shot learning. The prompt template and context provided clear instructions, including formatting examples (such as ticket titles and descriptions), subject matter context and writing style.
Smartly deployed the solution on their private, on-premises Kubernetes environment. Deploying locally kept them in complete control of their data and their customers’ information. The model and prompt template integrated seamlessly with Smartly’s existing platform, so other applications could easily access AI services.
Smartly used Llama in a private, local deployment that automates ticketing and resolution messages.
By taking on repetitive, meticulous tasks, the Llama-powered AI agents have fully automated support ticket creation, giving the support team time back to help customers one-on-one. Customer satisfaction scores for Smartly technical support are up, and support agents are happier.
• 80% less time to create support tickets
• 50% less time to draft customer resolution messages
Erik Karsten, Smartly DevOps Engineer
Stay up-to-date
Subscribe to our newsletter to keep up with the latest Llama updates, releases and more.
