First-of-its-kind telecom AI deployment Telecommunications organizations are increasingly looking to AI to help teams navigate highly specialized domains, but generic models often lack the industry-specific knowledge needed to understand telecom networks, standards, and operations. To address that gap, AT&T created their Open Telco (OTel) models, the next generation of telecom-focused AI designed to bring deeper telecommunications expertise into AI systems.
Building OTel2. 0 required more than training a large language model, it reflected a broader issue many organizations face: how to build domain-specific AI systems at scale while balancing cost, performance, and operational complexity. Cost management quickly became a key consideration.
To continue advancing telecom-focused AI, AT&T needed a platform capable of supporting OTel2. 0 development at an entirely new scale. Where teams previously had to own and manage deployments, infrastructure, and the associated operational overhead, Foundry Managed Compute provided a more streamlined way to access dedicated graphics processing unit (GPU) capacity.
This transformation requires more than powerful models; it requires the ability to scale without compromising cost, flexibility, or performance. Learn how OTel2. 0 scales telecom AI Using Microsoft Foundry Managed Compute , AT&T was able to experiment across multiple open models, optimize workloads across different GPU architectures, and process massive volumes of telecom data all within a unified platform.
The result was an AI development environment capable of supporting trillions of tokens while giving teams the flexibility to iterate, optimize, and innovate faster. Model choice meets infrastructure flexibility Building OTel2. 0 required flexibility across both models and infrastructure.
Rather than standardizing on a single model, AT&T adopted a multi open-model strategy. Open models were central to AT&T’s approach because they provided the flexibility to work with approved telecom data, tailor the workflow for domain-specific model development, and support large-scale experimentation with greater control over cost and deployment strategy. Through Microsoft Foundry , the team deployed several models from the Hugging Face collection, including Phi-4 , OSS-120B, and Gemma-4, to support different stages of development, from synthetic data generation and data preparation to reasoning-intensive workloads and broader model development efforts.
Phi-4 played a significant role in this process, processing more than 700 billion tokens a month as part of the broader data preparation and training workflow for OTel2. 0. Every company in the world needs to build its own AI, and that is only possible with open models and open source.
AT&T is championing this vision, building on open models like Phi-4 and Gemma, and giving OTel back to the community as a telecom AI foundation others can build upon. Microsoft Foundry makes this practical at scale, bringing the latest open models from the Hugging Face collection together with AMD and NVIDIA GPUs in one place, so teams can pick the right model and the right hardware, then deploy in hours instead of weeks.
—Jeff Boudier, Vice President of Product, Hugging Face Developing OTel2. 0 also required infrastructure capable of operating at telecom scale. AT&T used approximately 530 GPUs through Microsoft Foundry Managed Compute spanning multiple GPU architectures including 430 AMD Instinct™ MI300X GPUs .
This heterogenous approach gave AT&T more flexibility in how models were deployed and optimized as requirements evolved. Model Example workload Phi-4 Around 700B tokens a month for data preparation and synthetic data generation OSS 120B Higher-reasoning workloads Gemma 4 OTel2. 0 development workflows Table 1: Explains what open source models were used and how This flexibility illustrates a broader trend across AI development.
Organizations increasingly need platforms that allow them to choose the right model for the job, optimize for cost and performance, and scale workloads without rebuilding operational environments. Microsoft Foundry brings model choice, infrastructure flexibility, governance, and operational scale together in a unified platform that supports those requirements.
Start building with Microsoft Foundry Beyond flexibility and cost, deployment speed is a critical factor for many AI initiatives. As workloads expand and new models are evaluated, the ability to access GPU capacity quickly enables teams to move from experimentation to execution faster without lengthy provisioning cycles. With Foundry Managed Compute, AT&T could deploy and scale models in days rather than waiting weeks for infrastructure to become available, helping accelerate development timelines and maintain momentum across OTel2.
0 development. Optimizing cost without limiting innovation As AI workloads grow, economics become as important as model performance. For AT&T, one of the primary objectives was to lower AI model consumption costs while continuing to drive meaningful business value through AI-powered innovation.
By using open models on Microsoft Foundry Managed Compute , AT&T was able to support large-scale data preparation and model development using a different economic model built around dedicated GPU infrastructure and open-model flexibility. The impact became clear at scale. In support of OTel2.
0, AT&T processed approximately 1T tokens, consisting of raw documents from GSMA supplemented by synthetic data generated. Generating the data using open-source models like Phi-4, served by Microsoft’s Foundry Managed Compute, saved tens of millions of dollars versus using frontier models. This allowed teams to invest in larger-scale experimentation and development while maintaining a focus on business value and operational efficiency.
Metric Value OTel 1. 0 Downloads Over 25M GPUs Used Through Foundry Managed Compute About 530 Tokens Processed for OTel2. 0 About 1T Tokens Trained for OTel2.
Originally published at azure.microsoft.com
