Meta is moving harder into custom AI chips as the fight to cut reliance on Nvidia gets more serious across big tech.
The company said it began the Meta Training and Inference Accelerator, or MTIA, in 2023, and it is now preparing four new chip generations over the next two years.
Per Meta, these chips are allegedly being built for ranking, recommendations, and GenAI jobs across Meta’s products.
The company also said it is not betting on one supplier or one piece of hardware. Meta plans to keep buying silicon from several industry players while keeping MTIA at the center of its own AI infrastructure plan.
In the company’s words, it is taking a “portfolio approach” as its AI workloads grow and change. That means mixing outside chips with in-house silicon instead of handing the whole stack to one vendor.
Meta rolls out four MTIA chip generations on a faster schedule
Meta said it already uses hundreds of thousands of MTIA chips for inference work tied to both organic content and ads across its apps.
The chips are built for the company’s own jobs, not for general use. That matters because Meta said the hardware is part of a custom full-stack solution, which gives it a more tuned system for the work it runs every day.
The company said that setup delivers better compute efficiency for its specific use cases and lowers cost compared with broader-purpose chips.
The next phase is a larger rollout. Meta said it is building MTIA 300, 400, 450, and 500, with each version bringing gains in compute, memory bandwidth, and efficiency. MTIA 300 is already in production and will handle ranking and recommendations training.
MTIA 400, 450, and 500 can run all workloads, but Meta said those chips will mainly be used for GenAI inference production in the near term and through 2027.
The company also said the silicon is modular, which lets new chips slide into existing rack system infrastructure. That cuts the wait between design and deployment.
On release speed, Meta said the industry usually launches a new AI chip every one to two years, but it now has the capacity to release its own chips every six months or less by reusing modular designs.
Meta builds its AI chip strategy around inference and open standards
The company said its MTIA strategy rests on three parts: fast iteration, an inference-first design, and easy adoption through common standards.
On the first point, Meta said the shorter release cycle helps it adjust faster as AI techniques change, bring in newer hardware technology, and reduce the cost of developing and deploying fresh chip versions.
On the second point, Meta drew a line between its plan and the usual market model. The company said most mainstream chips are built first for large GenAI pre-training jobs and then used for other work, often at a worse cost level.
Meta said it is doing the opposite. MTIA 450 and 500 are being tuned first for GenAI inference, then used for ranking, recommendations training and inference, and GenAI training when needed.
The company also said MTIA is built from the start on standard tools and systems, including PyTorch, vLLM, Triton, and the Open Compute Project. Its system and rack designs also follow OCP standards for use in data centers.
Meta added that no single chip can cover every demand it has, which is why it plans to deploy different chips for different workloads while pushing toward what it called “personal superintelligence for all.”
Source: https://www.cryptopolitan.com/meta-launches-internal-ai-chips/
