Meta has announced its foray into the world of custom chips dedicated to running AI models. The company’s newly unveiled Meta Training and Inference Accelerator (MTIA) chip is poised to become a crucial asset in Meta’s efforts to compete with other tech giants investing heavily in AI research and development.
The MTIA chips belong to a family of in-house custom accelerator chips specifically designed for inference workloads. Meta claims that these chips offer superior computational power and efficiency compared to traditional CPUs, and they are tailored to meet the internal workloads of the company. Meta asserts that the MTIA v1 chips will deliver enhanced performance, reduced latency, and improved efficiency for each workload they handle.
In addition to the MTIA chips, Meta is introducing the Meta Scalable Video Processor (MSVP) as an application-specific integrated circuit (ASIC) dedicated to video transcoding. This specialized chip is designed to support both high-quality transcoding required for video-on-demand (VOD) services and low-latency, fast processing for live streaming applications. Moreover, Meta envisions the MSVP playing a pivotal role in the future by enabling AI-driven content generation and facilitating the integration of augmented reality/virtual reality (AR/VR) specific content into Meta apps.
Furthermore, Meta is actively developing a next-generation data centre design that is optimized for AI workloads, offering faster and more cost-effective deployment. The company is also proud to highlight its existing AI supercomputer, the Research SuperCluster (RSC), which is touted as one of the world’s fastest AI supercomputers.
As the demand for AI technologies continues to grow, having the right infrastructure has become a critical factor in determining a company’s competitiveness. Meta’s strategic move to develop custom chips, along with their advancements in data centre design and the Research SuperCluster, underscores their commitment to meeting the rising demand for AI capabilities. With these developments, Meta aims to strengthen its position in the AI landscape and ensure it remains at the forefront of technological innovation.