Microsoft unveils 2 custom-designed chips to drive AI innovations

by IANS |



San Francisco, Nov 16 (IANS) Heating up the AI race, Microsoft has unveiled two in-house, custom-designed chips and integrated systems that can be used to train large language models.


The Microsoft Azure Maia AI Accelerator is optimised for artificial intelligence (AI) tasks and generative AI, and the Microsoft Azure Cobalt CPU, an Arm-based processor, is tailored to run general purpose compute workloads on the Microsoft Cloud.


The chips will start to roll out early next year to Microsoft’s data centres, initially powering the company’s services such as Microsoft Copilot or Azure OpenAI Service,” the company said at its ‘Microsoft Ignite’ event late on Wednesday. 


“Microsoft is building the infrastructure to support AI innovation, and we are reimagining every aspect of our data centres to meet the needs of our customers,” said Scott Guthrie, executive vice president of Microsoft’s Cloud + AI Group. 


Microsoft sees the addition of homegrown chips as a way to ensure every element is tailored for Microsoft cloud and AI workloads.


The end goal is an Azure hardware system that offers maximum flexibility and can also be optimized for power, performance, sustainability or cost, said Rani Borkar, corporate vice president for Azure Hardware Systems and Infrastructure (AHSI).


“Software is our core strength, but frankly, we are a systems company. At Microsoft we are co-designing and optimising hardware and software together so that one plus one is greater than two,” Borkar said. 


“We have visibility into the entire stack, and silicon is just one of the ingredients,” she added.


At Microsoft Ignite, the company also announced the general availability of one of those key ingredients: Azure Boost, a system that makes storage and networking faster by taking those processes off the host servers onto purpose-built hardware and software.


To complement its custom silicon efforts, Microsoft also announced it is expanding industry partnerships to provide more infrastructure options for customers. 


By adding first party silicon to a growing ecosystem of chips and hardware from industry partners, Microsoft will be able to offer more choice in price and performance for its customers, Borkar said.


Additionally, OpenAI has provided feedback on Azure Maia and Microsoft’s deep insights into how OpenAI’s workloads run on infrastructure tailored for its large language models is helping inform future Microsoft designs.


“Since first partnering with Microsoft, we’ve collaborated to co-design Azure’s AI infrastructure at every layer for our models and unprecedented training needs,” said Sam Altman, CEO of OpenAI.


“Azure’s end-to-end AI architecture, now optimized down to the silicon with Maia, paves the way for training more capable models and making those models cheaper for our customers,” Altman added.



Latest News
BJP & JD-S making false accusations against me in MUDA case: Siddaramaiah Tue, Oct 22, 2024, 04:36 PM
Himachal Cabinet's nod to involve private players to expand EV charging stations Tue, Oct 22, 2024, 04:16 PM
Mongolia reports outbreak of contagious caprine pleuropneumonia Tue, Oct 22, 2024, 04:12 PM
Tamil parents should choose beautiful Tamil names for their children: Udhayanidhi Stalin Tue, Oct 22, 2024, 04:08 PM
Will win all seven seats in Rajasthan: BJP state chief on bypolls Tue, Oct 22, 2024, 03:59 PM
Akansha Ranjan Kapoor opens up about her role in Alia Bhatt's ‘Jigra’ Tue, Oct 22, 2024, 03:58 PM
Muthoot FinCorp ONE is now all-in-one financial suite Tue, Oct 22, 2024, 03:43 PM
Caste census report must be discussed before making it public: K’taka Home Minister Tue, Oct 22, 2024, 03:43 PM
People should become Hindu if they want to live in Bihar's Araria: BJP MP Tue, Oct 22, 2024, 03:39 PM
SC extends interim anticipatory bail of Malayalam actor Siddique in rape case Tue, Oct 22, 2024, 03:22 PM
India gearing up for 2nd white revolution, says HM Shah at NDDB diamond jubilee celebrations Tue, Oct 22, 2024, 03:20 PM
Paytm reports Rs 930 crore net profit after one-time gain, stock down over 4 pc Tue, Oct 22, 2024, 02:57 PM
Egypt urges safety of maritime navigation in Red Sea Tue, Oct 22, 2024, 02:52 PM
Venezuela confirms arrest of former Oil Minister for 'serious crimes' Tue, Oct 22, 2024, 02:44 PM
I find it hard to see anyone playing as well as Joe Root: Cook Tue, Oct 22, 2024, 02:38 PM