Gimlet Labs Raises $300M with Arm and Microsoft Backing for Multi-Silicon Inference Orchestration

Gimlet Labs, a company that develops software for multi-silicon inference orchestration, has raised $300 million at a valuation of approximately $3 billion. The funding round was led by Andreessen Horowitz and included new backers Arm and Microsoft's venture arm M12.

The company's software layer is designed to make accelerator choice irrelevant, allowing AI workloads to run across different architectures rather than being bound to a single vendor's chips. This move has significant implications for the AI stack competition and the negotiating position of large inference buyers.

Arm and Microsoft's M12 have strategic interests in this outcome, as it would reduce their dependence on NVIDIA's inference lock-in. Arm's business is based on its compute-architecture licensees' designs, while Microsoft has built Maia custom silicon for Azure and wants to reduce its reliance on NVIDIA.