IBM Teams with Together AI on $240M Deal for Large-Scale NVIDIA B300 AI Inference Cluster

IBM has partnered with Together AI to deploy a large-scale artificial intelligence (AI) inference cluster on IBM Cloud, using NVIDIA HGX B300 systems. The multi-year $240 million deal aims to provide open-source model inference for enterprise customers.

The cluster is expected to become available in the first quarter of 2027 and will be built with NVIDIA HGX B300 systems and Spectrum-X Ethernet networking. This infrastructure is designed to deliver up to 30 times more AI factory output than prior generations, according to NVIDIA.

Together AI plans to use this cluster to improve inference performance and token economics as enterprises move larger AI workloads into production. The company has already raised an $800 million Series C round at a valuation of $8.3 billion and serves approximately 400 trillion tokens per month through its open-source AI platform.

Vipul Ved Prakash, CEO of Together AI, stated that 'enterprises want the performance of the best frontier models without the closed-model price tag.' He added that the cluster will allow them to bring production-grade inference to more companies faster and make open-source AI the obvious choice for enterprises.