It seems Digital Ocean has rolled out Nvidia’s HGX H200 gpu cards for bare metal hosting on its cloud platform. The service is offered for AI training and high-performance AI work loads.
These dedciated machines are each powered with 8 H200 GPUs, thats 141GB of HBM3e memory and a memory bandwidth of 4.8 TB/s per machine for large AI projects. Machines can be clustered together to increase demand for training large language models.
Digital Ocean states that being able to run on bare metal, you shoud be able to reduce overhead fees that other hyperscalers charge. But you need to act fast and reserve as there is limited capacity.1