Martin Shkreli revealed that training of OpenAI GPT-5 is expected to require a budget of $2.0-$2.5 billion. The training process will involve the use of 500,000 H100s Tensor Core GPUs over 90 days or an alternative configuration.
The estimated cost per Nvidia H100 chip and peripheral components is covered by Nvidia's street price, which ranges from $25,000 to $30,000. The development of chips like the H100 requires substantial investment in research and development, with Nvidia's AI-accelerating products already sold out until 2024. The AI accelerator market is expected to be worth around $150 billion by 2027.