H100 GPUs that cost $40,000 new are now selling for around $6,000 on eBay, an 85% drop.
• LinkedinThe math on why is straightforward: it costs about 11x as much to run an H100 for inference as a B300. Anyone running H100s needs to charge dramatically more than competitors on newer hardware.
