Gpu Shortage Hinders Openai's Latest Model Rollout
OpenAI CEO Sam Altman has revealed that the company is "out of GPUs" due to rapid growth, forcing it to stagger the rollout of its new model, GPT-4.5. This limits access to the expensive and enormous GPT-4.5, which requires tens of thousands more GPUs than its predecessor, GPT-4. The high cost of GPT-4.5 is due in part to its size, with Altman stating it's "30x the input cost and 15x the output cost" of OpenAI's workhorse model.
- The widespread use of AI models like GPT-4.5 may lead to an increase in GPU demand, highlighting the need for sustainable computing solutions and efficient datacenter operations.
- How will the continued development of custom AI chips by companies like OpenAI impact the overall economy, especially considering the significant investments required to build and maintain such infrastructure?