OpenAI CEO Sam Altman has publicly acknowledged that AI token costs are becoming a significant operational challenge for the company, describing the issue as 'a huge issue.' The admission comes as inflationary compute costs and over-spending on inference have become a running conversation in the industry.
For enterprise customers and internal deployment teams, Altman's statement signals OpenAI is seeking improved cost-per-token value and likely exploring inference optimization and alternative routing strategies to offset margin pressure.