Rapidly scaling online storage to serve over 1 billion ChatGPT users
OpenAI evolved Habitat from a Python library into a globally distributed storage platform serving 1 billion ChatGPT users and 22M requests per second.
The transition from a Python library to a globally distributed storage platform indicates significant architectural changes, likely involving custom distributed systems, caching layers, and load balancing to handle 22M requests per second.
Serving 1 billion users positions OpenAI's infrastructure among the largest consumer-facing AI services, highlighting the growing importance of scalable storage in AI deployment.
This capability supports OpenAI's massive user base and may reduce infrastructure costs per user, improving margins and enabling new features.
Watch for further announcements on storage optimizations, cost reductions, or open-sourcing of components as OpenAI continues to scale.