A chief analyst at a semiconductor research firm says that ChatGPT could cost OpenAI over USD 700,000 in operational expense a day. SemiAnalysis’s Dylan Patel told The Information that ChatGPT is that expensive due to massive amounts of infrastructure it requires to calculate responses to hundreds of millions of prompts. The analyst said that most of the cost are allocated to servers ChatGPT requires to achieve the necessary computing power amidst the growing demand in AI. The cost could even be higher with GPT-4 model since Patel’s estimate was based on GPT-3. [caption id="attachment_332220" align="alignnone" width="847"] ChatGPT's answer when asked about the cost of running itself on a daily basis.[/caption] In line with this, Microsoft is developing a chip called Athena to decrease the operational costs of running generative AI models. OpenAI is expanding ChatGPT Free and Go access with unlimited text chats, a new Think button, and GPT-5.6 Luna as the default model. Limits will still apply to file uploads, images, and other ChatGPT tools. When selected, ChatGPT will give GPT-5.6 Luna more time to work through harder requests. Read more in our articles including "ChatGPT’s daily operational cost is ~USD 700,000 –report" and "OpenAI expands ChatGPT free access with GPT-5.6 Luna".
A chief analyst at a semiconductor research firm says that ChatGPT could cost OpenAI over USD 700,000 in operational expense a day. SemiAnalysis’s Dylan Patel told The Information that ChatGPT is that expensive due to massive amounts of infrastructure it requires to calculate responses to hundreds of millions of prompts.
The analyst said that most of the cost are allocated to servers ChatGPT requires to achieve the necessary computing power amidst the growing demand in AI. The cost could even be higher with GPT-4 model since Patel’s estimate was based on GPT-3. [caption id="attachment_332220" align="alignnone" width="847"] ChatGPT's answer when asked about the cost of running itself on a daily basis.[/caption] In line with this, Microsoft is developing a chip called Athena to decrease the operational costs of running generative AI models.
Our coverage of chat gpt cost includes: "ChatGPT’s daily operational cost is ~USD 700,000 –report"; "OpenAI expands ChatGPT free access with GPT-5.6 Luna"; "OpenAI expands Health in ChatGPT with medical records support". Each article provides unique insights and information.