Let’s assume an enterprise processes incoming customer queries through an interactive chatbot using ChatGPT. While open-source models are free to use, the infrastructure to host and deploy them is not. Let’s dive into AWS costs for hosting open-source models and serving as APIs — usually involving four steps. Table 2: Comparison of Models’ Cost, Advantages, and DisadvantagesHowever, open-source LLMs are rapidly catching up in terms of performance and relevance. Using open-source models provides more control and transparency as organizations have access to the underlying code and can modify it as needed.

Source: Wall Street Journal July 18, 2023 07:26 UTC