This sample application combines Azure Cosmos DB with Azure OpenAI ChatGPT with a Blazor front-end for an intelligent chat bot application that is a minimal clone of the OpenAi ChatGPT experience.
This application has individual chat sessions which are displayed and can be selected in the left-hand nav. Clicking on a session will show the messages that contain human prompts and AI completions.
When a new prompt is sent to the Azure OpenAI service, some of the conversation history is sent with it. This provides context allowing ChatGPT to respond
as though it is having a conversation. The length of this conversation history can be configured from appsettings.json
with the OpenAiMaxTokens value that is then translated to a maximum conversation string length that is 1/2 of this value.
Please note that the "text-davinci-003" model used by this sample has a maximum of 4096 tokens. Token are used in both the request and reponse from the service. Overriding the maxConversationLength to values approaching maximum token value could result in completions that contain little to no text if all of it has been used in the request.
The history for all prompts and completions for each chat session is stored in Azure Cosmos DB. Deleting a chat session in the UI will delete it's corresponding data as well.
The application will also summarize the name of the chat session by asking ChatGPT to provide a one or two word summary of the first prompt. This allows you to easily identity different chat sessions.
Please note this is a sample application. It is intended to demonstrate how to use Azure Cosmos DB and Azure OpenAI ChatGPT together. It is not intended for production or other large scale use
- Azure Subscription
- Subscription access to Azure OpenAI service. Start here to Request Acces to Azure OpenAI Service
- Visual Studio, VS Code, or some editor if you want to edit or view the source for this sample.
- Fork this repository to your own GitHub account.
- Depending on whether you deploy using the ARM Template or Bicep, modify this variable in one of those files to point to your fork of this repository, "webSiteRepository": "https://github.com/Azure-Samples/cosmos-chatgpt.git"
- If using the Deploy to Azure button below, also modify this README.md file to change the path for the Deploy To Azure button to your local repository.
- If you deploy this application without making either of these changes, you can update the repository by disconnecting and connecting an external git repository pointing to your fork.
The provided ARM or Bicep Template will provision the following resources:
- Azure Cosmos DB account with database and container at 400 RU/s. This can optionally be configured to run on the Cosmos DB free tier if available for your subscription.
- Azure App service. This will be configured for CI/CD to your forked GitHub repository. This service can also be configured to run on App Service free tier.
- Azure Open AI account. You must also specify a name for the deployment of the "text-davinci-003" model which is used by this application.
Note: You must have access to Azure Open AI service from your subscription before attempting to deploy this application.
All connection information for Azure Cosmos DB and Open AI is zero-touch and injected as environment variables in the Azure App Service instance at deployment time.
- After deployment, go to the resource group for your deployment and open the Azure App Service in the Azure Portal. Click the web url to launch the website.
- Click + New Chat to create a new chat session.
- Type your question in the text box and press Enter.
To remove all the resources used by this sample, you must first manually delete the deployed model within the Azure AI service. You can then delete the resource group for your deployment. This will delete all remaining resources.