Deploying Azure OpenAI ChatGPT with Private Endpoint using Terraform

Overview

Deploying an Azure OpenAI with ChatGPT or Azure Cognitive Service with a Private Endpoint

Blog ==> https://medium.com/@gmusumeci/how-to-deploy-azure-openai-with-private-endpoint-and-chatgpt-using-terraform-253cfd1513aa

Code creates:

• Resource Group for Network
• VNET and Subnet for Private Endpoint
• Azure OpenAI/Cognitive Service Instance
• Azure OpenAI/Cognitive Service Deployment

Azure OpenAI Service Instance Variables

List of variables used in this code to configure the Azure OpenAI Service Instance

Variable	Description	Type
region	The region in which this module should be deployed	string
cognitive_account_sku_name	Specifies the SKU Name for this Cognitive Service Account. Default: S0	string
cognitive_account_kind_name	Specifies the type of Cognitive Service Account that should be created. Default: OpenAI	string
vnet_address_space	CIDR of the VNET used for the Private Endpoint	string
subnet_address_space	CIDR of the Subnet used for the Private Endpoint	string
public_network_access_enabled	Enable public network access. Default: false	bool
outbound_network_access_restricted	Whether outbound network access is restricted for the Cognitive Account. Default: true	bool
network_acls_default_action	The default action is to use when no rules match from ip_rules / virtual_network_rules. Possible values are Allow and Deny. Default: "Deny"	string
network_acls_ip_rules	One or more IP Addresses, or CIDR Blocks which should be able to access the Cognitive Account	list(string)
private_dns_resource_group	The Resource Group where the Private DNS for OpenAI was created	string

Note: cognitive_account_kind_name Possible values are Academic, AnomalyDetector, Bing.Autosuggest, Bing.Autosuggest.v7, Bing.CustomSearch, Bing.Search, Bing.Search.v7, Bing.Speech, Bing.SpellCheck, Bing.SpellCheck.v7, CognitiveServices, ComputerVision, ContentModerator, CustomSpeech, CustomVision.Prediction, CustomVision.Training, Emotion, Face, FormRecognizer, ImmersiveReader, LUIS, LUIS.Authoring, MetricsAdvisor, OpenAI, Personalizer, QnAMaker, Recommendations, SpeakerRecognition, Speech, SpeechServices, SpeechTranslation, TextAnalytics, TextTranslation and WebLM.

Azure OpenAI Deployments Variables

Variable	Description	Type
cognitive_deployment	List of Azure OpenAI Cognitive Deployments	list(object)

• name = string --> Name of the Deployment
• format = string --> Format of the Deployment
• type = string --> Type of the Deployment
• version = string --> Version of the Deployment
• scale_type = string --> Scale Type of the Deployment
• capacity = number --> Tokens-per-Minute (TPM)

Default:

default = [
  {
    name       = "gpt35"
    format     = "OpenAI"
    type       = "gpt-35-turbo"
    version    = "0301"
    scale_type = "Standard"
    capacity   = 100
  }
]

How To deploy the code:

• Clone the repo
• Update variables to your environment
• Execute "terraform init"
• Execute "terraform apply"

Private DNS Zone

A private DNS zone is required, if you need one, use the code below:

# Create the Resource Group for DNS Zone
resource "azurerm_resource_group" "dns_zone" {
  name     = "kopicloud-dns-rg"
  location = var.location
}

# Create Private DNS Zone for OpenAI
resource "azurerm_private_dns_zone" "openai" {
  name                = "privatelink.openai.azure.com"
  resource_group_name = azurerm_resource_group.dns_zone.name
}