GitHub Copilot for Azure: Deploy an AI RAG App to ACA using AZD

Recently, I had to develop a Retrieval-Augmented Generation (RAG) prototype for an internal project. Since I enjoy working with LlamaIndex, I decided to use GitHub Copilot for Azure to quickly find an existing sample that I could use as a starting point and deploy it to Azure Container Apps.

Getting Started with GitHub Copilot for Azure

To begin, I installed the GitHub Copilot for Azure extension in VS Code. This extension allows me to interact with Azure directly using the azure command. I used this feature to ask my Copilot to help me locate a relevant sample to use as a foundation for my project.

After querying available Azure resources, the extension found a LlamaIndex JavaScript sample, which was ideal for my needs. I then copied the Azure Developer CLI (azd) command to initialize my project and set up my environment.

Deploying the Sample to Azure Container Apps

With the sample files downloaded, the next step was to deploy the application as-is to ensure everything functioned correctly. I asked my Copilot how to proceed, and it suggested running the following command: azd up.

After executing the command, my sample was successfully deployed to Azure Container Apps. Now, it was time to test it!

Debugging Deployment Issues with Copilot

To verify that everything was working, I interacted with the app by entering my prompt. However, I encountered an issue—there was a missing configuration in the container. To troubleshoot, I shared the error message with the extension and asked for guidance.

My Copilot suggested adding a specific line to my main.bicep file. I applied the change and then wondered if I also needed to pass the variable to my container as a runtime configuration. Again, I consulted Copilot, which confirmed that I should add the variable to the container configuration. After vibe copying and pasting the suggested change into my Bicep file, I was ready to redeploy.

Redeploying and Final Testing

To redeploy my updated configuration, I executed: azd deploy.

The new revision of the app was successfully deployed. Time for another test!

Success! The application responded correctly, confirming that my configuration updates worked as expected.

Conclusion

Using GitHub Copilot for Azure significantly accelerated my RAG prototype development by helping me find relevant resources, debug issues, and deploy my app seamlessly. If you’re building Azure-based applications, I highly recommend trying out this extension.

You can download the GitHub Copilot for Azure extension in VS Code and give it a go yourself. If you do, share your feedback in the repo—I’d love to hear how it improves your workflow!