MSFT 2024 Hackathon repository: "LetMeGoogleThatAzureQuestionForYou-Agent"
Introduction
Us techies in the field (CSAs and TSPs) get hammered with technical questions from customers (and colleagues) that are often just a couple of Google (or Bing :) ) searches away. The polite thing to do is to do that Google search and politely respond with a summary of your findings and some links.
LetMeGoogleThatAzureQuestionForYou-Bot to the rescue! The idea is to build an AI agent that does this searching and finding of data for you and composes an answer for you to hand back.
AutoGen
Our solution leverages https://microsoft.github.io/autogen/. Which is explained by Dr. Andrew Ng:
Today, we mostly use LLMs in zero-shot mode, prompting a model to generate final output token by token without revising its work. This is akin to asking someone to compose an essay from start to finish, typing straight through with no backspacing allowed, and expecting a high-quality result. Despite the difficulty, LLMs do amazingly well at this task!
With an agentic workflow, however, we can ask the LLM to iterate over a document many times. For example, it might take a sequence of steps such as:
- Plan an outline.
- Decide what, if any, web searches are needed to gather more information.
- Write a first draft.
- Read over the first draft to spot unjustified arguments or extraneous information.
- Revise the draft taking into account any weaknesses spotted.
- And so on.
This iterative process is critical for most human writers to write good text. With AI, such an iterative workflow yields much better results than writing in a single pass.
Agents
Our solution leverages several agents to find answers to difficult questions:
| Agent name | Role | Link | |
|---|---|---|---|
| Research manager | Creates the research plan, delegates the tasks and is only one to interact with 'us' | src |  |
| Researcher | Does research. Can search the web, read webpages and summarize content | src |  |
| ARM_creator | Expert on ARM specifications and generates ARM template to enable service property | src |  |
| WAF | Expert on Azure Well Architected. Checks relevant queries for the 5-pillars | src |  |
| Critic | Quality Assurance of the research and response. Checks whether the original question was properly answered. Whether evidence was provided, etc. | src |  |
See it in action
Sample responses
What of the following Azure services can be backed up using the Azure Backup Service: App Service? Return the results in a markdown table. Provide links to the official documentation as well as quotes from the documentation that support your answer.
Generate for me the ARM template to enable Azure Backup for Azure files storage.
Getting started
Pre-reqs
- Docker Desktop
- VSCode
Get started
- Clone repository
- Open workspace in VSCode - and 'Reopen in DevContainer'
- Copy
.env.templatetoenvand make fill out all the required variables - Hit run on
hack.pyand have fun!