microsoft / DevHomeAzureExtension

Dev Home Azure Extension
MIT License
68 stars 15 forks source link

Model can sometimes get stuck in a loop when generating a project, which exhausts the context window #223

Open adrastogi opened 1 week ago

adrastogi commented 1 week ago

Dev Home version

0.1501.529.0

Windows build number

10.0.26240.5000

Other software

OS Build Version: 10.0.26240.5000.amd64fre.ge_current_directadept.240613-1700 .NET Version: .NET 8.0.5

Steps to reproduce the bug

The repro for this is inconsistent- but something like the below seems to trigger it:

  1. In Quickstart Playground, instruct the model to generate a dotnet project for Aspire

Expected result

The model generates the project without issue

Actual result

The project fails to generate (progress will hang on phase where the devcontainer files are being produced). The problem is with the devcontainer file itself where the model will get "stuck in a loop" and continuously generate repeated apt commands for installing parts of dotnet. This exhausts the context window and eventually surfaces an error back to the user. This might be something that requires mitigation via more grounding data for that particular project type.

Included System Information

CPU: AMD Ryzen Threadripper PRO 3945WX 12-Cores
Physical Memory: 63.86GB (42.06GB free) Processor Architecture: x64

Included Extensions Information

Extensions: Microsoft.Windows.DevHomeGitHubExtension.Canary_0.1500.528.0_x648wekyb3d8bbwe (Dev Home GitHub Extension (Canary)) Microsoft.Windows.DevHome.Canary_0.1501.529.0_x648wekyb3d8bbwe (Core Widget Extension) Microsoft.Windows.DevHome.Canary_0.1501.529.0_x648wekyb3d8bbwe (Hyper-V Extension) Microsoft.Windows.DevHomeAzureExtension.Canary_0.1000.528.0_x648wekyb3d8bbwe (Dev Home Azure Extension (Canary)) 9932MartCliment.WingetUIWidgets_0.6.1.0_x64__g91dtg5srk15g (Widgets for UniGetUI (formerly WingetUI))

Widget Service: MicrosoftWindows.Client.WebExperience_524.16300.0.0_x64__cw5n1h2txyewy