Open sandrohanea opened 2 days ago
Error is BSOD screen is VIDEO_SCHEDULER_INTERNAL_ERROR
Also, the issue is reproduced consistently on my device.
I confirm that CUDA also works as expected on my system. only DML runtime is causing the BSOD.
Another strange thing is that even after the model should be "loaded" the RAM usage is super low:
Describe the bug When running one of the examples for directml OnmxRuntimeGenAI, I get the blue screen of death on my Surface Lpatop Studio 2
To Reproduce Steps to reproduce the behavior:
var modelPath = @"C:\Models\microsoft\Phi-3-medium-4k-instruct-onnx-directml\directml-int4-awq-block-128"; var model = new Model(modelPath); var tokenizer = new Tokenizer(model);
var systemPrompt = "You are an AI assistant that helps people find information. Answer questions using a direct style. Do not share more information that the requested by the users.";
// chat start Console.WriteLine(@"Ask your question. Type an empty string to Exit.");
// chat loop while (true) { // Get user question Console.WriteLine(); Console.Write(@"Q: "); var userQ = Console.ReadLine(); if (string.IsNullOrEmpty(userQ)) { break; }
}