Complete Datapoint Failure After Updating to PAT 3.5.1 on Windows 11

[GFlechas]

Summary:
I keep getting a Complete Datapoint Failure when trying to run PAT simulations using the local server on Windows 11 (see the below screenshot). Simulations were running fine on PAT 3.3.0. The seed model from the below-linked project was created with OpenStudio Application 1.5.0 and does simulate fine in the application. I've tried some older PAT projects as well and still get the datapoint failure.

Troubleshooting Steps I've Taken:
I've tried doing a full uninstall, reboot, install, and then another reboot before running PAT just to make sure I didn't have anything hanging around.

I moved my project folders to the base of the C-Drive to make sure I wasn't having a file path issue.

It's not clear if it's a bug related to windows 11 or PAT. I also can't rule out if it's something weird I've done in setting things up.

I've uploaded my project folder to OneDrive here if that will help to isolate the issue.

[GFlechas]

Hi there,

I apologize for not getting back to you sooner. I have not yet tried the new version of PAT to know if the issue is fixed. That said, I downgraded my PAT version to 3.3.0 where I wasn't having the problem. I run OpenStudio server in Docker on another computer and use that as my "cloud" computer with the recent version of OS server installed. I'm sure there's cases where incompatibility may arise, but I have not yet encountered them.

So in essence I generate the cases in the old version of PAT but then they get simulated in the newer version of OpenStudio in a cloud instance which seems to work well enough for the time being.

On Mon, Apr 3, 2023 at 8:20 PM Ib1ken0b1 @.***> wrote:

Have you had any developments with this bug? I've also experienced it and can't figure out a solution.

— Reply to this email directly, view it on GitHub https://github.com/NREL/OpenStudio-PAT/issues/252#issuecomment-1495246458, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJRHX4ZZI3BNTJWUY3UAXEDW7OAPVANCNFSM6AAAAAAVHDFV3M . You are receiving this because you authored the thread.Message ID: @.***>

-- Gabriel

[MColeman2021]

Just wanted to check in to see if this issue has been resolved. I have tried using the newer version of PAT (3.6.1) and this is still the case. Is there any way to address this?

[brianlball]

3.6.1-1 ?

[brianlball]

also, in the console log, PAT outputs the commands its using to run the analysis. 'run analysis command' copy that command and run it in a terminal or powershell and add the '--verbose --debug' after run_analysis. that will get you more info.

[GFlechas]

Hi @brianlball, I'm still seeing this as well. I just ran a PAT project from the command prompt using PAT 3.6.1-1 and got the following output:

C:\Users\gabri>"C:\ParametricAnalysisTool-3.6.1\pat\ruby\bin\ruby.exe" "C:\ParametricAnalysisTool-3.6.1\pat\OpenStudio-server\bin\openstudio_meta" run_analysis   --ruby-lib-path="C:\ParametricAnalysisTool-3.6.1\pat\OpenStudio\Ruby" "C:\PAT Projects\PatTesting/PatTesting.json" "http://localhost:8080" --verbose --debug
D, [2023-10-27T13:08:31.325665 #8912] DEBUG -- : Set Logger log level to DEBUG
D, [2023-10-27T13:08:31.326414 #8912] DEBUG -- : Environment is: {"ALLUSERSPROFILE"=>"C:\\ProgramData", "APPDATA"=>"C:\\Users\\gabri\\AppData\\Roaming", "ChocolateyInstall"=>"C:\\ProgramData\\chocolatey", "ChocolateyLastPathUpdate"=>"133387502157095701", "CommonProgramFiles"=>"C:\\Program Files\\Common Files", "CommonProgramFiles(x86)"=>"C:\\Program Files (x86)\\Common Files", "CommonProgramW6432"=>"C:\\Program Files\\Common Files", "COMPUTERNAME"=>"GABRIEL_TAB_P8", "ComSpec"=>"C:\\WINDOWS\\system32\\cmd.exe", "DriverData"=>"C:\\Windows\\System32\\Drivers\\DriverData", "EFC_21044"=>"1", "GEM_HOME"=>"C:/ParametricAnalysisTool-3.6.1/pat/OpenStudio-server/gems", "GEM_PATH"=>"C:/ParametricAnalysisTool-3.6.1/pat/OpenStudio-server/gems;C:/ParametricAnalysisTool-3.6.1/pat/OpenStudio-server/gems/bundler/gems", "HOME"=>"C:/Users/gabri", "HOMEDRIVE"=>"C:", "HOMEPATH"=>"\\Users\\gabri", "LOCALAPPDATA"=>"C:\\Users\\gabri\\AppData\\Local", "MSMPI_BENCHMARKS"=>"C:\\Program Files\\Microsoft MPI\\Benchmarks\\", "MSMPI_BIN"=>"C:\\Program Files\\Microsoft MPI\\Bin\\", "NUMBER_OF_PROCESSORS"=>"8",  "OPENMODELICAHOME"=>"C:\\Program Files\\OpenModelica1.20.0-64bit\\", "OS"=>"Windows_NT", "Path"=>"C:\\Program Files\\Microsoft MPI\\Bin\\;C:\\Program Files\\Python310\\Scripts\\;C:\\Program Files\\Python310\\;C:\\Program Files\\Python39\\Scripts\\;C:\\Program Files\\Python39\\;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files\\PuTTY\\;C:\\Program Files\\Microsoft VS Code\\bin;C:\\Program Files\\Git\\cmd;C:\\Program Files\\dotnet\\;C:\\Program Files\\Calibre2\\;C:\\Program Files\\MATLAB\\R2022b\\bin;C:\\ProgramData\\chocolatey\\bin;C:\\Ruby27-x64\\bin;C:\\Users\\gabri\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\gabri\\AppData\\Local\\GitHubDesktop\\bin;C:\\Program Files (x86)\\Nmap;C:\\Users\\gabri\\AppData\\Roaming\\Amazon", "PATHEXT"=>".COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC;.PY;.PYW;.RB;.RBW", "PROCESSOR_ARCHITECTURE"=>"AMD64", "PROCESSOR_IDENTIFIER"=>"Intel64 Family 6 Model 140 Stepping 1, GenuineIntel", "PROCESSOR_LEVEL"=>"6", "PROCESSOR_REVISION"=>"8c01", "ProgramData"=>"C:\\ProgramData", "ProgramFiles"=>"C:\\Program Files", "ProgramFiles(x86)"=>"C:\\Program Files (x86)", "ProgramW6432"=>"C:\\Program Files", "PROMPT"=>"$P$G", "PSModulePath"=>"C:\\Program Files\\WindowsPowerShell\\Modules;C:\\WINDOWS\\system32\\WindowsPowerShell\\v1.0\\Modules", "PUBLIC"=>"C:\\Users\\Public", "RUBYOPT"=>"-Eutf-8", "SESSIONNAME"=>"Console", "SystemDrive"=>"C:", "SystemRoot"=>"C:\\WINDOWS", "TEMP"=>"C:\\Users\\gabri\\AppData\\Local\\Temp", "TMP"=>"C:\\Users\\gabri\\AppData\\Local\\Temp", "windir"=>"C:\\WINDOWS", "ZES_ENABLE_SYSMAN"=>"1", "__PSLockDownPolicy"=>"0"}
D, [2023-10-27T13:08:31.326749 #8912] DEBUG -- : Input ARGV is ["run_analysis", "--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"]
D, [2023-10-27T13:08:31.326932 #8912] DEBUG -- : Executing requires
D, [2023-10-27T13:08:31.327242 #8912] DEBUG -- : Requiring tmpdir
D, [2023-10-27T13:08:31.363034 #8912] DEBUG -- : Requiring optsparse
D, [2023-10-27T13:08:31.371141 #8912] DEBUG -- : Requiring timeout
D, [2023-10-27T13:08:31.377737 #8912] DEBUG -- : Requiring json
D, [2023-10-27T13:08:31.378027 #8912] DEBUG -- : Required initial gems successfully
I, [2023-10-27T13:08:31.378195 #8912]  INFO -- : Executing argv: ["run_analysis", "--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"]I, [2023-10-27T13:08:31.378361 #8912]  INFO -- : CLI Parsed Inputs: [] "run_analysis" ["--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"]
D, [2023-10-27T13:08:31.378527 #8912] DEBUG -- : Main arguments are []
D, [2023-10-27T13:08:31.378714 #8912] DEBUG -- : Sub-command is run_analysis
D, [2023-10-27T13:08:31.378898 #8912] DEBUG -- : Sub-arguments are ["--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"]
D, [2023-10-27T13:08:31.379252 #8912] DEBUG -- : Invoking command class: RunAnalysis ["--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"]
D, [2023-10-27T13:08:31.379513 #8912] DEBUG -- : sub_argv = ["--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"] in RunAnalysis execute
D, [2023-10-27T13:08:31.379714 #8912] DEBUG -- : Requiring gems for RunAnalysis
D, [2023-10-27T13:08:31.379859 #8912] DEBUG -- : Requiring zip gem
D, [2023-10-27T13:08:31.669623 #8912] DEBUG -- : Requiring os-analysis gem
Top level ::CompositeIO is deprecated, require 'multipart/post' and use `Multipart::Post::CompositeReadIO` instead!
Top level ::Parts is deprecated, require 'multipart/post' and use `Multipart::Post::Parts` instead!
OpenStudio did not load, but most functionality is still available. Will continue...
D, [2023-10-27T13:08:37.932242 #8912] DEBUG -- : Requiring os-aws gem
D, [2023-10-27T13:08:41.210044 #8912] DEBUG -- : Successfully required all gems for RunAnalysis
D, [2023-10-27T13:08:41.245777 #8912] DEBUG -- : RunAnalysis command: ["C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080"] {:debug=>true, :dencity=>false, :zip_file=>nil, :analysis_type=>"batch_datapoints"}
new project created with ID: 03b1b7cb-adff-48bf-ba28-092edc518dbe
asked to create analysis with 8223aa63-6351-470b-90a4-d7a4c00bec13
options[:push_to_dencity] = false
new analysis created with ID: 8223aa63-6351-470b-90a4-d7a4c00bec13
Successfully uploaded ZIP file
Run analysis is configured with {"analysis_action":"start","without_delay":false,"analysis_type":"batch_datapoints","simulate_data_point_filename":"simulate_data_point.rb","run_data_point_filename":"run_openstudio_workflow_monthly.rb"}
Received request to run analysis 8223aa63-6351-470b-90a4-d7a4c00bec13
Run analysis is configured with {"analysis_action":"start","without_delay":false,"analysis_type":"batch_run","simulate_data_point_filename":"simulate_data_point.rb","run_data_point_filename":"run_openstudio_workflow_monthly.rb"}
Received request to run analysis 8223aa63-6351-470b-90a4-d7a4c00bec13

[brianlball]

that looks like the data point was submitted correctly. the next step would be to look the /temp_data directory in your PAT project folder. this has the analysis and datapoint directories for the simulations that are trying to run. Look in the datapoint directory for any energyplus .err files or other log info

[GFlechas]

It looks like the run folders are all basically empty. There is a single run.log file in each, however they're all empty files.

[brianlball]

zip up your pat project folder and i'll try and reproduce

[GFlechas]

Sure thing @brianlball, see attachment here: PatTesting_2.zip

[brianlball]

I think I found the culprit. The weather file was not set in the design alternatives, resulting in a NULL value for the weather file. Once I selected a weather file it ran.

I found this by looking at the simulate data point log which can be found in a few locations:

or in the server localhost:8080 webpage

[GFlechas]

I've added the weather file to each of the design alternatives, however, each point still fails. It doesn't have any information for sdp_log_file either:

I've rezipped the project with the updated design alternatives here:PatTesting_2_update.zip

[brianlball]

I just ran your project in PAT 3.6.1-1 with the project at c:\PatTesting_2_update and it ran successfully.

[GFlechas]

Are you running it on Windows 11?

On Mon, Oct 30, 2023 at 10:14 AM Brian Ball @.***> wrote:

I just ran your project in PAT 3.6.1-1 with the project at c:\PatTesting_2_update and it ran successfully.

[image: image] https://user-images.githubusercontent.com/2235296/279124653-110007b2-4a31-4d92-9979-0eefe38c94f1.png

— Reply to this email directly, view it on GitHub https://github.com/NREL/OpenStudio-PAT/issues/252#issuecomment-1785559344, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJRHX4YK5FC7JSW5NBS6463YB7G4ZAVCNFSM6AAAAAAVHDFV3OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTOOBVGU2TSMZUGQ . You are receiving this because you authored the thread.Message ID: @.***>

-- Gabriel

[brianlball]

windows 10

[GFlechas]

I am also able to run the project on a Windows 10 computer. However, if I try to run the project on my Windows 11 Laptop with PAT 3.6.1-1 I get the datapoint failure. That's what's lead me to think the issue is Win 11 specific.

[brianlball]

gotcha, will the OSMs that are generated on the windows 10 computer, and/or the OSW workflow with measures run on the Windows 11 machine with the openstudio CLI?

[GFlechas]

Yes. I called one of the workflows generated by PAT located in the temp_data folder from the openstudio CLI (version 3.6.0). It fully simulated and ran its reporting measures.

[brianlball]

did you use the openstudio that ships with PAT? For example, at C:\ParametricAnalysisTool-3.6.1\pat\openstudio\bin\openstudio.exe it would be great to know if the openstudio that PAT is using works

[GFlechas]

I just tried and yes, it will also simulate using the version of openstudio shipping with PAT.

[brianlball]

we are working on getting a windows 11 VM so we can replicate the issue

[MColeman2021]

I've also run into this issue and am running on Windows 11. Has there been any progress with this? I've also been using version 3.6.1 and the newly released 3.7.0, and the same error happens in both.

[brianlball]

We are still waiting on our IT to release an approved windows 11 VM for us so we can include windows 11 in our testing. 3.7.0 is getting re-released soon with a fix for the wrong E+ version https://github.com/NREL/OpenStudio-PAT/issues/272 @wenyikuang

[brianlball]

@MColeman2021 PAT 3.7.0 was re-released with the correct version of E+ https://github.com/NREL/OpenStudio-PAT/releases/tag/v3.7.0 Please let us know if you are still having problems after that.

[Safari-2024]

Hi, has this issue been resolved? I am getting the same datapoint failure issue- I am using v3.7.0 for PAT and I have Windows 11 Version 23H2 (x64).

[wenyikuang]

I may need to try to re-produce it in other platform and see how it works... Probably not issue in E+?

[brianlball]

https://github.com/NREL/OpenStudio-server/issues/737 The datapoint logs were blank, but I fixed it server side, so the openstudio datapoint log will get populated. This will make it easier to debug. Probably have to retry in 3.8.0 It also would be helpful to have an updated minimal reproducible example

[mekiolivier]

Please I am facing same challenges, i have the latest version of PAT 3.7.0 using windows 10, but simulation still fail. I want to downgrade it to 3.6.1 but i couldn't find. kindly ; Your help will be appreciated.

[brianlball]

The 3.6.1-1 release can be found here We are working on the 3.8.0 release which will have improved logging to help with debugging failed datapoints.

[mekiolivier]

Thank You very much. let me give it a try. i really appreciate

[mekiolivier]

Hello Sir, Please , I downloaded but still getting failure as shown in the image. Thanks again for your assistance.

[brianlball]

what about the logs in the PAT project folder?

[mekiolivier]

Hello Sir, thanks for the feeedback. in the PAT project folder log ; it shows those files , which i copied top messages to paste here : delayed Job : [17:49:48.671505 INFO] 2024-07-10T17:49:48+0100: [Worker(delayed_job.server host:DESKTOP-H8ODB4J pid:3320)] Error while reserving job: IOError: closed stream (for 127.0.0.1:27017 (no TLS)) (on 127.0.0.1:27017, connection 1:1 dj_server : Top level ::CompositeIO is deprecated, require 'multipart/post' and use Multipart::Post::CompositeReadIO instead! dj_worker : Top level ::CompositeIO is deprecated, require 'multipart/post' and use Multipart::Post::CompositeReadIO instead! mongo : {"t":{"$date":"2024-07-10T17:49:14.738+01:00"},"s":"I", "c":"CONTROL", "id":23285, "ctx":"main","msg":"Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'"} {"t":{"$date":"2024-07-10T17:49:14.750+01:00"},"s":"W", "c":"ASIO", "id":22601, "ctx":"main","msg":"No TransportLayer configured during NetworkInterface startup"} {"t":{"$date":"2024-07-10T17:49:14.752+01:00"},"s":"I", "c":"NETWORK", "id":4648602, "ctx":"main","msg":"Implicit TCP FastOpen in use."} rail : Top level ::CompositeIO is deprecated, require 'multipart/post' and use Multipart::Post::CompositeReadIO instead!

Kindly , look at it and please if you can advise to solve the issue. Once again thank you i appreciate.

[brianlball]

That past is not helpful. Is there anything in the localresults or other log files that looks like something we can debug? something that says error how about posting your project so we can try and replicate? We need a minimally reproducible example in order to really debug

[mekiolivier]

Thank you Sir. here is the project. In the log no error is shown. Project.zip

[brianlball]

Thats an openstudio model. I want the PAT project. Does that openstudio model run correctly?

[mekiolivier]

Yes Sir, It ran successfully. PAT.zip

[brianlball]

there are no measures or design alternatives to run in that pat project, so I cant replicate what you are seeing

[mekiolivier]

Hello Sir , Sorry for delay. I was without my laptop. Thanks for your feeddback. There are 2 measures and two alternatives as well. let me reattach and sent to you to check. I really appreciate your effort for helping me sorting out this issue. file simulated.zip PAT file.zip