Model Output Discrepancies Between Jupyter and VSCode

FarihaAnis commented 4 months ago

Type: Performance Issue

I've been saving my trained model in JSON format in Jupyter Notebook using Python, assuming it would save all the parameters too. But when I load this model in VSCode, also using Python, the outputs are a bit different, even though both environments are using the same versions of the libraries. Just FYI, I also saved the scaler that I used during training and moved it over to VSCode along with the model using pickle. Any idea why this might be happening?

VS Code version: Code 1.89.1 (dc96b837cf6bb4af9cd736aa3af08cf8279f7685, 2024-05-07T05:13:33.891Z) OS version: Windows_NT x64 10.0.22631 Modes:

System Info

|Item|Value| |---|---| |CPUs|Intel(R) Core(TM) i5-1035G1 CPU @ 1.00GHz (8 x 1190)| |GPU Status|2d_canvas: enabled
canvas_oop_rasterization: enabled_on
direct_rendering_display_compositor: disabled_off_ok
gpu_compositing: enabled
multiple_raster_threads: enabled_on
opengl: enabled_on
rasterization: enabled
raw_draw: disabled_off_ok
skia_graphite: disabled_off
video_decode: enabled
video_encode: enabled
vulkan: disabled_off
webgl: enabled
webgl2: enabled
webgpu: enabled| |Load (avg)|undefined| |Memory (System)|7.78GB (1.44GB free)| |Process Argv|--crash-reporter-id 84527a82-785d-485f-a0b7-cdf5c12ac0aa| |Screen Reader|no| |VM|0%|

Process Info

``` CPU % Mem MB PID Process 0 59 8388 code main 0 119 3024 gpu-process 0 23 3872 ptyHost 0 6 4856 conpty-agent 0 1 8468 conpty-agent 0 1 8968 conpty-agent 0 44 10580 C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -noexit -command "try { . \"c:\Users\user\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\workbench\contrib\terminal\browser\media\shellIntegration.ps1\" } catch {}" 0 44 11688 C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -noexit -command "try { . \"c:\Users\user\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\workbench\contrib\terminal\browser\media\shellIntegration.ps1\" } catch {}" 0 3 18864 "C:\Users\user\anaconda3\Scripts\streamlit.exe" run predictionv5.py 0 237 5640 "C:\Users\user\anaconda3\python.exe" "C:\Users\user\anaconda3\Scripts\streamlit.exe" run predictionv5.py 0 4 12832 C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -noexit -command "try { . \"c:\Users\user\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\workbench\contrib\terminal\browser\media\shellIntegration.ps1\" } catch {}" 0 4 17512 C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -noexit -command "try { . \"c:\Users\user\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\workbench\contrib\terminal\browser\media\shellIntegration.ps1\" } catch {}" 0 6 17836 conpty-agent 0 12 10640 utility-network-service 0 34 10732 shared-process 0 168 13660 window [1] (predictionv5.py - IDS_small - Visual Studio Code) 0 3 17532 crashpad-handler 0 86 20620 window [2] (Issue Reporter) 0 65 21088 extensionHost [1] 0 18 12760 electron-nodejs (bundle.js ) 0 12 21832 fileWatcher [1] ```

Workspace Info

Extensions (3)

Extension|Author (truncated)|Version ---|---|--- debugpy|ms-|2024.6.0 python|ms-|2024.6.0 vscode-pylance|ms-|2024.5.1

A/B Experiments

``` vsliv368:30146709 vspor879:30202332 vspor708:30202333 vspor363:30204092 vscoreces:30445986 vscod805:30301674 binariesv615:30325510 vsaa593cf:30376535 py29gd2263:31024239 c4g48928:30535728 azure-dev_surveyone:30548225 a9j8j154:30646983 962ge761:30959799 pythongtdpath:30769146 welcomedialog:30910333 pythonidxpt:30866567 pythonnoceb:30805159 asynctok:30898717 pythontestfixt:30902429 pythonregdiag2:30936856 pythonmypyd1:30879173 pythoncet0:30885854 h48ei257:31000450 pythontbext0:30879054 accentitlementsc:30995553 dsvsc016:30899300 dsvsc017:30899301 dsvsc018:30899302 cppperfnew:31000557 dsvsc020:30976470 pythonait:31006305 chatpanelt:31048053 dsvsc021:30996838 0ee40948:31013168 pythoncenvpt:31049070 a69g1124:31046351 dvdeprecationcf:31052040 pythonprc:31047982 dwnewjupytercf:31046870 26j00206:31048877 ```

DonJayamanne commented 4 months ago

Thank you for filing this issue, and sorry you are running into this. Please can you share a screenshot of the two outputs?

Even better, can you share a very simple sample Notebook that I can use at my end to replicate this issue.

vscodenpa commented 4 months ago

This issue has been closed automatically because it needs more information and has not had recent activity. See also our issue reporting guidelines.

Happy Coding!

microsoft / vscode

Model Output Discrepancies Between Jupyter and VSCode #213437