Open jrmclaugh opened 3 years ago
Can you try https://github.com/microsoft/vscode-cpptools/releases/tag/1.3.0-insiders5? We plan to release that as 1.3.0 next week so it should be pretty stable. It has changes that may fix things for you. Also, you can either remove folders from the browse.path (or add * to make them non-recursive) or add folders to files.exclude or C_Cpp.files.exclude if you don't need symbols in those folders? You can set C_Cpp.loggingLevel to "Debug" and view the "C/C++" panel in the Output window to see which files are getting "tag parsed".
Or you can set C_Cpp.intelliSenseEngine to "Disabled", but that will disable all language service features. The Tag Parser functionality is required for the IntelliSense features as well (i.e. it's like an add-on). The "fallback" usually occurs when IntelliSense isn't ready yet or headers can't be found.
Thanks for the prompt reply! Ok I can try that updated version.
Are you saying that some of the include paths I have listed in the logs may be an issue as well (e.g. being accessed recursively)?
Multiple developers use this same configuration and only need to access certain parts of the codebase. This is checked in at the root of the project for anyone to use. If possible, it's handy to have access to both userspace and kernel space, but a rough separation of the two can be workable. I was also originally working under the assumption that compile_commands.json overrides any other include paths. Now re-reading this, I suppose it is still falling back to those when files are not found there, and may be exacerbating the issue above (although I would still expect the includes above to be workable, unless we're just doing something wrong with those).
I'd prefer not to disable entirely, as IntelliSense seems to generally work as expected (and pretty well!). What makes IntelliSense "not ready yet"? I assume there's no way to just delay this process until IntelliSense is ready?
Oops, sorry, I didn't catch you were using compile commands. Include paths and browse.path shouldn't matter. Your C/C++: Log Diagnostics logging should show "Browse Paths from compile_commands.json, from workspace folder" which shows the folders that would be recursively enumerated and tag parsed, i.e. you could potentially add "**/folderToSkip" to C_Cpp.files.exclude. 1.3.0-insiders5 should reduce the max memory usage when doing the file enumeration (before tag parsing) and enables the the files.exclude to avoid the file enumeration which otherwise could consume all your memory if a symlink exists to your root drive for example.
It'll say "IntelliSense client not available" when you first open a file and the IntelliSense process hasn't run yet. You should wait for the flame icon to disappear. The tag parser always has to run (for global symbols to be found outside of the current TU), so the fact that it's falling back shouldn't impact the tag parser issue you're seeing.
Ok thank you for the clarification on how the Tag Parser and Intellisense engine should behave. Disabling the Tag Parser entirely would prevent normal operation, and even only be a temporary workaround anyway if it were possible.
I've been running that insiders version for almost a week now and it is looking a bit better. I believe the last couple days have been the actual v1.3.0 release since my VS Code updated.
Right as I was entering this reply, the memory usage started to creep up again. I restarted VS Code, then watched it steadily increase to 60% (~20GB). From watching the Debug messages in the Output window, it seems related to when the Intellisense Engine is not available. As long as the Tag Parser is running on its own, the memory usage steadily increases. Once Intellisense is available, the amount of memory used stops where it's at (but does not free).
Other things I've observed include:
It at least seems to stop before it overloads my system now, but ~20GB usage is still not great, especially with how inconsistent it is and the risk of it still potentially locking up my system by eating all the RAM and swap.
I'll separately try to be sure I'm not including things that shouldn't be.
This is memory usage with cpptools and not cpptools-srv, right, i.e. is memory usage still high after you close all the files and make sure all the cpptools-srv processes have exited? If so, then that would seem to indicate a memory leak related to tag parsing.
I'm currently looking into memory issues so I could see if I can repro this.
That is with cpptools itself, not cpptools-srv. When I sort by memory usage, I actually don't see cpptools-srv at all.
And just slight correction to the numbers above, the 3GB after restart was actually 1GB (~3% mem usage).
That sounds good, thanks! Let me know if I can do anything to provide more useful information for you.
Yeah, cpptools itself should not be using lots of memory. This could have the same root cause as https://github.com/microsoft/vscode-cpptools/issues/7230 .
Type: LanguageService
Describe the bug
Steps to reproduce
Expected behavior
Some amount of memory usage is understood to be necessary, even in the several GB. I would expect after using a certain amount of memory, it limits itself, even if that limits what features are available until it completes. Most importantly, I expect the setting to explicitly NOT use the Tag Parser as a backup would prevent the Tag Parser from running when IntelliSense is not available. I would rather have nothing than eventual system lock up, although I'm unclear why the IntelliSense client would not be available in the first place (as reported by the C/C++ Output window when I have Debug set).
NOTE: any logs posted have been trimmed of any potential company IP. I included notes to describe what was there and seemed important from my perspective. If more information is necessary, we can try to figure out what I can/can't share there (might not even be necessary, just doing it out of an abundance of caution unless other information is actually useful).
Logs
``` -------- Diagnostics - 4/9/2021, 10:11:45 AM Version: 1.2.2 Current Configuration: { "name": "Linux", "includePath": [ "${workspaceRoot}/kmod/**", "${workspaceRoot}/software/libs", "${workspaceRoot}/toolchain/x86_64-linux-gnu/include/c++/7.5.0", "${workspaceRoot}/toolchain/x86_64-linux-gnu/include/c++/7.5.0/x86_64-linux-gnu", "${workspaceRoot}/toolchain/lib/gcc/x86_64-linux-gnu/7.5.0/include", "${workspaceRoot}/x86_64-linux-gnu/install/usr/include", "${workspaceRoot}/kernel/linux-4.19.25-rt16/include", "${workspaceRoot}/x86_64-linux-gnu/intevac/libs", "${workspaceRoot}/x86_64-linux-gnu/install/usr/include/dbus-1.0", "${workspaceRoot}/x86_64-linux-gnu/install/usr/lib/dbus-1.0/include", "${workspaceRoot}/x86_64-linux-gnu/install/usr/include/libxml++-3.0", "${workspaceRoot}/x86_64-linux-gnu/install/usr/include/glibmm-2.4", "${workspaceRoot}/x86_64-linux-gnu/install/usr/lib/glibmm-2.4/include/", "${workspaceRoot}/x86_64-linux-gnu/install/usr/include/glib-2.0", "${workspaceRoot}/x86_64-linux-gnu/install/usr/lib/libxml++-3.0/include/", "${workspaceRoot}/x86_64-linux-gnu/install/usr/lib/glib-2.0/include/" ], "defines": [ "QSC_CONFIG_AUDIO_ENGINE" ], "intelliSenseMode": "linux-gcc-x64", "compilerPath": "/usr/bin/g++", "cStandard": "c11", "cppStandard": "c++17", "compileCommands": "${workspaceFolder}/compile_commands.json", "compilerArgs": [], "intelliSenseModeIsExplicit": true, "cStandardIsExplicit": true, "cppStandardIsExplicit": true, "compilerPathIsExplicit": true, "browse": { "path": [ "${workspaceRoot}/kmod/**", "${workspaceRoot}/software/libs", "${workspaceRoot}/toolchain/x86_64-linux-gnu/include/c++/7.5.0", "${workspaceRoot}/toolchain/x86_64-linux-gnu/include/c++/7.5.0/x86_64-linux-gnu", "${workspaceRoot}/toolchain/lib/gcc/x86_64-linux-gnu/7.5.0/include", "${workspaceRoot}/x86_64-linux-gnu/install/usr/include", "${workspaceRoot}/kernel/linux-4.19.25-rt16/include", "${workspaceRoot}/x86_64-linux-gnu/intevac/libs", "${workspaceRoot}/x86_64-linux-gnu/install/usr/include/dbus-1.0", "${workspaceRoot}/x86_64-linux-gnu/install/usr/lib/dbus-1.0/include", "${workspaceRoot}/x86_64-linux-gnu/install/usr/include/libxml++-3.0", "${workspaceRoot}/x86_64-linux-gnu/install/usr/include/glibmm-2.4", "${workspaceRoot}/x86_64-linux-gnu/install/usr/lib/glibmm-2.4/include/", "${workspaceRoot}/x86_64-linux-gnu/install/usr/include/glib-2.0", "${workspaceRoot}/x86_64-linux-gnu/install/usr/lib/libxml++-3.0/include/", "${workspaceRoot}/x86_64-linux-gnu/install/usr/lib/glib-2.0/include/", "${workspaceFolder}" ], "limitSymbolsToIncludedHeaders": true } } Translation Unit Mappings: [ OMITTED PATH TO SINGLE IP SOURCE (C FILE) ]: OMITTED PATH TO SINGLE IP SOURCE (C FILE) OMITTED PATH TO SINGLE IP SOURCE (H FILE) Translation Unit Configurations: [ OMITTED PATH TO SINGLE IP SOURCE (C FILE) ]: Process ID: 1514214 Memory Usage: 84 MB Compiler Path: /usr/bin/g++ Includes: NOTE: INCLUDE PATHS TRIMMED TO HIDE COMPANY IP -- there were 35 include paths in this list, spanning our IP as well as source for a single kernel version /usr/lib/gcc/x86_64-linux-gnu/9/include /usr/local/include /usr/include/x86_64-linux-gnu /usr/include Defines: __KERNEL__ KASAN_SHADOW_SCALE_SHIFT=3 KASAN_SHADOW_SCALE_SHIFT=3 MODULE KBUILD_BASENAME="output" KBUILD_MODNAME="vst_controller" Forced Includes: NOTE: INCLUDE PATHS TRIMMED TO HIDE COMPANY IP -- there were 3 include paths in this list, spanning our IP as well as source for a single kernel version Standard Version: c11 IntelliSense Mode: linux-gcc-x64 Other Flags: --gcc --gnu_version=90300 compile_commands.json entry: directory: /home/qsysbuilder/qsys-develop file:Screenshots
Additional context