Closed caspar-goeke closed 3 years ago
Hi @caspar-goeke, Could you please verify issue is possible duplicate https://github.com/google/mediapipe/issues/2506
Could you please attach the contents of Chrome's about:gpu page ("Copy report to clipboard" / paste) as a text file here?
@sgowroji the issue seems to be related, but it's hard to say if its a douplicate. We do not run the holistic part but just the facemesh, and the actual error message seems different, so my guess is it's not idential. However, what seems to be similar is that in Chrome 93 we cannot use an offscreen canvas on the webworker and then feed an image based on that into mediapipe to get a tensor which then does the face detection, while this was a workable solution in Chrome 92. The speed reduction not using an offscreen canvas but image data directly is about 20-40% which is really a lot for our application. We are happy for any suggestions (obviously we are also trying oursevels to find any workaround).
@kenrussell please find the output of my graphics card detials above, but please also note that this happens on each and every system / graphics card we tested so far (about 10 different ones), and both on Linux and Windows
Even some more information if needed
Initialization time | 192 In-process GPU | false Passthrough Command Decoder | true Sandboxed | true GPU0 | VENDOR= 0x10de, DEVICE=0x2484, SUBSYS=0x87bd1043, REV=161, LUID={0,43502} *ACTIVE* GPU1 | VENDOR= 0x1414, DEVICE=0x008c, LUID={0,46645} Optimus | false AMD switchable | false Desktop compositing | Aero Glass Direct composition | true Supports overlays | true YUY2 overlay support | DIRECT NV12 overlay support | DIRECT BGRA8 overlay support | SOFTWARE RGB10A2 overlay support | SOFTWARE Driver D3D12 feature level | D3D 12.2 Driver Vulkan API version | Vulkan API 1.2.0 Driver vendor | NVIDIA Driver version | 30.0.14.7141 GPU CUDA compute capability major version | 0 Pixel shader version | 5.0 Vertex shader version | 5.0 Max. MSAA samples | 8 Machine model name | Machine model version | GL_VENDOR | Google Inc. (NVIDIA) GL_RENDERER | ANGLE (NVIDIA, NVIDIA GeForce RTX 3070 Direct3D11 vs_5_0 ps_5_0, D3D11-30.0.14.7141) GL_VERSION | OpenGL ES 2.0.0 (ANGLE 2.1.16203 git hash: f42bd00efd49)
As mentioned on the Chromium bug, I think it's likely that this is not a duplicate issue, but also not a MediaPipe issue.
Issue #2506 is that MediaPipe JS Solution APIs do not run in web workers.
This issue appears to be with the TF.js WebGL backend running our facemesh model. Aside from using our ML model (MediaPipe often shares models with TF.js), I don't think there's any MediaPipe code in the TF.js calls you're making, so this issue should be re-filed on TF.js for further investigation.
System information (Please provide as much relevant information as possible)
Describe the current behavior: After about running media-pipe/facemesh for about 2 minutes it crashes when using Offscreen Canvas. It's not a memory leak issue on our side (no tensors are leaking):
Describe the expected behavior: I would expect that it is possible to use a Offscreen canvas in a webworker that is running mediapipe/facemesh
Standalone code to reproduce the issue: We currently disabled the Offscreen canvas but otherwise the behavior can be reproduced here: https://www.labvanced.com/player.html?id=26130
Other info / Complete Logs :