jiuqiant
commented
3 years ago Yes, there is a way to do this. But, it requires you to build the python wheel locally since there is a BUILD file change.
Step 1. Modify the source code.
In mediapipe/python/BUILD, register the rect proto. (We will have this fix in the coming release)
--- a/mediapipe/python/BUILD
+++ b/mediapipe/python/BUILD
@@ -47,6 +47,7 @@ pybind_extension(
"//mediapipe/framework/formats:classification_registration",
"//mediapipe/framework/formats:detection_registration",
"//mediapipe/framework/formats:landmark_registration",
+ "//mediapipe/framework/formats:rect_registration",
],
)In hands.py, you can add hand_rects into the outputs list.
--- a/mediapipe/python/solutions/hands.py
+++ b/mediapipe/python/solutions/hands.py
@@ -142,7 +142,7 @@ class Hands(SolutionBase):
'handlandmarkcpu__ThresholdingCalculator.threshold':
min_tracking_confidence,
},
- outputs=['multi_hand_landmarks', 'multi_handedness'])
+ outputs=['multi_hand_landmarks', 'multi_handedness', 'hand_rects'])
def process(self, image: np.ndarray) -> NamedTuple:
"""Processes an RGB image and returns the hand landmarks and handedness of each detected hand.Step 2.Build the python wheel locally by following https://google.github.io/mediapipe/getting_started/python.html#building-mediapipe-python-package
Step 3. Modify your example code to get the hand bbox.
results = hands.process(cv2.cvtColor(image, cv2.COLOR_BGR2RGB))
for rect in results.hand_rects:
print(rect)Then, you will get something like:
x_center: 0.7076132893562317
y_center: 0.4579037129878998
height: 1.0035101175308228
width: 0.6690067052841187
rotation: -0.29718053340911865
x_center: 0.27738717198371887
y_center: 0.4893067479133606
height: 0.9825395941734314
width: 0.6550264358520508
rotation: 0.28020596504211426
faldisulistiawan
fawad1989
naveedkhan1998
20XYSong
RyanPaulMcKenna
Jamxscape
Hello.
I want to use the Hands Solution API Python for drawing bounding box. I already saw the solution of #1390 but that only draws the bounding box according to the palm_detections bbox coordinates, not the whole hand. The hand_rects output is not available for the Python package (as far as i know. please correct me if i'm wrong).
Is there a way for me to draw the bounding box of the whole hand using Python?
Thanks.