search

facebookresearch / PyTouch

PyTouch is a machine learning library for tactile touch sensing.
MIT License
235 stars 37 forks source link

3 issues #29

Closed vocdex closed 2 years ago

vocdex commented 2 years ago

Thank you for the code. 1.I am trying to use the touch_detect.py in pytouch/examples/ folder. However, it cannot download the model from AWS cloud because of this: Ipytouch.models.zoo.PyTouchZooModelNotFound: cannot find model touchdetect_resnet18_DigitSensor.pth I had no problem to download the models for surface3d.py example. Is it possible that the model resnet18 was deleted or the name has changed?

  1. Is it possible to use surface3d.py in real-time? Currently, in surface3d.py, the 3d reconstructions are created by existing files in dataset. I want to get real-time image input from DIGIT and plot the surface3d in real-time too
  2. In examples/configs/digit_surface3d.yaml file, the gel width and gel_height are given as follows: gel_width: 0.02 # gel width (y-axis) in meters gel_height: 0.03 # gel height (x-axis) in meters Assuming it is a DIGIT sensor, should not the gel width be 0.015 and gel_height 0.02? I measured both with a caliper. Did you guys have different DIGIT sensor or am I missing something here?
hmcty commented 2 years ago

Running into issue 1 as well, any updates?

vocdex commented 2 years ago

No updates, so far. Hope the authors can take a look on these issues

AlphaBetaPhi commented 2 years ago

Hi all,

We are working on releasing a new update to address these issues and provide examples that work without modification. These were initially provided as reference examples demonstrating how to use the framework.

AlphaBetaPhi commented 2 years ago

Hi @vocdex,

The 3d surface can be reconstructed in real time for sensor output as well as TACTO output. We will provide an example on how to do this. In general, the output from the sensors is provided as a stream of sequential images to the input of the 3d surface task.

For the gel height, we measure this from the molds used to produce the gels. Can you confirm where these devices (gels) were obtained from?