roahmlab / terrain_friction_dataset

5 stars 0 forks source link

Accessibility to Training Data #1

Open Daisy-GENG opened 1 year ago

Daisy-GENG commented 1 year ago

Hi, thanks for your amazing work!

I noticed that there is only the friction label and the corresponding rgb image in this repo. Is it possible to offer the whole dataset, including training, validation as well as test sequences?

Thanks in advance.

Best regards, Daisy

ParkerEwen5441 commented 1 year ago

Hi Daisy,

This dataset was only used to estimate a probabilistic model of the friction for each terrain class. The RGB image is used to indicate the type of terrain class corresponding to each label but is not used during model generation.

In our paper we mention that we use a Gaussian distribution to model the friction of each terrain class and use this dataset to compute the mean and variance of the distribution.

If you have any other questions I'd be happy to answer them!

Cheers, Parker

On Thu, Mar 30, 2023, 2:18 AM Daisy-GENG @.***> wrote:

Hi, thanks for your amazing work!

I noticed that there is only the friction label and the corresponding rgb image in this repo. Is it possible to offer the whole dataset, including training, validation as well as test sequences?

Thanks in advance.

Best regards, Daisy

— Reply to this email directly, view it on GitHub https://github.com/roahmlab/terrain_friction_dataset/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALQLUDTEJBOH5PAYA3OW64LW6UQRTANCNFSM6AAAAAAWMZ77FI . You are receiving this because you are subscribed to this thread.Message ID: @.***>

Daisy-GENG commented 1 year ago

Hi Parker,

Thanks for your answer. I am afraid that I have not made myself clear. I want to know how you get the rgbd training data for terrain type segmentation intead of terrain property estimation. Is it possible for you to publicize the raw rgbd images as well as their terrain type semantic labels.

Another question is that how you make sure that your acceleartion is 0 when measuring the pulling force, because it seems that you assume that pulling force is equivalent to the friction force in the paper. And how you make sure that the pulling force is horizontal which is vertical to the gravity direction? It will be very nice if you can offer an experiment setup picture.

Thank you so much!

Best, Daisy

ParkerEwen5441 commented 1 year ago

Hi Daisy,

For the terrain segmentation we used this work: https://github.com/CSAILVision/semantic-segmentation-pytorch

The dataset used to train the semantic segmentation network is provided in this repo and we relabel some of the classes (ie. Road->concrete) for our purposes. You can also change the semantic segmentation network used to one you are more familiar with. I hope this helps!

Cheers, Parker

On Thu, Mar 30, 2023, 9:11 AM Daisy-GENG @.***> wrote:

Hi Parker,

Thanks for your answer. I am afraid that I have not made myself clear. I want to know how you get the rgbd training data for terrain type segmentation intead of terrain property estimation. Is it possible for you to publicize the raw rgbd images as well as their terrain type semantic labels.

Another question is that how you make sure that your acceleartion is 0 when measuring the pulling force, because it seems that you assume that pulling force is equivalent to the friction force in the paper. And how you make sure that the pulling force is horizontal which is vertical to the gravity direction? It will be very nice if you can offer an experiment setup picture.

Thank you so much!

Best, Daisy

— Reply to this email directly, view it on GitHub https://github.com/roahmlab/terrain_friction_dataset/issues/1#issuecomment-1490280370, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALQLUDRC2XIGZC4EY6KUO6LW6WBATANCNFSM6AAAAAAWMZ77FI . You are receiving this because you commented.Message ID: @.***>

ParkerEwen5441 commented 1 year ago

I can send an experiment setup image later today

On Thu, Mar 30, 2023, 9:11 AM Daisy-GENG @.***> wrote:

Hi Parker,

Thanks for your answer. I am afraid that I have not made myself clear. I want to know how you get the rgbd training data for terrain type segmentation intead of terrain property estimation. Is it possible for you to publicize the raw rgbd images as well as their terrain type semantic labels.

Another question is that how you make sure that your acceleartion is 0 when measuring the pulling force, because it seems that you assume that pulling force is equivalent to the friction force in the paper. And how you make sure that the pulling force is horizontal which is vertical to the gravity direction? It will be very nice if you can offer an experiment setup picture.

Thank you so much!

Best, Daisy

— Reply to this email directly, view it on GitHub https://github.com/roahmlab/terrain_friction_dataset/issues/1#issuecomment-1490280370, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALQLUDRC2XIGZC4EY6KUO6LW6WBATANCNFSM6AAAAAAWMZ77FI . You are receiving this because you commented.Message ID: @.***>

Daisy-GENG commented 1 year ago

Thank you so much for your detailed answer!

Best, Daisy

Daisy-GENG commented 1 year ago

Hi, is it possible for you to send me an image of your experiment setup? My email is rgengaa@connect.ust.hk

Thanks a lot!

Best, Daisy

zhj3180 commented 4 months ago

Hello, I recently read your paper and would like to try replicating the experiment. Could you please send me an image of the experiment setup? Thank you very much for your help. hjzhang0831@bit.edu.cn

ParkerEwen5441 commented 4 months ago

Hi zhj3180! I've attached a picture of the experimental setup. We used a weighted device with a rubber pad on the bottom (same material as the rubber feet of legged robots, shown in blue) and attached a strain gauge to the top (shown in red). We pulled this device across the surfaces and measured the force of the strain gauge and used the mass of the weighted device device to compute the coefficient of friction.

While its quite rudimentary, we recently validated the friction measurements from this experimental setup using a more accurate force-torque sensor and found them to be approximately the same.

friction

zhj3180 commented 4 months ago

thanks a lot for your help!