search

gaopengcuhk / Stable-Pix2Seq

A full-fledged version of Pix2Seq
Apache License 2.0
235 stars 20 forks source link

About the details of the code #8

Closed hcy226 closed 2 years ago

hcy226 commented 2 years ago

What's the usage of weight[1998]=0.01 and weight[2000]=0.01？ I want to extend the code to the Panoptic Segmentation and wonder how to modify it

gaopengcuhk commented 2 years ago

1998 and 2000 is EOS and N/A token defined in Pix2Seq. To better balance the loss, we set EOS and N/A tokens with a smaller weight. This is not mentioned in Pix2Seq. I am not sure this is the best practice or not.