search

MzeroMiko / VMamba

VMamba: Visual State Space Models，code is based on mamba
MIT License
1.83k stars 100 forks source link

Replace the decoder with Mask2former #155

Open Zoulinx opened 2 months ago

Zoulinx commented 2 months ago

After replacing upernet with mask2former in the swin_b, the IOU increased to 52.44. I then tried doing same thing to vmamba_b, but only achieved a score of 47.62. Here are my results: +---------------------+-------+-------+ | Class | IoU | Acc | +---------------------+-------+-------+ | wall | 76.96 | 86.46 | | building | 80.66 | 89.82 | | sky | 94.41 | 97.14 | | floor | 82.02 | 88.11 | | tree | 75.13 | 87.3 | | ceiling | 84.18 | 91.38 | | road | 84.62 | 90.37 | | bed | 89.18 | 94.27 | | windowpane | 60.06 | 77.45 | | grass | 62.51 | 73.79 | | cabinet | 60.44 | 71.36 | | sidewalk | 66.46 | 81.97 | | person | 81.57 | 89.2 | | earth | 36.43 | 47.83 | | door | 42.99 | 57.81 | | table | 61.35 | 74.59 | | mountain | 58.36 | 71.07 | | plant | 55.06 | 69.42 | | curtain | 77.14 | 86.39 | | chair | 52.48 | 66.29 | | car | 85.15 | 92.39 | | water | 45.14 | 65.53 | | painting | 64.92 | 80.32 | | sofa | 58.83 | 67.72 | | shelf | 37.73 | 55.45 | | house | 38.67 | 69.82 | | sea | 48.77 | 75.83 | | mirror | 61.14 | 80.61 | | rug | 65.38 | 83.26 | | field | 30.89 | 70.06 | | armchair | 38.64 | 69.51 | | seat | 60.18 | 75.92 | | fence | 41.77 | 58.93 | | desk | 42.02 | 63.34 | | rock | 46.25 | 75.14 | | wardrobe | 51.05 | 71.49 | | lamp | 62.92 | 75.23 | | bathtub | 66.15 | 81.88 | | railing | 33.77 | 56.73 | | cushion | 57.65 | 74.04 | | base | 33.49 | 50.75 | | box | 27.38 | 42.02 | | column | 45.57 | 55.94 | | signboard | 36.04 | 48.37 | | chest of drawers | 38.35 | 73.68 | | counter | 40.26 | 46.87 | | sand | 39.35 | 59.54 | | sink | 70.8 | 81.07 | | skyscraper | 39.95 | 45.69 | | fireplace | 73.58 | 91.29 | | refrigerator | 72.53 | 88.35 | | grandstand | 37.31 | 56.56 | | path | 24.23 | 36.76 | | stairs | 41.32 | 51.18 | | runway | 71.33 | 95.66 | | case | 63.74 | 82.95 | | pool table | 93.05 | 96.53 | | pillow | 55.34 | 65.47 | | screen door | 63.42 | 84.09 | | stairway | 25.26 | 34.42 | | river | 10.35 | 11.83 | | bridge | 65.83 | 76.07 | | bookcase | 28.82 | 46.4 | | blind | 46.69 | 51.38 | | coffee table | 60.76 | 84.52 | | toilet | 84.99 | 91.6 | | flower | 36.55 | 52.37 | | book | 49.76 | 70.49 | | hill | 11.73 | 17.03 | | bench | 39.88 | 59.15 | | countertop | 50.22 | 65.88 | | stove | 70.72 | 83.37 | | palm | 48.03 | 73.07 | | kitchen island | 43.88 | 87.46 | | computer | 72.3 | 86.4 | | swivel chair | 39.33 | 66.94 | | boat | 40.57 | 54.92 | | bar | 41.66 | 55.45 | | arcade machine | 52.22 | 64.24 | | hovel | 32.92 | 52.56 | | bus | 91.82 | 95.97 | | towel | 71.55 | 83.41 | | light | 55.67 | 69.01 | | truck | 33.74 | 57.89 | | tower | 29.45 | 49.09 | | chandelier | 61.56 | 74.78 | | awning | 32.18 | 45.75 | | streetlight | 29.29 | 45.64 | | booth | 34.11 | 37.55 | | television receiver | 71.95 | 88.11 | | airplane | 60.6 | 69.31 | | dirt track | 0.0 | 0.0 | | apparel | 29.76 | 54.4 | | pole | 22.83 | 36.64 | | land | 3.79 | 6.26 | | bannister | 14.32 | 23.71 | | escalator | 53.68 | 70.57 | | ottoman | 42.5 | 56.1 | | bottle | 29.87 | 42.3 | | buffet | 37.64 | 47.95 | | poster | 19.15 | 47.75 | | stage | 6.9 | 15.72 | | van | 40.41 | 55.37 | | ship | 60.29 | 88.41 | | fountain | 21.71 | 26.05 | | conveyer belt | 58.11 | 93.2 | | canopy | 12.97 | 29.72 | | washer | 76.98 | 81.8 | | plaything | 21.53 | 29.21 | | swimming pool | 30.58 | 44.27 | | stool | 38.88 | 67.28 | | barrel | 49.27 | 64.88 | | basket | 29.51 | 47.52 | | waterfall | 60.48 | 82.95 | | tent | 89.72 | 97.99 | | bag | 17.53 | 24.58 | | minibike | 73.19 | 85.13 | | cradle | 83.46 | 96.55 | | oven | 30.54 | 38.61 | | ball | 30.34 | 75.25 | | food | 60.65 | 71.56 | | step | 10.25 | 17.51 | | tank | 23.17 | 36.1 | | trade name | 35.32 | 52.77 | | microwave | 79.6 | 91.51 | | pot | 32.38 | 37.26 | | animal | 68.54 | 72.91 | | bicycle | 58.11 | 80.61 | | lake | 0.0 | 0.0 | | dishwasher | 71.45 | 83.15 | | screen | 32.9 | 60.23 | | blanket | 27.43 | 42.28 | | sculpture | 63.06 | 80.47 | | hood | 53.75 | 66.68 | | sconce | 43.0 | 55.22 | | vase | 41.37 | 70.89 | | traffic light | 31.93 | 62.17 | | tray | 12.75 | 19.5 | | ashcan | 42.6 | 63.67 | | fan | 55.94 | 78.61 | | pier | 30.06 | 42.44 | | crt screen | 3.32 | 11.3 | | plate | 54.44 | 70.86 | | monitor | 8.86 | 13.75 | | bulletin board | 37.66 | 54.42 | | shower | 14.51 | 22.64 | | radiator | 60.66 | 74.02 | | glass | 20.58 | 26.36 | | clock | 28.69 | 39.91 | | flag | 44.3 | 52.22 | +---------------------+-------+-------+ 04/18 07:34:30 - mmengine - INFO - Iter(val) [2000/2000] aAcc: 82.0800 mIoU: 47.6200 mAcc: 62.4800

MzeroMiko commented 2 months ago

Thank you for sharing your result, we may check this in the future.