search

Epiphqny / VisTR

[CVPR2021 Oral] End-to-End Video Instance Segmentation with Transformers
https://arxiv.org/abs/2011.14503
Apache License 2.0
739 stars 95 forks source link

How to visualize results.json ? #60

Open AnaRhisT94 opened 3 years ago

AnaRhisT94 commented 3 years ago

I changed instances.json file to have 3 images from my own dataset. I've got the results in results.json as follows:

[
  {
    "video_id": 1,
    "score": 0.9989607930183411,
    "category_id": 1,
    "segmentations": [
      {
        "size": [
          720,
          1280
        ],
        "counts": "Q^W61_f00O2O001N101O0O10000000000000000000000000O10O1000000O100O100O100O100O2O0000000O100000000000000000000000000000000000000000001O001O1O1O1O001O000O10001O00O10O0100O01000O10O10O01O1O001O1O1O001O1O1N1O2N2L3N3M3N1O100O1O1M4L3O1O2N1O2O000O10O1000@[NV\\Oe1hc0aNT\\O`1jc0dNS\\O\\1kc0hNS\\OY1ic0h0M4O000O10000O101O00001O00O010000O11O10O01O1O010O1O1N101O1O100O10O01O100O1001R]OgMca0Y2W^OTNba0m1[^OYNaa0g1\\^O`N`a0a1\\^OeNaa0\\1Z^OkNca0V1Y^OPOda0R1X^OQOga0m2O1N2O001O2N1O2N1O1O1O1N3N1O2N5J5L4L3L4M1N2N3L3M5L4K5K5M2M3N1O2N2N2O1N3N1N2N2N1K6K5K5M3M3J6H7K6K5M2O1N2N2N2O2gCfFW;]9]DPG_;T9ZDSGc;R9UDRGi;l9O000O2O0O10000O1000001N1000000000000O10000000000000000000000000000000000O010000O10000O101O0O100000000O100000000O1000001N10000O10000O1010O0001O0010O0001O001O10O01O1O1O1O1O1O2N1O2N2N3M1O2N1O2N001O002N4L3M2N1O1O1O1O1dNTCRIm<l6UCSIl<j6WCUIj<i6XCVIh<i6ZCVIg<h6[CWIe<i6[CWIf<g6\\CXId<g6^CWIc<h6`CVIa<g6cCVI^<g6fCXIZ<e6jCYIX<d6kC[IU<c6nCZIT<e6nCXIU<f6lCXIV<h6kCUIW<j6h1O1O1N3L3L4L4M3N2Cm_OZJV`0d5<N2M3N2N2N2O1O100O1O1N2O1N2O101N1O100O1O1N2O1O1O2N1O100O2N2N2N2N2M2O2M3N1O2N2M3\\Ob]OnLeb0o2b0K4M3M2N2O1O10O0100O010O1O00100O2O2M3N3L3N1O00000O1O100O2N1O100O1O1O1O100O1O100O1O010O010O001O1O001O100O1O1O1O1O100O1O2N1O1O001O1O1O100O1O1O1O1O001O1O1O1O00100O1O1O1O1O1O001O001O00001O000000000000001O00O0100O1O1O100O100O1000000O101O00000O10000000001O000000001O1O001O1O001O001O001N101N2NZXk9"
      },
      {
        "size": [
          720,
          1280
        ],
        "counts": "QPo51_f000000000000PW40PiK00000O100O100001O00XS21flM2O001N10001O000O100000001O0000001O00001O0000001O000000000000000000000000010O001O1O1O0O2O00000000000O1000O0100O1O010O1O100O10O10O100O100O001O1O1O0O2N1O2N100O2O000O2N1N2M3N2N2O1O10001N1O2N101N2O001O1O000O2L3K4N3N2L5M2N3O0000000O010O1O20O0001O0O10000001O001O010O010O00100O01000O10000O100O100OS]OnM^a0R2]^O]NYa0c1d^ObNZa0^1c^OgN[a0Z1a^OjN]a0W1a^OmN]a0S1a^OQO]a0Q1_^OSO_a0Q3N2N1O1O001O1O2N1N2O2N1O1O2N1O2M3N3M3L4M4K4L2N3M2M5L6I;F6J7I5K4M1O2N3M2N2O1N2O1O1L3L4L5L3M4J6H9J7I9H<F4K4L2N2O1N2N2N101N10001N1000000O100000001O000O10000000001OO100000O1000000000000000000000000O10O10000000000O100000000O2O00000O10000O100000001N1000000O2O0001O001O01O01O000100O001O1O1O1O1O001O1O2N2N2N2N2N2N2N1O1O1O0O2O001O1O2N3M2N2N1O1O1O1N2O001O001O1O0gNPCQIR=k6SCSIm<j6YCSIh<j6]CRId<k6aCSI_<j6eCTI]<i6fCVIZ<h6iCVIX<h6kCUIW<j6lCQIX<m6f1N2O1O1O1N3N1N2K5L4L4L4F:N2N2O2M2O1O1N2N2M3M3N101O1O2O0O1O1N2O1N2N3N100O1O2N1N3M3M3M3M3N1N3N2L4M3A>M5L3N2N3L3O000100O10O010O1O2O0O2N2O1N3N2M4L4M1N100O101N100O2O000O00100O1O1O2N100O1O1O001O0010O01O001O1O010O1O2N1O100O2N100O1O10O01O100O1O1O100O1O1O1O00100O1O1O1O001O1O1O1O1O001O00001O00000000000O2O0000000O1O100O0010000O100000001N100000000000000000000000000000001O00001O001O1O001O1O0O2O1N2O1O1NjTi9"
      },
      {
        "size": [
          720,
          1280
        ],
        "counts": "aYn51_f000000gV40XiK3N1O1O1N2O001O0O2O000000O100000O10O1000000O1000000O1000000O10001O00000O100000001O0000001N10001Naf02]YO4M4K3N001O0O10000O100O100O010O100O100O1O10000O01000O1000O010O00O1N2N3N10001O00000O2N1N2O1O1O2O0O1O2N101N101N101O1O001O000O10001N1O2N101N1N2N3N1N2M3M3N20000O2O001N101N1O2O0000000000001O010O010O010O01O0O2O1O010000000000O100W]OiMYa0W2b^OUNWa0k1d^O`NVa0`1g^OfNVa0[1f^OjNXa0V1g^OmNWa0S1g^OROUa0P1i^OSOUa0m0i^OVOVa0j0i^OYOUa0h0e^O_OYa0n2N1O1O1O1O2N1O2N4L4L4K3N2N2N4L5J<k_OiI[?m6I4K5K3N2M2N3L4M3M4K5L5K:F3N2N2N3M1N2O1O1N1O2M2O2M2M3K6K4M4M2N3N1O2N2N1O2O0O2O1O0O2O001O0O1000000O2O000000000O2O000000001O000O100000000000000O100000000O1000000000000000000000O1SO`DjF`;V9aDiF_;V9cDiF];W9cDiF];V9eDhF\\;X9eDgF[;X9gDgFY;Y9hDfFX;Z9iDeFW;Z9lDcFU;]9lDbFT;^9mDaFT;^9lDbFT;^9kDbFV;_9iDaFX;^9hDbFX;^9fDcF[;]9eDcF\\;]9bDdF^;\\9aDeF_;[9`DeFb;[9\\DfFd;Z9[DgFe;Z9YDgFg;Y9XDhFh;P:1O0000001O1O010O1O1O1O100O1O1O1O2N2N1O2N1O2N2N1O1O1N2O1O001O1O9G1O000O1000001O0000000O2O001O1O001N101O001N100O1O1N2N2N2POfBhH\\=W7hBaH^=]7fB]H]=a7j0N2N3J5K5M3jNj@PKY?l4o@nJR?P5TAkJm>S5ZAfJh>X5Y1M3L4M4M2O1O1O1O1O1O1O2M2O1O2N100O2N1O1O2L4M2dNP^OUNTb0h1o]OTNUb0j1m]OSNVb0k1l]OSNVb0l1j]OSNWb0m1j]OQNXb0o1h]OnMZb0R2h]ObMcb0^2g00100O010O10O100O00100O1O010O0100O2O0O2O1O3M3L5K4M2M3N1N2O1N2O0O100O10O0100O2N10000O100O00100O1O1O1O10O01O1O1O100O001O1O010O1O1O1O100O1O1O1O1O1O100O001O100O1O1O100O1O001O1O00001O001O01O000001O000001O00000000O10000O1O1O100O100O100O10000O1000000000000O0100000000001O000000001O000001OO2O00000000001O00000O4M4Klmd9"
      }
    ]
  }
]

Question: How can I visualize these results on my images?

Epiphqny commented 3 years ago

Hi @AnaRhisT94 , you could refer to coco rle format decoding, https://github.com/cocodataset/cocoapi/blob/master/PythonAPI/pycocotools/mask.py

AnaRhisT94 commented 3 years ago

Hi @AnaRhisT94 , you could refer to coco rle format decoding, https://github.com/cocodataset/cocoapi/blob/master/PythonAPI/pycocotools/mask.py

I see, I will try and update, and what tools should I use for visualization? I think decetron2 has one

Epiphqny commented 3 years ago

@AnaRhisT94 Use any tool as you like.

qzsrh commented 2 years ago

I changed instances.json file to have 3 images from my own dataset. I've got the results in results.json as follows:

[
  {
    "video_id": 1,
    "score": 0.9989607930183411,
    "category_id": 1,
    "segmentations": [
      {
        "size": [
          720,
          1280
        ],
        "counts": "Q^W61_f00O2O001N101O0O10000000000000000000000000O10O1000000O100O100O100O100O2O0000000O100000000000000000000000000000000000000000001O001O1O1O1O001O000O10001O00O10O0100O01000O10O10O01O1O001O1O1O001O1O1N1O2N2L3N3M3N1O100O1O1M4L3O1O2N1O2O000O10O1000@[NV\\Oe1hc0aNT\\O`1jc0dNS\\O\\1kc0hNS\\OY1ic0h0M4O000O10000O101O00001O00O010000O11O10O01O1O010O1O1N101O1O100O10O01O100O1001R]OgMca0Y2W^OTNba0m1[^OYNaa0g1\\^O`N`a0a1\\^OeNaa0\\1Z^OkNca0V1Y^OPOda0R1X^OQOga0m2O1N2O001O2N1O2N1O1O1O1N3N1O2N5J5L4L3L4M1N2N3L3M5L4K5K5M2M3N1O2N2N2O1N3N1N2N2N1K6K5K5M3M3J6H7K6K5M2O1N2N2N2O2gCfFW;]9]DPG_;T9ZDSGc;R9UDRGi;l9O000O2O0O10000O1000001N1000000000000O10000000000000000000000000000000000O010000O10000O101O0O100000000O100000000O1000001N10000O10000O1010O0001O0010O0001O001O10O01O1O1O1O1O1O2N1O2N2N3M1O2N1O2N001O002N4L3M2N1O1O1O1O1dNTCRIm<l6UCSIl<j6WCUIj<i6XCVIh<i6ZCVIg<h6[CWIe<i6[CWIf<g6\\CXId<g6^CWIc<h6`CVIa<g6cCVI^<g6fCXIZ<e6jCYIX<d6kC[IU<c6nCZIT<e6nCXIU<f6lCXIV<h6kCUIW<j6h1O1O1N3L3L4L4M3N2Cm_OZJV`0d5<N2M3N2N2N2O1O100O1O1N2O1N2O101N1O100O1O1N2O1O1O2N1O100O2N2N2N2N2M2O2M3N1O2N2M3\\Ob]OnLeb0o2b0K4M3M2N2O1O10O0100O010O1O00100O2O2M3N3L3N1O00000O1O100O2N1O100O1O1O1O100O1O100O1O010O010O001O1O001O100O1O1O1O1O100O1O2N1O1O001O1O1O100O1O1O1O1O001O1O1O1O00100O1O1O1O1O1O001O001O00001O000000000000001O00O0100O1O1O100O100O1000000O101O00000O10000000001O000000001O1O001O1O001O001O001N101N2NZXk9"
      },
      {
        "size": [
          720,
          1280
        ],
        "counts": "QPo51_f000000000000PW40PiK00000O100O100001O00XS21flM2O001N10001O000O100000001O0000001O00001O0000001O000000000000000000000000010O001O1O1O0O2O00000000000O1000O0100O1O010O1O100O10O10O100O100O001O1O1O0O2N1O2N100O2O000O2N1N2M3N2N2O1O10001N1O2N101N2O001O1O000O2L3K4N3N2L5M2N3O0000000O010O1O20O0001O0O10000001O001O010O010O00100O01000O10000O100O100OS]OnM^a0R2]^O]NYa0c1d^ObNZa0^1c^OgN[a0Z1a^OjN]a0W1a^OmN]a0S1a^OQO]a0Q1_^OSO_a0Q3N2N1O1O001O1O2N1N2O2N1O1O2N1O2M3N3M3L4M4K4L2N3M2M5L6I;F6J7I5K4M1O2N3M2N2O1N2O1O1L3L4L5L3M4J6H9J7I9H<F4K4L2N2O1N2N2N101N10001N1000000O100000001O000O10000000001OO100000O1000000000000000000000000O10O10000000000O100000000O2O00000O10000O100000001N1000000O2O0001O001O01O01O000100O001O1O1O1O1O001O1O2N2N2N2N2N2N2N1O1O1O0O2O001O1O2N3M2N2N1O1O1O1N2O001O001O1O0gNPCQIR=k6SCSIm<j6YCSIh<j6]CRId<k6aCSI_<j6eCTI]<i6fCVIZ<h6iCVIX<h6kCUIW<j6lCQIX<m6f1N2O1O1O1N3N1N2K5L4L4L4F:N2N2O2M2O1O1N2N2M3M3N101O1O2O0O1O1N2O1N2N3N100O1O2N1N3M3M3M3M3N1N3N2L4M3A>M5L3N2N3L3O000100O10O010O1O2O0O2N2O1N3N2M4L4M1N100O101N100O2O000O00100O1O1O2N100O1O1O001O0010O01O001O1O010O1O2N1O100O2N100O1O10O01O100O1O1O100O1O1O1O00100O1O1O1O001O1O1O1O1O001O00001O00000000000O2O0000000O1O100O0010000O100000001N100000000000000000000000000000001O00001O001O1O001O1O0O2O1N2O1O1NjTi9"
      },
      {
        "size": [
          720,
          1280
        ],
        "counts": "aYn51_f000000gV40XiK3N1O1O1N2O001O0O2O000000O100000O10O1000000O1000000O1000000O10001O00000O100000001O0000001N10001Naf02]YO4M4K3N001O0O10000O100O100O010O100O100O1O10000O01000O1000O010O00O1N2N3N10001O00000O2N1N2O1O1O2O0O1O2N101N101N101O1O001O000O10001N1O2N101N1N2N3N1N2M3M3N20000O2O001N101N1O2O0000000000001O010O010O010O01O0O2O1O010000000000O100W]OiMYa0W2b^OUNWa0k1d^O`NVa0`1g^OfNVa0[1f^OjNXa0V1g^OmNWa0S1g^OROUa0P1i^OSOUa0m0i^OVOVa0j0i^OYOUa0h0e^O_OYa0n2N1O1O1O1O2N1O2N4L4L4K3N2N2N4L5J<k_OiI[?m6I4K5K3N2M2N3L4M3M4K5L5K:F3N2N2N3M1N2O1O1N1O2M2O2M2M3K6K4M4M2N3N1O2N2N1O2O0O2O1O0O2O001O0O1000000O2O000000000O2O000000001O000O100000000000000O100000000O1000000000000000000000O1SO`DjF`;V9aDiF_;V9cDiF];W9cDiF];V9eDhF\\;X9eDgF[;X9gDgFY;Y9hDfFX;Z9iDeFW;Z9lDcFU;]9lDbFT;^9mDaFT;^9lDbFT;^9kDbFV;_9iDaFX;^9hDbFX;^9fDcF[;]9eDcF\\;]9bDdF^;\\9aDeF_;[9`DeFb;[9\\DfFd;Z9[DgFe;Z9YDgFg;Y9XDhFh;P:1O0000001O1O010O1O1O1O100O1O1O1O2N2N1O2N1O2N2N1O1O1N2O1O001O1O9G1O000O1000001O0000000O2O001O1O001N101O001N100O1O1N2N2N2POfBhH\\=W7hBaH^=]7fB]H]=a7j0N2N3J5K5M3jNj@PKY?l4o@nJR?P5TAkJm>S5ZAfJh>X5Y1M3L4M4M2O1O1O1O1O1O1O2M2O1O2N100O2N1O1O2L4M2dNP^OUNTb0h1o]OTNUb0j1m]OSNVb0k1l]OSNVb0l1j]OSNWb0m1j]OQNXb0o1h]OnMZb0R2h]ObMcb0^2g00100O010O10O100O00100O1O010O0100O2O0O2O1O3M3L5K4M2M3N1N2O1N2O0O100O10O0100O2N10000O100O00100O1O1O1O10O01O1O1O100O001O1O010O1O1O1O100O1O1O1O1O1O100O001O100O1O1O100O1O001O1O00001O001O01O000001O000001O00000000O10000O1O1O100O100O100O10000O1000000000000O0100000000001O000000001O000001OO2O00000000001O00000O4M4Klmd9"
      }
    ]
  }
]

Question: How can I visualize these results on my images?

Hello! Have you addressed it? I met the same problem.