search

orthanc-server / orthanc-explorer-2

New UI for Orthanc
GNU Affero General Public License v3.0
45 stars 31 forks source link

"Loading most recent studies" is very slow compared to searching #66

Open gdevenyi opened 2 months ago

gdevenyi commented 2 months ago

I have a common set of text in all of my "Study Descriptions" that I can type and near-instantly all the studies show up.

Meanwhile, if I clear the search and let the UI perform the default most recent studies loading it takes almost a 1 minute to load the 19 studies currently indexed.

amazy commented 2 months ago

Yes, that is a "known issue" because we get the most recent studies by cycling through the /changes API and this can take a lot of time if you have deleted a lot of studies in the past.

This will be solved when we finish optimizing the DB but this can still take a few months before we release it ...

gdevenyi commented 2 months ago

a lot of time if you have deleted a lot of studies in the past.

Good to know, but a followup, this is a fresh install with < 30 studies and nothing deleted.

amazy commented 2 months ago

That is weird ... could you check the timings in the "network" dev-tools ? This is what it looks like on my PC: image

gdevenyi commented 2 months ago

Huge amounts of repeating calls to changes? image

Pages and pages and pages

amazy commented 2 months ago

This is exactly the problem I described: lots of changes in the DB but the changes with the "NewStudy" have been recorded a long time ago and therefore it takes a lot of call to /changes to find them ...

gdevenyi commented 2 months ago

Interesting.

This deployment is new, its been up for 2 weeks.

The oldest DICOMs in the directory are: Aug 1 14:52

There are 57 studies, with the most recent one yesterday.

So some definite badness going on in the DB.

amazy commented 2 months ago

What is the content of http://localhost:8042/changes?limit=10 ?

gdevenyi commented 2 months ago 
{
   "Changes" : [
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240812T194204",
         "ID" : "ef4e7ae0-0d2a5440-9cd5d4ac-0c2eeab1-bbe016fe",
         "Path" : "/instances/ef4e7ae0-0d2a5440-9cd5d4ac-0c2eeab1-bbe016fe",
         "ResourceType" : "Instance",
         "Seq" : 1
      },
      {
         "ChangeType" : "NewSeries",
         "Date" : "20240812T194204",
         "ID" : "4635dc53-f59b59eb-e400e1de-88b0a13f-b1708c02",
         "Path" : "/series/4635dc53-f59b59eb-e400e1de-88b0a13f-b1708c02",
         "ResourceType" : "Series",
         "Seq" : 2
      },
      {
         "ChangeType" : "NewStudy",
         "Date" : "20240812T194204",
         "ID" : "fa070b88-8e2692ab-55581f82-fe0072a6-4ef86fb8",
         "Path" : "/studies/fa070b88-8e2692ab-55581f82-fe0072a6-4ef86fb8",
         "ResourceType" : "Study",
         "Seq" : 3
      },
      {
         "ChangeType" : "NewPatient",
         "Date" : "20240812T194204",
         "ID" : "24adeafe-161fb993-64a81301-e37b371c-b3470898",
         "Path" : "/patients/24adeafe-161fb993-64a81301-e37b371c-b3470898",
         "ResourceType" : "Patient",
         "Seq" : 4
      },
      {
         "ChangeType" : "UpdatedMetadata",
         "Date" : "20240812T194204",
         "ID" : "ef4e7ae0-0d2a5440-9cd5d4ac-0c2eeab1-bbe016fe",
         "Path" : "/instances/ef4e7ae0-0d2a5440-9cd5d4ac-0c2eeab1-bbe016fe",
         "ResourceType" : "Instance",
         "Seq" : 5
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240812T194204",
         "ID" : "38adcbbd-d1c4a55d-f376362c-13e12f87-808f8ab1",
         "Path" : "/instances/38adcbbd-d1c4a55d-f376362c-13e12f87-808f8ab1",
         "ResourceType" : "Instance",
         "Seq" : 6
      },
      {
         "ChangeType" : "NewSeries",
         "Date" : "20240812T194204",
         "ID" : "631b4286-1d704382-290549c9-8e744d81-786759ac",
         "Path" : "/series/631b4286-1d704382-290549c9-8e744d81-786759ac",
         "ResourceType" : "Series",
         "Seq" : 7
      },
      {
         "ChangeType" : "UpdatedMetadata",
         "Date" : "20240812T194204",
         "ID" : "38adcbbd-d1c4a55d-f376362c-13e12f87-808f8ab1",
         "Path" : "/instances/38adcbbd-d1c4a55d-f376362c-13e12f87-808f8ab1",
         "ResourceType" : "Instance",
         "Seq" : 8
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240812T194204",
         "ID" : "3d226644-0834e9c1-0fc8f283-aae898cd-30188c65",
         "Path" : "/instances/3d226644-0834e9c1-0fc8f283-aae898cd-30188c65",
         "ResourceType" : "Instance",
         "Seq" : 9
      },
      {
         "ChangeType" : "NewSeries",
         "Date" : "20240812T194204",
         "ID" : "72cf3563-b69470de-b17b4395-95161afd-ca2766f3",
         "Path" : "/series/72cf3563-b69470de-b17b4395-95161afd-ca2766f3",
         "ResourceType" : "Series",
         "Seq" : 10
      }
   ],
   "Done" : false,
   "Last" : 10
}
amazy commented 2 months ago

Sorry, wrong direction ... Could you check http://localhost:8042/changes?last and then, http://localhost:8042/changes?since=... where ... is the value of "Last" from previous call minus e.g 100 or more if you don't get any changes ...

Note that, if you don't get any changes, this means that the changes have been deleted and changes are deleted when the related resources are deleted ....

gdevenyi commented 2 months ago

?last

{
   "Changes" : [
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180102",
         "ID" : "47c87ac8-dbc2327c-45054690-6732c078-cc8838a2",
         "Path" : "/series/47c87ac8-dbc2327c-45054690-6732c078-cc8838a2",
         "ResourceType" : "Series",
         "Seq" : 906741
      }
   ],
   "Done" : true,
   "Last" : 906741
}

since 906741 - 100 = 906641

{
   "Changes" : [
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175954",
         "ID" : "9145d3f9-68a3201b-5a90c198-ba37b113-6263612d",
         "Path" : "/instances/9145d3f9-68a3201b-5a90c198-ba37b113-6263612d",
         "ResourceType" : "Instance",
         "Seq" : 906642
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175954",
         "ID" : "20d9b941-ffb4a5f8-cded6fde-aeb04ea3-a40e2ba1",
         "Path" : "/instances/20d9b941-ffb4a5f8-cded6fde-aeb04ea3-a40e2ba1",
         "ResourceType" : "Instance",
         "Seq" : 906643
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175954",
         "ID" : "cc74a1e7-69f916a0-8cee21a6-517011da-ce421d67",
         "Path" : "/instances/cc74a1e7-69f916a0-8cee21a6-517011da-ce421d67",
         "ResourceType" : "Instance",
         "Seq" : 906644
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175954",
         "ID" : "f05ba130-022e88e0-61d56729-475b717d-d485ab38",
         "Path" : "/instances/f05ba130-022e88e0-61d56729-475b717d-d485ab38",
         "ResourceType" : "Instance",
         "Seq" : 906645
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175954",
         "ID" : "c448b66b-4248f39d-6ea069b4-f6623cae-c85d9d39",
         "Path" : "/instances/c448b66b-4248f39d-6ea069b4-f6623cae-c85d9d39",
         "ResourceType" : "Instance",
         "Seq" : 906646
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175954",
         "ID" : "09684344-464d3e0d-29e6b044-e6858fab-359a1673",
         "Path" : "/instances/09684344-464d3e0d-29e6b044-e6858fab-359a1673",
         "ResourceType" : "Instance",
         "Seq" : 906647
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175954",
         "ID" : "735c2676-618f3cdf-15069523-c8691b47-0513ed2a",
         "Path" : "/instances/735c2676-618f3cdf-15069523-c8691b47-0513ed2a",
         "ResourceType" : "Instance",
         "Seq" : 906648
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175954",
         "ID" : "092ac557-4d105b65-caf97439-c0125c05-106c919f",
         "Path" : "/instances/092ac557-4d105b65-caf97439-c0125c05-106c919f",
         "ResourceType" : "Instance",
         "Seq" : 906649
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "eb28cdd1-dfad0b71-738066cc-8f3dc87b-afb9edc4",
         "Path" : "/instances/eb28cdd1-dfad0b71-738066cc-8f3dc87b-afb9edc4",
         "ResourceType" : "Instance",
         "Seq" : 906650
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "bf1cdba7-419826be-e5b325fc-8c44d8e1-c44d6bff",
         "Path" : "/instances/bf1cdba7-419826be-e5b325fc-8c44d8e1-c44d6bff",
         "ResourceType" : "Instance",
         "Seq" : 906651
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "8013be4e-8c5dd5db-aac4e2eb-c8c167bc-9980deef",
         "Path" : "/instances/8013be4e-8c5dd5db-aac4e2eb-c8c167bc-9980deef",
         "ResourceType" : "Instance",
         "Seq" : 906652
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "4f2290a0-76c94d4c-8f38ba0f-25e05f39-e0eb3e19",
         "Path" : "/instances/4f2290a0-76c94d4c-8f38ba0f-25e05f39-e0eb3e19",
         "ResourceType" : "Instance",
         "Seq" : 906653
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "2068e47c-e1449842-ecccfa37-f1fe8af9-fefa5177",
         "Path" : "/instances/2068e47c-e1449842-ecccfa37-f1fe8af9-fefa5177",
         "ResourceType" : "Instance",
         "Seq" : 906654
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "1ee4274c-2ca2d6a7-42f57f05-190d2356-8a1c0b0e",
         "Path" : "/instances/1ee4274c-2ca2d6a7-42f57f05-190d2356-8a1c0b0e",
         "ResourceType" : "Instance",
         "Seq" : 906655
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "c36384f5-0e4c5173-fde3b79b-72b5e7f4-08b04e90",
         "Path" : "/instances/c36384f5-0e4c5173-fde3b79b-72b5e7f4-08b04e90",
         "ResourceType" : "Instance",
         "Seq" : 906656
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "f980bff7-94c9c053-86f60319-7b57234f-e34cf4e5",
         "Path" : "/instances/f980bff7-94c9c053-86f60319-7b57234f-e34cf4e5",
         "ResourceType" : "Instance",
         "Seq" : 906657
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "466eb0b8-c90c973a-8b4195d8-72aa2068-2a7fa11a",
         "Path" : "/instances/466eb0b8-c90c973a-8b4195d8-72aa2068-2a7fa11a",
         "ResourceType" : "Instance",
         "Seq" : 906658
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "57c4af6a-7c6ec009-4f95fa6d-c31f7633-8cb76fd4",
         "Path" : "/instances/57c4af6a-7c6ec009-4f95fa6d-c31f7633-8cb76fd4",
         "ResourceType" : "Instance",
         "Seq" : 906659
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "3ab366a7-c450849e-a553abf5-217527f1-576d1a81",
         "Path" : "/instances/3ab366a7-c450849e-a553abf5-217527f1-576d1a81",
         "ResourceType" : "Instance",
         "Seq" : 906660
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "91525002-ece6bfeb-a5a7a4dc-a2a34720-5960966a",
         "Path" : "/instances/91525002-ece6bfeb-a5a7a4dc-a2a34720-5960966a",
         "ResourceType" : "Instance",
         "Seq" : 906661
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "ca7593a7-a05149d1-ccc5499b-da386ada-70b76ed5",
         "Path" : "/instances/ca7593a7-a05149d1-ccc5499b-da386ada-70b76ed5",
         "ResourceType" : "Instance",
         "Seq" : 906662
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "ff7e62b8-737efcc0-97370f02-5a173d13-1447819f",
         "Path" : "/instances/ff7e62b8-737efcc0-97370f02-5a173d13-1447819f",
         "ResourceType" : "Instance",
         "Seq" : 906663
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "a01a7f5f-30d4147e-27ee6c97-aabfe727-4e0b81db",
         "Path" : "/instances/a01a7f5f-30d4147e-27ee6c97-aabfe727-4e0b81db",
         "ResourceType" : "Instance",
         "Seq" : 906664
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "a7564dc4-879560db-2a551f48-07c3239d-8392f1a1",
         "Path" : "/instances/a7564dc4-879560db-2a551f48-07c3239d-8392f1a1",
         "ResourceType" : "Instance",
         "Seq" : 906665
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "2e2a0d57-450b59fe-bfd96ee1-a2ca7474-fb1b5f04",
         "Path" : "/instances/2e2a0d57-450b59fe-bfd96ee1-a2ca7474-fb1b5f04",
         "ResourceType" : "Instance",
         "Seq" : 906666
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "3fd91841-2499aec6-fc59d06d-90d8ba8e-8f0a92b6",
         "Path" : "/instances/3fd91841-2499aec6-fc59d06d-90d8ba8e-8f0a92b6",
         "ResourceType" : "Instance",
         "Seq" : 906667
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "41ec79ff-b49d61bd-337583d7-0da26c81-f6f292dc",
         "Path" : "/instances/41ec79ff-b49d61bd-337583d7-0da26c81-f6f292dc",
         "ResourceType" : "Instance",
         "Seq" : 906668
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "5fdeffdb-c0f96b91-594f2e66-f95ff126-c84b8d80",
         "Path" : "/instances/5fdeffdb-c0f96b91-594f2e66-f95ff126-c84b8d80",
         "ResourceType" : "Instance",
         "Seq" : 906669
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "226a8334-f22d2d37-c16c7b3c-6f4d859c-0ed3c346",
         "Path" : "/instances/226a8334-f22d2d37-c16c7b3c-6f4d859c-0ed3c346",
         "ResourceType" : "Instance",
         "Seq" : 906670
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "62b48a0c-55a3d3b9-eab1fde7-b9d2d73c-cd7864bd",
         "Path" : "/instances/62b48a0c-55a3d3b9-eab1fde7-b9d2d73c-cd7864bd",
         "ResourceType" : "Instance",
         "Seq" : 906671
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "b92d7184-11735b29-b676cee5-758750e9-2ea4fcf5",
         "Path" : "/instances/b92d7184-11735b29-b676cee5-758750e9-2ea4fcf5",
         "ResourceType" : "Instance",
         "Seq" : 906672
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "6e65d0c7-9aa86829-a2231920-f2fd3b7c-616ecddc",
         "Path" : "/instances/6e65d0c7-9aa86829-a2231920-f2fd3b7c-616ecddc",
         "ResourceType" : "Instance",
         "Seq" : 906673
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "d0d388cd-a1f0e103-d1345e79-1fa43ffe-aa885afb",
         "Path" : "/instances/d0d388cd-a1f0e103-d1345e79-1fa43ffe-aa885afb",
         "ResourceType" : "Instance",
         "Seq" : 906674
      },
      {
         "ChangeType" : "NewSeries",
         "Date" : "20240828T175955",
         "ID" : "53290a9f-a9680c5d-05a55b1e-eae10a07-657d64ff",
         "Path" : "/series/53290a9f-a9680c5d-05a55b1e-eae10a07-657d64ff",
         "ResourceType" : "Series",
         "Seq" : 906675
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "cb6dc0ad-b221b679-163f4c30-41a3866e-6f716db9",
         "Path" : "/instances/cb6dc0ad-b221b679-163f4c30-41a3866e-6f716db9",
         "ResourceType" : "Instance",
         "Seq" : 906676
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "a5e3176a-1467cdb0-21e09dae-de338b3c-4bd435df",
         "Path" : "/instances/a5e3176a-1467cdb0-21e09dae-de338b3c-4bd435df",
         "ResourceType" : "Instance",
         "Seq" : 906677
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "dbdfe52b-b8d11a30-481b30d7-fd0d83b9-c3893123",
         "Path" : "/instances/dbdfe52b-b8d11a30-481b30d7-fd0d83b9-c3893123",
         "ResourceType" : "Instance",
         "Seq" : 906678
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "3910fa5b-a130b3e3-ea206cfe-501d7c4a-0fe2e0c8",
         "Path" : "/instances/3910fa5b-a130b3e3-ea206cfe-501d7c4a-0fe2e0c8",
         "ResourceType" : "Instance",
         "Seq" : 906679
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "d8621415-1aeb889f-90870143-18237aed-992faaca",
         "Path" : "/instances/d8621415-1aeb889f-90870143-18237aed-992faaca",
         "ResourceType" : "Instance",
         "Seq" : 906680
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "c518ec5f-03d5c14e-b4f3a40b-6110b2e3-ff2462bd",
         "Path" : "/instances/c518ec5f-03d5c14e-b4f3a40b-6110b2e3-ff2462bd",
         "ResourceType" : "Instance",
         "Seq" : 906681
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "2e39a988-767739a6-e25d62ae-03b31d1d-cc61022d",
         "Path" : "/instances/2e39a988-767739a6-e25d62ae-03b31d1d-cc61022d",
         "ResourceType" : "Instance",
         "Seq" : 906682
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "89cf5897-2744d98c-76f9481a-11c5a7c6-3071c402",
         "Path" : "/instances/89cf5897-2744d98c-76f9481a-11c5a7c6-3071c402",
         "ResourceType" : "Instance",
         "Seq" : 906683
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "ac7cfada-684d3757-41cdb35f-b715e777-660056fb",
         "Path" : "/instances/ac7cfada-684d3757-41cdb35f-b715e777-660056fb",
         "ResourceType" : "Instance",
         "Seq" : 906684
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "197b418d-85b692bd-4fe03edb-cd30f2a0-5fbed2cb",
         "Path" : "/instances/197b418d-85b692bd-4fe03edb-cd30f2a0-5fbed2cb",
         "ResourceType" : "Instance",
         "Seq" : 906685
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "7b952555-c24bd0bf-98a97ab7-d5e34b35-be37c0cc",
         "Path" : "/instances/7b952555-c24bd0bf-98a97ab7-d5e34b35-be37c0cc",
         "ResourceType" : "Instance",
         "Seq" : 906686
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "c117f5ab-75f38d90-46523d01-78bd3dc9-0b1e606c",
         "Path" : "/instances/c117f5ab-75f38d90-46523d01-78bd3dc9-0b1e606c",
         "ResourceType" : "Instance",
         "Seq" : 906687
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "63e97008-8526992c-45b434f6-6adc6b82-b695878c",
         "Path" : "/instances/63e97008-8526992c-45b434f6-6adc6b82-b695878c",
         "ResourceType" : "Instance",
         "Seq" : 906688
      },
      {
         "ChangeType" : "NewInstance",
         "Date" : "20240828T175955",
         "ID" : "d960d4a1-112d7199-63733142-2bdd4bc7-2ce206c0",
         "Path" : "/instances/d960d4a1-112d7199-63733142-2bdd4bc7-2ce206c0",
         "ResourceType" : "Instance",
         "Seq" : 906689
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180018",
         "ID" : "238a495f-c65e7954-dd798fe2-103453ec-08aeb194",
         "Path" : "/series/238a495f-c65e7954-dd798fe2-103453ec-08aeb194",
         "ResourceType" : "Series",
         "Seq" : 906690
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180018",
         "ID" : "da09690c-822b9faa-a6697a66-3b613324-c29586f1",
         "Path" : "/series/da09690c-822b9faa-a6697a66-3b613324-c29586f1",
         "ResourceType" : "Series",
         "Seq" : 906691
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180018",
         "ID" : "238a495f-c65e7954-dd798fe2-103453ec-08aeb194",
         "Path" : "/series/238a495f-c65e7954-dd798fe2-103453ec-08aeb194",
         "ResourceType" : "Series",
         "Seq" : 906692
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180018",
         "ID" : "da09690c-822b9faa-a6697a66-3b613324-c29586f1",
         "Path" : "/series/da09690c-822b9faa-a6697a66-3b613324-c29586f1",
         "ResourceType" : "Series",
         "Seq" : 906693
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180021",
         "ID" : "65e765a6-286b5910-ab69f48b-c0310c86-cb75b9b6",
         "Path" : "/series/65e765a6-286b5910-ab69f48b-c0310c86-cb75b9b6",
         "ResourceType" : "Series",
         "Seq" : 906694
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180021",
         "ID" : "65e765a6-286b5910-ab69f48b-c0310c86-cb75b9b6",
         "Path" : "/series/65e765a6-286b5910-ab69f48b-c0310c86-cb75b9b6",
         "ResourceType" : "Series",
         "Seq" : 906695
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180023",
         "ID" : "46eeb26e-4d5e78c7-93669566-c56b3b48-e8eeadc1",
         "Path" : "/series/46eeb26e-4d5e78c7-93669566-c56b3b48-e8eeadc1",
         "ResourceType" : "Series",
         "Seq" : 906696
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180023",
         "ID" : "46eeb26e-4d5e78c7-93669566-c56b3b48-e8eeadc1",
         "Path" : "/series/46eeb26e-4d5e78c7-93669566-c56b3b48-e8eeadc1",
         "ResourceType" : "Series",
         "Seq" : 906697
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180025",
         "ID" : "2f01b63b-b041928e-d48c4c0c-62604fc2-e6c06c7f",
         "Path" : "/series/2f01b63b-b041928e-d48c4c0c-62604fc2-e6c06c7f",
         "ResourceType" : "Series",
         "Seq" : 906698
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180025",
         "ID" : "2f01b63b-b041928e-d48c4c0c-62604fc2-e6c06c7f",
         "Path" : "/series/2f01b63b-b041928e-d48c4c0c-62604fc2-e6c06c7f",
         "ResourceType" : "Series",
         "Seq" : 906699
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180026",
         "ID" : "447b4f58-fb08c8b9-580e716e-ee682804-8be9c2de",
         "Path" : "/series/447b4f58-fb08c8b9-580e716e-ee682804-8be9c2de",
         "ResourceType" : "Series",
         "Seq" : 906700
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180026",
         "ID" : "8854b336-3bd398bb-fac20492-816b96db-4ab32ecb",
         "Path" : "/series/8854b336-3bd398bb-fac20492-816b96db-4ab32ecb",
         "ResourceType" : "Series",
         "Seq" : 906701
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180026",
         "ID" : "0f8e96a5-d0ed1120-a9c223d2-b9303523-bc79286f",
         "Path" : "/series/0f8e96a5-d0ed1120-a9c223d2-b9303523-bc79286f",
         "ResourceType" : "Series",
         "Seq" : 906702
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180026",
         "ID" : "30de8103-d7956571-67de2dad-555ac005-8bea9abf",
         "Path" : "/series/30de8103-d7956571-67de2dad-555ac005-8bea9abf",
         "ResourceType" : "Series",
         "Seq" : 906703
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180026",
         "ID" : "f8efa711-221b1e3f-552a8f10-640862ec-09879bae",
         "Path" : "/series/f8efa711-221b1e3f-552a8f10-640862ec-09879bae",
         "ResourceType" : "Series",
         "Seq" : 906704
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180026",
         "ID" : "d1b17f4f-c4dec82e-f3b66493-b2082fad-e687a1b8",
         "Path" : "/series/d1b17f4f-c4dec82e-f3b66493-b2082fad-e687a1b8",
         "ResourceType" : "Series",
         "Seq" : 906705
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180026",
         "ID" : "0f907e1c-1143c965-d900d63c-5680d23b-c5f19160",
         "Path" : "/series/0f907e1c-1143c965-d900d63c-5680d23b-c5f19160",
         "ResourceType" : "Series",
         "Seq" : 906706
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180026",
         "ID" : "05919421-a2855103-72c18cab-8a0f59f0-700fb700",
         "Path" : "/series/05919421-a2855103-72c18cab-8a0f59f0-700fb700",
         "ResourceType" : "Series",
         "Seq" : 906707
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180026",
         "ID" : "c9615d17-de91bdc3-5b46e248-32cb7940-d633e417",
         "Path" : "/series/c9615d17-de91bdc3-5b46e248-32cb7940-d633e417",
         "ResourceType" : "Series",
         "Seq" : 906708
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180026",
         "ID" : "447b4f58-fb08c8b9-580e716e-ee682804-8be9c2de",
         "Path" : "/series/447b4f58-fb08c8b9-580e716e-ee682804-8be9c2de",
         "ResourceType" : "Series",
         "Seq" : 906709
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180026",
         "ID" : "8854b336-3bd398bb-fac20492-816b96db-4ab32ecb",
         "Path" : "/series/8854b336-3bd398bb-fac20492-816b96db-4ab32ecb",
         "ResourceType" : "Series",
         "Seq" : 906710
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180027",
         "ID" : "0f8e96a5-d0ed1120-a9c223d2-b9303523-bc79286f",
         "Path" : "/series/0f8e96a5-d0ed1120-a9c223d2-b9303523-bc79286f",
         "ResourceType" : "Series",
         "Seq" : 906711
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180027",
         "ID" : "30de8103-d7956571-67de2dad-555ac005-8bea9abf",
         "Path" : "/series/30de8103-d7956571-67de2dad-555ac005-8bea9abf",
         "ResourceType" : "Series",
         "Seq" : 906712
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180033",
         "ID" : "f8efa711-221b1e3f-552a8f10-640862ec-09879bae",
         "Path" : "/series/f8efa711-221b1e3f-552a8f10-640862ec-09879bae",
         "ResourceType" : "Series",
         "Seq" : 906713
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180034",
         "ID" : "d1b17f4f-c4dec82e-f3b66493-b2082fad-e687a1b8",
         "Path" : "/series/d1b17f4f-c4dec82e-f3b66493-b2082fad-e687a1b8",
         "ResourceType" : "Series",
         "Seq" : 906714
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180035",
         "ID" : "0f907e1c-1143c965-d900d63c-5680d23b-c5f19160",
         "Path" : "/series/0f907e1c-1143c965-d900d63c-5680d23b-c5f19160",
         "ResourceType" : "Series",
         "Seq" : 906715
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180035",
         "ID" : "05919421-a2855103-72c18cab-8a0f59f0-700fb700",
         "Path" : "/series/05919421-a2855103-72c18cab-8a0f59f0-700fb700",
         "ResourceType" : "Series",
         "Seq" : 906716
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180036",
         "ID" : "c9615d17-de91bdc3-5b46e248-32cb7940-d633e417",
         "Path" : "/series/c9615d17-de91bdc3-5b46e248-32cb7940-d633e417",
         "ResourceType" : "Series",
         "Seq" : 906717
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180054",
         "ID" : "6667302e-409cc464-8aac19b6-7451f13b-bf3b3a83",
         "Path" : "/series/6667302e-409cc464-8aac19b6-7451f13b-bf3b3a83",
         "ResourceType" : "Series",
         "Seq" : 906718
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180054",
         "ID" : "0427ff76-b12ce2e5-6436f1e9-2b4efe46-aff60858",
         "Path" : "/series/0427ff76-b12ce2e5-6436f1e9-2b4efe46-aff60858",
         "ResourceType" : "Series",
         "Seq" : 906719
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180054",
         "ID" : "976bf3af-efe12154-04cb945c-d254d3d3-028949c3",
         "Path" : "/series/976bf3af-efe12154-04cb945c-d254d3d3-028949c3",
         "ResourceType" : "Series",
         "Seq" : 906720
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180054",
         "ID" : "6667302e-409cc464-8aac19b6-7451f13b-bf3b3a83",
         "Path" : "/series/6667302e-409cc464-8aac19b6-7451f13b-bf3b3a83",
         "ResourceType" : "Series",
         "Seq" : 906721
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180054",
         "ID" : "0427ff76-b12ce2e5-6436f1e9-2b4efe46-aff60858",
         "Path" : "/series/0427ff76-b12ce2e5-6436f1e9-2b4efe46-aff60858",
         "ResourceType" : "Series",
         "Seq" : 906722
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180054",
         "ID" : "976bf3af-efe12154-04cb945c-d254d3d3-028949c3",
         "Path" : "/series/976bf3af-efe12154-04cb945c-d254d3d3-028949c3",
         "ResourceType" : "Series",
         "Seq" : 906723
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180055",
         "ID" : "71672c2f-049dae00-05995225-3885812e-fe18f21f",
         "Path" : "/series/71672c2f-049dae00-05995225-3885812e-fe18f21f",
         "ResourceType" : "Series",
         "Seq" : 906724
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180055",
         "ID" : "8725a5cb-a84d3fbd-969bd188-c0a9458d-4d5dab0d",
         "Path" : "/series/8725a5cb-a84d3fbd-969bd188-c0a9458d-4d5dab0d",
         "ResourceType" : "Series",
         "Seq" : 906725
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180055",
         "ID" : "446c0c2d-b24bef96-1b8c28f6-bbf50648-7382134c",
         "Path" : "/series/446c0c2d-b24bef96-1b8c28f6-bbf50648-7382134c",
         "ResourceType" : "Series",
         "Seq" : 906726
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180055",
         "ID" : "f3da0f5c-c4487df9-13895c72-bdb755c7-914fece5",
         "Path" : "/series/f3da0f5c-c4487df9-13895c72-bdb755c7-914fece5",
         "ResourceType" : "Series",
         "Seq" : 906727
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180055",
         "ID" : "d2084a41-8757187d-3bc04849-24a355cf-6b149dbf",
         "Path" : "/series/d2084a41-8757187d-3bc04849-24a355cf-6b149dbf",
         "ResourceType" : "Series",
         "Seq" : 906728
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180055",
         "ID" : "71672c2f-049dae00-05995225-3885812e-fe18f21f",
         "Path" : "/series/71672c2f-049dae00-05995225-3885812e-fe18f21f",
         "ResourceType" : "Series",
         "Seq" : 906729
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180055",
         "ID" : "8725a5cb-a84d3fbd-969bd188-c0a9458d-4d5dab0d",
         "Path" : "/series/8725a5cb-a84d3fbd-969bd188-c0a9458d-4d5dab0d",
         "ResourceType" : "Series",
         "Seq" : 906730
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180055",
         "ID" : "446c0c2d-b24bef96-1b8c28f6-bbf50648-7382134c",
         "Path" : "/series/446c0c2d-b24bef96-1b8c28f6-bbf50648-7382134c",
         "ResourceType" : "Series",
         "Seq" : 906731
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180055",
         "ID" : "f3da0f5c-c4487df9-13895c72-bdb755c7-914fece5",
         "Path" : "/series/f3da0f5c-c4487df9-13895c72-bdb755c7-914fece5",
         "ResourceType" : "Series",
         "Seq" : 906732
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180055",
         "ID" : "d2084a41-8757187d-3bc04849-24a355cf-6b149dbf",
         "Path" : "/series/d2084a41-8757187d-3bc04849-24a355cf-6b149dbf",
         "ResourceType" : "Series",
         "Seq" : 906733
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180056",
         "ID" : "53290a9f-a9680c5d-05a55b1e-eae10a07-657d64ff",
         "Path" : "/series/53290a9f-a9680c5d-05a55b1e-eae10a07-657d64ff",
         "ResourceType" : "Series",
         "Seq" : 906734
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180056",
         "ID" : "899a2357-9d00c2f6-a42b1cc7-c9ebf50f-e01e8ff8",
         "Path" : "/series/899a2357-9d00c2f6-a42b1cc7-c9ebf50f-e01e8ff8",
         "ResourceType" : "Series",
         "Seq" : 906735
      },
      {
         "ChangeType" : "StableSeries",
         "Date" : "20240828T180056",
         "ID" : "47c87ac8-dbc2327c-45054690-6732c078-cc8838a2",
         "Path" : "/series/47c87ac8-dbc2327c-45054690-6732c078-cc8838a2",
         "ResourceType" : "Series",
         "Seq" : 906736
      },
      {
         "ChangeType" : "StableStudy",
         "Date" : "20240828T180056",
         "ID" : "92e327b2-f88628ad-07e26976-1c514556-9770edb2",
         "Path" : "/studies/92e327b2-f88628ad-07e26976-1c514556-9770edb2",
         "ResourceType" : "Study",
         "Seq" : 906737
      },
      {
         "ChangeType" : "StablePatient",
         "Date" : "20240828T180056",
         "ID" : "640ab2ba-e07bedc4-c163f679-a746f7ab-7fb5d1fa",
         "Path" : "/patients/640ab2ba-e07bedc4-c163f679-a746f7ab-7fb5d1fa",
         "ResourceType" : "Patient",
         "Seq" : 906738
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180101",
         "ID" : "53290a9f-a9680c5d-05a55b1e-eae10a07-657d64ff",
         "Path" : "/series/53290a9f-a9680c5d-05a55b1e-eae10a07-657d64ff",
         "ResourceType" : "Series",
         "Seq" : 906739
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180102",
         "ID" : "899a2357-9d00c2f6-a42b1cc7-c9ebf50f-e01e8ff8",
         "Path" : "/series/899a2357-9d00c2f6-a42b1cc7-c9ebf50f-e01e8ff8",
         "ResourceType" : "Series",
         "Seq" : 906740
      },
      {
         "ChangeType" : "UpdatedAttachment",
         "Date" : "20240828T180102",
         "ID" : "47c87ac8-dbc2327c-45054690-6732c078-cc8838a2",
         "Path" : "/series/47c87ac8-dbc2327c-45054690-6732c078-cc8838a2",
         "ResourceType" : "Series",
         "Seq" : 906741
      }
   ],
   "Done" : true,
   "Last" : 906741
}

Reminder, the filewatcher plugin is pointed at a directory with 58 studies, with dates between Aug 1 14:52 and Aug 28 13:59

amazy commented 2 months ago

How many instances in your studies ? 900k changes for 58 studies is huge but if your studies have 10k-15k instances each, that sounds logical. OE2 needs to go backward through /changes to find the /NewStudy events since there is currently no ability to filter changes but we are working on it...

gdevenyi commented 2 months ago

Well, I'd like to have this be more viewable at a glance (see #64), but for a very non-random sample, I'm looking at 1500-45000 (manually calculated from looking at some individual studies).

For context here, we're a research imaging centre often doing high-resolution hour+ studies on live (and ex-vivo) brains with multispectral protocols. Not a typical clinical imaging workload.

amazy commented 1 month ago

Hi @gdevenyi

Could you give it a try with this version ? orthancteam/orthanc-pre-release:find-refactoring-unstable. Note: only working with SQLite and PostgreSQL, neither with MySQL nor ODBC.

gdevenyi commented 1 month ago

I had been running the services via docker-compose and jodogne/orthanc-plugins:1.12.4, swapping in orthancteam/orthanc-pre-release:find-refactoring-unstable into the compose stack didn't result in an deployment where I could find the new UI elements and test this.

Can you provide any insight?

Current compose

services:
  orthanc:
    image: jodogne/orthanc-plugins:1.12.4
    command: /run/secrets/  # Path to the configuration files (stored as secrets)
    ports:
      - 8042:8042
    secrets:
      - orthanc.json
    volumes:
      - /data/dicom/incoming:/dicom/incoming:ro
    environment:
      - TZ=America/Toronto
secrets:
  orthanc.json:
    file: orthanc.json
amazy commented 1 month ago

you probably need to remove the "Plugins" section from your orthanc.json because that's kind of automatic in the orthancteam/orthanc images. If plugins are not loading, you might need to enable them with environment variables but having their section defined in the json should be enough.

gdevenyi commented 1 week ago

Finally got a chance to demo.

The "most recent" loading is now instantaneous from my perspective. Much improved.