pulling files from git (if no files) takes 0.6 seconds
reading 2,285 items from file to cache takes 85 seconds
reading 2,285 items from cache to database takes 15 seconds
entire operation (from 0 local files to data in database) takes ~110 seconds (there's also a slight delay firing off ReadItmFiles, but less than 5 seconds).
This is using a slow ssd and 8+ year old cpu, so should be faster elsewhere.
Cache is file based so there's potentially 10k+ file i/o ops. Could move cache to redis if that becomes an issue. The file stuff is the main bottleneck.
To compare later:
This is using a slow ssd and 8+ year old cpu, so should be faster elsewhere.
Cache is file based so there's potentially 10k+ file i/o ops. Could move cache to redis if that becomes an issue. The file stuff is the main bottleneck.
Total file size (including Accursedlands-obj):
Total cache size (with items cached):
Total size of
itemstable: