OpenModelDB / open-model-database

An open and free database for AI models
https://openmodeldb.info
GNU General Public License v3.0
307 stars 33 forks source link

[MODEL ADD REQUEST] Ani4VK v2 Compact / UltraCompact #432

Closed Sirosky closed 5 months ago

Sirosky commented 5 months ago
{
  "name": "Ani4VK v2 Compact",
  "author": "sirosky",
  "license": "CC-BY-NC-4.0",
  "tags": [
    "anime",
    "anti-aliasing",
    "compression-removal",
    "debanding",
    "deblur",
    "dehalo",
    "denoise",
    "jpeg",
    "restoration"
  ],
  "description": "## Ani4K v2  \n\n Ani4K v2, as the successor to the original Ani4K, retains its predecessor's fantastic detail retention, depth of field preservation and faithfulness to the original source. As the name suggests, the model is targeted at modern anime, ranging from high-quality Bluray to crappy WEB releases, for upscaling either to 2K or 4K.\n\nAn **UltraCompact** version of the model is available on the [Github release](https://github.com/Sirosky/Upscale-Hub/releases/tag/Ani4K-v2). The UltraCompact version is faster, without a perceptual hit to quality in most cases.\n\n📌 [More comparisons](https://slow.pics/c/1HykdyT5)\n\n****\n\n**FAQ**\n\n- *How does v2 differ from v1?* I'm so glad you asked! A shortcoming of the v1 models is that the model really struggled on sources which were poorly mastered. This is unfortunately still very common even with modern anime. v2 is far more capable of dealing with such sources. \n- *How does Ani4K v2 differ from JaNai v3? Which one should I pick?* JaNai v3 is a fantastic model, and shares many of the fundamental training objectives behind Ani4K (DOF preservation, faithfulness, etc.). I'd say that the primary difference is one of training philosophy-- JaNai seeks to render the source as if it was originally mastered in 4K, whereas Ani4K seeks to produce an upscale that is as close as possible to the source (while cleaning up any issues). Long story short, test both models and see which you prefer.\n- *What model versions are there?* Ani4K comes in Compact and UltraCompact flavors. Compact is of course a standard option. UltraCompact provides a noticeable performance uplift, without too much impact on quality. I ultimately did not train a SuperUltraCompact variant as I felt the hit to the model quality was far too significant.",
  "date": "2024-03-23",
  "architecture": "compact",
  "size": [
    "num_feat: 64",
    "num_conv: 16"
  ],
  "scale": 2,
  "inputChannels": 3,
  "outputChannels": 3,
  "resources": [
    {
      "urls": [
        "https://github.com/Sirosky/Upscale-Hub/releases/download/Ani4K-v2/2x_Ani4Kv2_G6i2_Compact_107500.pth"
      ],
      "sha256": "fe99290e9e4f95424219566dbe159184a123587622cc00bc632b1eecbd07d7a4",
      "size": 2419540,
      "platform": "pytorch",
      "type": "pth"
    },
    {
      "urls": [
        "https://github.com/Sirosky/Upscale-Hub/releases/download/Ani4K-v2/2x_Ani4Kv2_G6i2_Compact_107500_fp32.onnx"
      ],
      "sha256": "747163e8572650380b0b2f16f89e8c3ce2c29cd19525e9af8782d4bf1fe653c2",
      "size": 2413474,
      "platform": "onnx",
      "type": "onnx"
    }
  ],
  "images": [
    {
      "type": "paired",
      "LR": "https://github.com/Sirosky/Upscale-Hub/blob/main/Comparison%20Images/Ani4K%20v2%20Model%20Images/Chainsaw%20LR.png?raw=true",
      "SR": "https://github.com/Sirosky/Upscale-Hub/blob/main/Comparison%20Images/Ani4K%20v2%20Model%20Images/Chainsaw%20HR.png?raw=true",
      "caption": "Chainsaw"
    },
    {
      "type": "paired",
      "LR": "https://github.com/Sirosky/Upscale-Hub/blob/main/Comparison%20Images/Ani4K%20v2%20Model%20Images/Oshi%20LR.png?raw=true",
      "SR": "https://github.com/Sirosky/Upscale-Hub/blob/main/Comparison%20Images/Ani4K%20v2%20Model%20Images/Oshi%20HR.png?raw=true",
      "caption": "Oshi no Ko"
    },
    {
      "type": "paired",
      "LR": "https://github.com/Sirosky/Upscale-Hub/blob/main/Comparison%20Images/Ani4K%20v2%20Model%20Images/Heavenly%20LR.png?raw=true",
      "SR": "https://github.com/Sirosky/Upscale-Hub/blob/main/Comparison%20Images/Ani4K%20v2%20Model%20Images/Heavenly%20HR.png?raw=true",
      "caption": "Heavenly Delusion"
    }
  ],
  "dataset": "Anime frames.",
  "datasetSize": 10922,
  "trainingIterations": 107500,
  "trainingBatchSize": 16,
  "trainingEpochs": 141,
  "trainingHRSize": 256,
  "trainingOTF": false
}
joeyballentine commented 5 months ago

If this is two models please separate them out into two posts. Thanks!

Sirosky commented 5 months ago

Eh too lazy. I'll just post the Compact version then. Updated the post above accordingly, let me know if that works.

joeyballentine commented 5 months ago

That works I guess. Thanks

Sirosky commented 5 months ago

Cool thanks, out of town right now so it'd be difficult to dig up the UltraCompact config and generate the comparison images.