axinc-ai / ailia-models-unity

Unity version of ailia models repository
42 stars 2 forks source link

Implement RVC f0 mode #100

Closed kyakuno closed 10 months ago

kyakuno commented 11 months ago

CREPEを取り込んでf0に対応する。 https://github.com/axinc-ai/ailia-models/issues/1201

kyakuno commented 10 months ago

1khzのsinを入れた場合のpythonの期待値。

decoder.argmax

Audio shape :  (1, 2048)
Frames.shape (13, 1024)
Frames [[ 4.0745363e-10  4.0745363e-10  4.0745363e-10 ... -1.8477590e+00
  -1.4142135e+00 -7.6536685e-01]
 [ 3.5565467e-10  3.5565467e-10  3.5565467e-10 ... -1.6128563e+00
  -1.2344267e+00 -6.6806692e-01]
 [ 3.1963293e-10  3.1963293e-10  3.1963293e-10 ... -1.4495014e+00
  -1.1094004e+00 -6.0040313e-01]
 ...
 [ 2.9749622e-10  5.5894488e-01  1.0327955e+00 ...  2.9756206e-10
   2.9756206e-10  2.9756206e-10]
 [ 3.2590958e-10  6.1229348e-01  1.1313708e+00 ...  3.2596290e-10
   3.2596290e-10  3.2596290e-10]
 [ 3.6429737e-10  6.8456489e-01  1.2649111e+00 ...  3.6443759e-10
   3.6443759e-10  3.6443759e-10]]
Probabilities.shape (13, 360)
Probabilities [[0.00020502 0.00031751 0.00042388 ... 0.0071491  0.01173246 0.01672114]
 [0.00038446 0.00050728 0.00061423 ... 0.01150815 0.01685008 0.02029349]
 [0.00043563 0.00062878 0.00082959 ... 0.02076474 0.03138043 0.03670036]
 ...
 [0.00017953 0.00025119 0.00032758 ... 0.03704717 0.05419874 0.05310791]
 [0.00030062 0.00044596 0.00061663 ... 0.04476431 0.06290425 0.06596494]
 [0.00035007 0.00050137 0.00067456 ... 0.04698664 0.06278921 0.06866229]]
bins [[298 298 298 298 298 298 298 298 298 298 298 298 298]]
cents [[7957.37940844 7957.37940844 7957.37940844 7957.37940844 7957.37940844
  7957.37940844 7957.37940844 7957.37940844 7957.37940844 7957.37940844
  7957.37940844 7957.37940844 7957.37940844]]
dither_cents [[7953.61208946 7954.14764803 7949.19239862 7955.28112399 7966.55823823
  7963.17041572 7958.84505225 7963.19714456 7961.19396268 7940.6826132
  7955.4193838  7950.37785882 7941.15170714]]
freq [[992.27519294 994.3639072  994.48941636 990.90872761 988.75016576
  987.85706148 994.1876741  984.65056225 993.77473096 991.06808855
  995.5121274  983.2524569  995.69439125]]
pd :  [[0.30528295 0.55763453 0.64612538 0.58593071 0.56871527 0.56871527
  0.56871527 0.56871527 0.56871527 0.56871527 0.59678572 0.5792219
  0.54140884]]
f0 :  [[988.45554384 989.68189213 988.54862566 986.27044549 993.53983795
  985.11663805 982.49210512 989.97455928 989.54480726 994.11474896
  987.21039173 989.97930728 992.20686384]]
[W NNPACK.cpp:64] Could not initialize NNPACK! Reason: Unsupported hardware.
median pd :  [[0.30528295 0.55763453 0.5859307  0.5859307  0.5687153  0.5687153
  0.5687153  0.5687153  0.5687153  0.5687153  0.5792219  0.5792219
  0.54140884]]
mean f0 :  [[989.0687  988.8953  988.167   989.45294 988.309   987.04956 985.8611
  987.33716 991.21136 990.29    990.4348  989.7988  991.0931 ]]
final f0 :  [989.0687  988.8953  988.167   989.45294 988.309   987.04956 985.8611
 987.33716 991.21136 990.29    990.4348  989.7988  991.0931 ]

decoder.viterbi

Audio shape :  (1, 2048)
pd :  [[0.30528295 0.55763453 0.64612538 0.58593071 0.56871527 0.56871527
  0.56871527 0.56871527 0.56871527 0.56871527 0.59678572 0.5792219
  0.54140884]]
f0 :  [[997.74597251 997.24236973 996.38860264 987.06377319 982.97850302
  986.79590645 990.38032484 987.02009161 995.42629698 991.83966575
  993.10933922 992.50616708 994.77689137]]
[W NNPACK.cpp:64] Could not initialize NNPACK! Reason: Unsupported hardware.
median pd :  [[0.30528295 0.55763453 0.5859307  0.5859307  0.5687153  0.5687153
  0.5687153  0.5687153  0.5687153  0.5687153  0.5792219  0.5792219
  0.54140884]]
mean f0 :  [[997.49414 997.1257  993.56494 988.8103  985.61273 986.71826 988.0654
  990.9422  991.42865 993.45844 992.48505 993.4641  993.64154]]
final f0 :  [997.49414 997.1257  993.56494 988.8103  985.61273 986.71826 988.0654
 990.9422  991.42865 993.45844 992.48505 993.4641  993.64154]
kyakuno commented 10 months ago

viterbiの中間データ

Probabilities [[0.00020502 0.00031751 0.00042388 ... 0.0071491  0.01173246 0.01672114]
 [0.00038446 0.00050728 0.00061423 ... 0.01150815 0.01685008 0.02029349]
 [0.00043563 0.00062878 0.00082959 ... 0.02076474 0.03138043 0.03670036]
 ...
 [0.00017953 0.00025119 0.00032758 ... 0.03704717 0.05419874 0.05310791]
 [0.00030062 0.00044596 0.00061663 ... 0.04476431 0.06290425 0.06596494]
 [0.00035007 0.00050137 0.00067456 ... 0.04698664 0.06278921 0.06866229]]
sqeuence (360, 13)
Viterbi Epsilon 1.1754944e-38
Viterbi transition [[0.15384615 0.14102564 0.12820513 ... 0.         0.         0.        ]
 [0.12359551 0.13483146 0.12359551 ... 0.         0.         0.        ]
 [0.1010101  0.11111111 0.12121212 ... 0.         0.         0.        ]
 ...
 [0.         0.         0.         ... 0.12121212 0.11111111 0.1010101 ]
 [0.         0.         0.         ... 0.12359551 0.13483146 0.12359551]
 [0.         0.         0.         ... 0.12820513 0.14102564 0.15384615]]
Viterbi prob [[0. 0. 0. ... 0. 0. 0.]
 [0. 0. 0. ... 0. 0. 0.]
 [0. 0. 0. ... 0. 0. 0.]
 ...
 [0. 0. 0. ... 0. 0. 0.]
 [0. 0. 0. ... 0. 0. 0.]
 [0. 0. 0. ... 0. 0. 0.]]
Viterbi p_init [0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778
 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778 0.00277778]
Viterbi log_trans [[ -1.87180218  -1.95881355  -2.05412373 ... -87.33654475 -87.33654475
  -87.33654475]
 [ -2.0907411   -2.00372972  -2.0907411  ... -87.33654475 -87.33654475
  -87.33654475]
 [ -2.29253476  -2.19722458  -2.1102132  ... -87.33654475 -87.33654475
  -87.33654475]
 ...
 [-87.33654475 -87.33654475 -87.33654475 ...  -2.1102132   -2.19722458
   -2.29253476]
 [-87.33654475 -87.33654475 -87.33654475 ...  -2.0907411   -2.00372972
   -2.0907411 ]
 [-87.33654475 -87.33654475 -87.33654475 ...  -2.05412373  -1.95881355
   -1.87180218]]
Viterbi log_prob [[-87.33655 -87.33655 -87.33655 ... -87.33655 -87.33655 -87.33655]
 [-87.33655 -87.33655 -87.33655 ... -87.33655 -87.33655 -87.33655]
 [-87.33655 -87.33655 -87.33655 ... -87.33655 -87.33655 -87.33655]
 ...
 [-87.33655 -87.33655 -87.33655 ... -87.33655 -87.33655 -87.33655]
 [-87.33655 -87.33655 -87.33655 ... -87.33655 -87.33655 -87.33655]
 [-87.33655 -87.33655 -87.33655 ... -87.33655 -87.33655 -87.33655]]
Viterbi log_p_init [-5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403
 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403 -5.88610403]
value[1]  [-182.43100191 -182.51801329 -182.61332347 -182.71868398 -182.82788328
 -182.88647744 -182.93410549 -182.97213288 -183.00154677 -183.02305298
 -183.03713772 -183.04410638 -183.04410638 -183.04410638 -183.04410638
 -183.04410638 -183.04410638 -183.04410638 -183.04410638 -183.04410638
 -183.04410638 -183.04410638 -183.04410638 -183.04410638 -183.04410638
 -183.04410638 -183.04410638 -183.04410638 -103.79517638 -103.1020292
 -102.69656409 -102.40888202 -102.18573847 -102.00341691 -101.84926623
 -101.71573484 -101.59795181 -101.49259129 -101.39728111  -19.58018007
  -19.58018531  -19.58023443  -19.58028497  -19.58030166  -19.58028736
  -19.58027305  -19.58025875  -19.58024444  -19.58024587  -19.58028068
  -19.58033361  -19.58037748  -19.58039369  -19.58039369  -19.58037176
  -19.58033552  -19.58029499  -19.58027877  -19.5802802   -19.580305
  -19.58032217  -19.58026352  -19.58007469  -19.5800661   -19.58023729
  -19.58031549  -19.58033409  -19.58033933  -19.58034982  -19.58036794
  -19.58038749  -19.58038988  -19.5803689   -19.58035793  -19.58032264
  -19.58030214  -19.58030929  -19.58032026  -19.58032026  -19.58029689
  -19.58030262  -19.58031978  -19.58031454  -19.58033123  -19.58034982
  -19.58037939  -19.58039417  -19.58037462  -19.58034982  -19.58035125
  -19.58039274  -19.58041944  -19.58043327  -19.58043708  -19.58043518
  -19.58042135  -19.58038988  -19.58035173  -19.58033599  -19.58031215
  -19.58031263  -19.58034792  -19.58035602  -19.58036031  -19.58038272
  -19.58035936  -19.58030834  -19.58028307  -19.58027114  -19.58025875
  -19.58025875  -19.58023252  -19.58022632  -19.58019104  -19.58017864
  -19.58014001  -19.58006754  -19.58002081  -19.58000078  -19.57997169
  -19.58002843  -19.57991638  -19.57968702  -19.5796937   -19.5796484
  -19.57981004  -19.58007087  -19.58025207  -19.58028688  -19.58030786
  -19.58033886  -19.58034887  -19.58033695  -19.58030643  -19.58027734
  -19.58027591  -19.58029594  -19.58028783  -19.58026828  -19.5802597
  -19.58023061  -19.58019724  -19.58023252  -19.58027734  -19.58034172
  -19.58040037  -19.58040371  -19.5803689   -19.5803751   -19.58038082
  -19.58038416  -19.58038034  -19.58036508  -19.58036317  -19.58035888
  -19.58035078  -19.58032693  -19.58029785  -19.58026971  -19.58017339
  -19.58009424  -19.58015575  -19.58019914  -19.58029546  -19.58034792
  -19.58034124  -19.58030071  -19.58022823  -19.58018007  -19.58008995
  -19.5800847   -19.58010854  -19.58015623  -19.58017292  -19.58022489
  -19.5802926   -19.58028068  -19.58016862  -19.58016529  -19.58012428
  -19.58017959  -19.58021965  -19.58026161  -19.58027067  -19.58027448
  -19.58031692  -19.58034887  -19.58037414  -19.5804142   -19.58043756
  -19.58044805  -19.58044138  -19.58041658  -19.58036127  -19.58031358
  -19.58024492  -19.5801362   -19.58013334  -19.58010473  -19.58009615
  -19.5801095   -19.58002748  -19.57999124  -19.57988109  -19.58000841
  -19.58020486  -19.58032217  -19.58037939  -19.58039274  -19.58039322
  -19.58039941  -19.58041467  -19.58039322  -19.58039798  -19.58040275
  -19.58037557  -19.58029022  -19.58009519  -19.57973423  -19.57936229
  -19.57906189  -19.5792016   -19.57964077  -19.57999029  -19.5800847
  -19.58013143  -19.57990255  -19.5793003   -19.57903137  -19.57821407
  -19.57774057  -19.57787647  -19.57876625  -19.57894125  -19.57890071
  -19.57845487  -19.57720079  -19.57547083  -19.57373037  -19.57545986
  -19.57761135  -19.57882537  -19.57914867  -19.5795392   -19.57956161
  -19.57944097  -19.57978429  -19.58012428  -19.58023014  -19.5803255
  -19.58039417  -19.58039083  -19.58034887  -19.58026924  -19.58024349
  -19.58006038  -19.57995643  -19.5799407   -19.57981577  -19.57963791
  -19.57930317  -19.57849159  -19.5769309   -19.57531633  -19.57575168
  -19.57781448  -19.57919778  -19.57967796  -19.57974615  -19.57986965
  -19.58000364  -19.58008041  -19.58007755  -19.58008136  -19.58010282
  -19.5801362   -19.58002605  -19.57956829  -19.5789174   -19.57838907
  -19.57788839  -19.57745971  -19.57765426  -19.5773982   -19.57715835
  -19.5764245   -19.57196083  -19.5604681   -19.53975954  -19.49428548
  -19.43435325  -19.40534582  -19.41520347  -19.41624059  -19.38642063
  -19.33067407  -19.14101066  -18.86663093  -18.71754827  -18.93157091
  -19.23892015  -19.44042482  -19.51237049  -19.53914728  -19.55148639
  -19.55237903  -19.55213966  -19.56264438 -101.38773292 -101.4830431
 -101.58840362 -101.70618665 -101.83971805 -101.99386873 -102.17619028
 -102.39933383 -102.68701591 -103.09248102 -103.7856282  -183.04410638
 -183.04410638 -183.04410638 -183.04410638 -183.04410638 -183.04410638
 -183.04410638 -183.04410638 -183.04410638 -183.04410638 -183.04410638
 -183.04410638 -183.04410638 -183.04410638 -183.04410638 -183.04410638
 -183.04410638 -183.04410638 -183.04410638 -183.04410638 -183.04410638
 -183.04410638 -183.04410638 -183.04410638 -183.04410638 -183.04410638
 -183.04410638 -183.04410638 -183.04410638 -183.04410638 -183.03713772
 -183.02305298 -183.00154677 -182.97213288 -182.93410549 -182.88647744
 -182.82788328 -182.71868398 -182.61332347 -182.51801329 -182.43100191]
ptr[1]  [  0   0   0   0   4   5   6   7   8   9  10  11  12  13  14  15  16  17
  18  19  20  21  22  23  24  25  26  27  39  39  39  39  39  39  39  39
  39  39  39  39  40  41  42  43  44  45  46  47  48  49  50  51  52  53
  54  55  56  57  58  59  60  61  62  63  64  65  66  67  68  69  70  71
  72  73  74  75  76  77  78  79  80  81  82  83  84  85  86  87  88  89
  90  91  92  93  94  95  96  97  98  99 100 101 102 103 104 105 106 107
 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125
 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143
 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161
 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179
 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197
 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215
 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233
 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251
 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269
 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287
 288 289 290 291 292 293 294 295 296 297 298 299 299 301 302 303 304 305
 306 307 307 307 307 307 307 307 307 307 307 307 307 319 320 321 322 323
 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341
 342 343 344 345 346 347 348 349 350 351 352 353 354 355 359 359 359 359]
value[2]  [-193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.32894881 -193.10580526
 -192.88266171 -192.70034015 -192.5180186  -111.88654122 -111.19339404
 -110.78792893 -110.50024686 -110.27710331 -110.09478175 -109.94063107
 -109.80709968 -109.68931664 -109.58395613 -109.48864595  -27.67270028
  -27.67272031  -27.67278564  -27.67284143  -27.67285621  -27.67284095
  -27.67282521  -27.67280757  -27.67279231  -27.67279946  -27.67285049
  -27.67292153  -27.67297399  -27.6729902   -27.67298734  -27.6729592
  -27.67290914  -27.67284238  -27.67280805  -27.67280709  -27.67282903
  -27.6728481   -27.67275083  -27.67242038  -27.67238366  -27.67268026
  -27.67282521  -27.67284858  -27.67284524  -27.6728605   -27.67288673
  -27.67291629  -27.67291009  -27.67287337  -27.67286908  -27.67283189
  -27.67283713  -27.67286193  -27.67287194  -27.67286908  -27.67284286
  -27.67285668  -27.67287671  -27.67286193  -27.67288005  -27.6729058
  -27.67295062  -27.67297256  -27.67294538  -27.67291152  -27.67291343
  -27.67297208  -27.6730088   -27.67302787  -27.67303264  -27.67302835
  -27.67300593  -27.67295682  -27.67289197  -27.67286145  -27.67282521
  -27.6728357   -27.6728934   -27.67290008  -27.67290914  -27.67294919
  -27.6729182   -27.67284381  -27.67280662  -27.67280376  -27.67279756
  -27.67280757  -27.6727823   -27.67277276  -27.67271602  -27.67267978
  -27.6725868   -27.67240703  -27.67226731  -27.67221772  -27.67218578
  -27.67232501  -27.67214524  -27.67176664  -27.67182433  -27.67175805
  -27.67201602  -27.67243087  -27.6727122   -27.67276275  -27.6728009
  -27.6728481   -27.67285621  -27.67282569  -27.67277991  -27.67275512
  -27.6727761   -27.67282092  -27.67280995  -27.67278134  -27.67276561
  -27.67271125  -27.67265403  -27.672706    -27.67277515  -27.67287528
  -27.67296731  -27.67297589  -27.67292153  -27.67292964  -27.67294538
  -27.67295062  -27.67294156  -27.67292106  -27.67291772  -27.67290866
  -27.67289865  -27.67287242  -27.67283284  -27.67279851  -27.67267453
  -27.67258298  -27.67266309  -27.6727103   -27.67283046  -27.67290055
  -27.67289102  -27.67283475  -27.67273509  -27.67267692  -27.67257583
  -27.67259919  -27.6726259   -27.67267978  -27.67268598  -27.67272985
  -27.67280185  -27.67274415  -27.6725167   -27.6724962   -27.67241084
  -27.67253959  -27.67265594  -27.67274844  -27.67278373  -27.67279184
  -27.6728481   -27.67288816  -27.67292773  -27.67299306  -27.67302596
  -27.67304217  -27.67303168  -27.67298734  -27.67289292  -27.67281472
  -27.67270648  -27.67258155  -27.67254674  -27.67250239  -27.67247808
  -27.67246759  -27.67229306  -27.6721524   -27.6718949   -27.6721853
  -27.6725868   -27.67281997  -27.67292487  -27.67295301  -27.67296016
  -27.67296397  -27.67298352  -27.67294204  -27.67295491  -27.67296397
  -27.67292773  -27.67280805  -27.67254817  -27.67206752  -27.67158401
  -27.6712178   -27.67139995  -27.67197406  -27.67242276  -27.67254626
  -27.67259299  -27.67224204  -27.6713413   -27.67100417  -27.6699084
  -27.66941726  -27.66962611  -27.67075383  -27.67084872  -27.67038524
  -27.66862952  -27.66401231  -27.65709293  -27.65018642  -27.65745723
  -27.66506087  -27.66907489  -27.67030275  -27.67130553  -27.67145812
  -27.67131221  -27.67190921  -27.67250478  -27.67271173  -27.67286622
  -27.67296826  -27.67296302  -27.67290437  -27.67280185  -27.67275321
  -27.6724981   -27.67235887  -27.6723212   -27.67215955  -27.67189014
  -27.67132842  -27.66987979  -27.66719854  -27.66444194  -27.66572892
  -27.6693629   -27.67135036  -27.67201745  -27.67214858  -27.67231261
  -27.67246616  -27.67254293  -27.67251384  -27.67249906  -27.67252814
  -27.67259776  -27.67245996  -27.67187678  -27.67110431  -27.67050063
  -27.66991841  -27.66933667  -27.66949021  -27.66918075  -27.66878259
  -27.6677593   -27.66192805  -27.64592778  -27.61700332  -27.56147468
  -27.49467885  -27.46152961  -27.45177189  -27.29435126  -27.14098726
  -26.9788412   -26.71647203  -26.37246934  -26.16403186  -26.41644613
  -26.76242531  -27.00596942  -27.17919717  -27.33171145  -27.49166238
  -27.6346997   -27.63565814  -27.6498264  -109.47111026 -109.56642044
 -109.67178096 -109.78956399 -109.92309538 -110.07724606 -110.25956762
 -110.48271117 -110.77039325 -111.17585835 -111.86900553 -192.50847041
 -192.69079197 -192.87311352 -193.09625707 -193.31940062 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087
 -193.39064087 -193.39064087 -193.39064087 -193.39064087 -193.39064087]
ptr[2]  [298 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298
 298 298 298 298 298  31  31  32  33  33  39  39  39  39  39  39  39  39
  39  39  39  39  40  41  42  43  44  45  46  47  48  49  50  51  52  53
  54  55  56  57  58  59  60  61  62  63  64  65  66  67  68  69  70  71
  72  73  74  75  76  77  78  79  80  81  82  83  84  85  86  87  88  89
  90  91  92  93  94  95  96  97  98  99 100 101 102 103 104 105 106 107
 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125
 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143
 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161
 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179
 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197
 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215
 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233
 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251
 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269
 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287
 288 289 290 291 297 298 298 298 298 298 298 298 298 298 298 298 298 305
 306 307 307 307 307 307 307 307 307 307 307 307 307 313 313 314 314 315
 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298
 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298 298]
kyakuno commented 10 months ago

一通り実装はできたものの、まだ負荷が高い。

kyakuno commented 10 months ago

NVIDIA GPUだと実用的かどうか確認する。

kyakuno commented 10 months ago

1.82secの音の処理。ailia SDK 1.2.15。f0にcrepeを使うとリアルタイムは難しくなる印象。

デバイス rvc f0
RTX3080 cuDNN 1199ms 2986ms
M2 6253ms 9084ms