axinc-ai / ailia-models-unity

Unity version of ailia models repository
45 stars 4 forks source link

Add Lipgan #105

Closed kyakuno closed 1 year ago

kyakuno commented 1 year ago

103

kyakuno commented 1 year ago

Pythonでのen_example.wavのMelspectrum。

(80, 4801)
[[1.7782074e-04 9.4256808e-05 2.4634908e-05 ... 2.6005753e-05
  6.2427350e-04 1.2492979e-03]
 [1.8051970e-04 9.1515547e-05 7.2755880e-05 ... 8.6944077e-05
  7.4971095e-04 1.4764036e-03]
 [2.3220392e-04 1.1364660e-04 3.3496850e-04 ... 5.9571181e-04
  1.6077741e-03 2.9375975e-03]
 ...
 [1.5525334e-04 2.0089920e-04 3.5490340e-04 ... 4.0776231e-03
  7.3834984e-03 7.4516409e-03]
 [1.2768754e-04 1.9118622e-04 2.9189765e-04 ... 5.6722877e-03
  6.5133492e-03 5.6479275e-03]
 [2.4511138e-04 2.2178251e-04 3.3717207e-04 ... 4.0123481e-03
  5.0174799e-03 5.6596575e-03]]

Normalized Melspectrum。

(80, 4801)
[[-3.600028  -4.        -4.        ... -4.        -2.7273998 -2.2453346]
 [-3.5895605 -4.        -4.        ... -4.        -2.6001697 -2.129272 ]
 [-3.4146087 -3.9111097 -3.159994  ... -2.759942  -2.0700402 -1.6512122]
 ...
 [-3.6943347 -3.515235  -3.1198237 ... -1.4233484 -1.0107803 -1.0043969]
 [-3.8301623 -3.5496697 -3.255631  ... -1.1939869 -1.0979128 -1.1969776]
 [-3.3770185 -3.446516  -3.1554377 ... -1.4345624 -1.279223  -1.1955359]]

Pythonでの入力波形とpremphasisの出力。

[-0.00448608 -0.00537109 -0.00540161 ...  0.01559448  0.01504517
  0.01028442]
[-4.48608398e-03 -1.01959229e-03 -1.91650391e-04 ...  7.00988770e-03
 -8.14819336e-05 -4.30938721e-03]
kyakuno commented 1 year ago

librosaのmelspectrum。

(80, 4801)
[[1.99747004e-04 9.99604423e-05 1.84032539e-04 ... 1.87182231e-04
  9.73823970e-04 1.85331427e-03]
 [2.82515078e-04 1.71108029e-04 5.22331720e-04 ... 2.17816963e-03
  4.19446037e-03 5.81525616e-03]
 [2.38576915e-04 3.65548720e-04 1.74503722e-03 ... 1.40396621e-02
  1.45924219e-02 8.13778784e-03]
 ...
 [1.39912875e-04 1.95439830e-04 3.39978077e-04 ... 4.48158468e-03
  7.67531127e-03 7.41303192e-03]
 [1.61488705e-04 1.97779610e-04 2.88520981e-04 ... 5.52082925e-03
  6.11450947e-03 5.45685761e-03]
 [2.19110788e-04 2.10258892e-04 3.36069636e-04 ... 3.70672458e-03
  4.56828352e-03 5.17882048e-03]]
kyakuno commented 1 year ago

動くようにはなった。品質向上のためのCompositeの修正が必要。

lipgan