search

EleonoreMizo / fmtconv

Format conversion tools for Vapoursynth and Avisynth+
Do What The F*ck You Want To Public License
67 stars 14 forks source link

Uses bit shifting even for full-range depth conversions #10

Closed kgrabs closed 4 years ago

kgrabs commented 6 years ago

for a function call like this:

clip = core.std.BlankClip(format=vs.GRAY8, color=255)
clip.fmtc.bitdepth(bits=16, fulls=True, fulld=True).set_output()

the clip should have a color of 65535 (255 257) but instead is 65280 (255 256)

mrhso commented 5 years ago

Even RGB.

keytouch commented 5 years ago

The factor should be 257 to do evenly matched mapping.

keytouch commented 5 years ago

It is 257 in full range and it's 256 when limited checked out in vapoursynth resize.

EleonoreMizo commented 4 years ago

Right. Thank you for the report. Fixed in 1695707dec303da59e8eb7d0133c70d804c62190, will be available in upcoming r22 release.