fp8: add calibration scale for decode attention operators

[yzh119]

@comaniac

[comaniac]

Looks super clean lol It'd be better to have a test to verify the correctness

[yzh119]

I feel we can directly use fp16 for query (but use fp8 for kv) to avoid possible accuracy loss, but let's merge this first.