Replace `addr_of_mut!` with `&raw mut` and remove `unsafe` (Rust 1.82)

[kkysen]

Rust 1.82 will stabilize &raw mut finally, and also make the dereference in &raw mut (*ptr).field safe, so we can now make that safe and remove the unsafe block.