Fix panic on scalar arithmetic operations

[lovasoa]

This PR normalizes the behavior of addition and subtraction between simd and scalar implementations

[lovasoa]

Thanks for merging ! 🙏