Is this a new feature, an improvement, or a change to existing functionality?
Improvement
How would you describe the priority of this feature request
Medium
Please provide a clear description of problem this feature solves
Triton input tensors mush all be row-major, per kserve.
Currently the Python impl of the Triton stage performs this conversion implicitly as it makes use of tritonclient.InferInput.set_data_from_numpy to stage the data which ultimately calls numpy.ndarray.tobytes which defaults to row-major.
Describe your ideal solution
We should check for column-major input tensors and convert them to row-major
Additional context
No response
Code of Conduct
[X] I agree to follow this project's Code of Conduct
[X] I have searched the open feature requests and have found no duplicates for this feature request
Is this a new feature, an improvement, or a change to existing functionality?
Improvement
How would you describe the priority of this feature request
Medium
Please provide a clear description of problem this feature solves
Triton input tensors mush all be row-major, per kserve.
Currently the Python impl of the Triton stage performs this conversion implicitly as it makes use of
tritonclient.InferInput.set_data_from_numpy
to stage the data which ultimately callsnumpy.ndarray.tobytes
which defaults to row-major.Describe your ideal solution
We should check for column-major input tensors and convert them to row-major
Additional context
No response
Code of Conduct