What this PR does / why we need it:
adds support for arm64/aarch64 for inference. it does not include cuda with arm64
Which issue(s) this PR fixes(optional, using fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when the PR gets merged):
Fixes #67
What this PR does / why we need it: adds support for arm64/aarch64 for inference. it does not include cuda with arm64
Which issue(s) this PR fixes (optional, using
fixes #<issue number>(, fixes #<issue_number>, ...)
format, will close the issue(s) when the PR gets merged): Fixes #67Special notes for your reviewer: