xmos / xcore_iot

Other
29 stars 39 forks source link

Extend xscope_fileio example application with streaming data transport method #525

Open keithm-xmos opened 1 year ago

keithm-xmos commented 1 year ago

Currently the only transport method demonstrated is XSCOPE_FILEIO. The XSCOPE_FILEIO method has one drawback. It requires the user to interpret the files on the XCORE device. Code for this may not be readily available or easy to port to XCORE. For example, HDF5 is a common array/tensor data file format, as are Python pickle archives. Libraries to read these file formats are readily available on x86.

A new transport method (XSCOPE_STREAMIO) could be easily added so raw data arrays can be streamed from the host to the device. With this, data stored in complex file formats can be read on the host and just processed on the XCORE.

The example application would be extended to support both methods with a configuration-time switch to select the desired method.