microsoft / onnxruntime-extensions

onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
MIT License
295 stars 80 forks source link

Refactor the header file directory and integrate the eager tensor implementation #689

Closed wenbingl closed 2 months ago

wenbingl commented 2 months ago
  1. rename includes folder to include (w/o s)
  2. move all custom-op related header file a sub-folder
  3. integrate Cheng's POC of eager mode.
  4. Add the Tokenizer header files to validate the refactored folder structure, implementation will be merged by another PR.
  5. Add a stub unit test for tokenizer api, the implementation will be merged later