Closed jeremyfowers closed 2 months ago
Bug fix: process isolation mode wasn't working with Tool args because it was missing a space between the arg value and the next tool name.
This PR also:
Here is a more complex example to show that things are fixed:
(tkml) PS C:\work\turnkeyml\models\transformers> turnkey -i .\electra.py --process-isolation discover --max-depth 0 --script-args="" export-pytorch --opset 17 benchmark --iterations 1 --runtime ort Info: Running turnkey on .\electra.py Info: Starting process with command: turnkey -i C:\work\turnkeyml\models\transformers\electra.py --cache-dir="~/.cache/turnkey" discover --max-depth 0 --script-args= export-pytorch --opset 17 benchmark --iterations 1 --runtime ort Info: Running turnkey on C:\work\turnkeyml\models\transformers\electra.py Building "electra_transformers" + Discovering PyTorch models + Exporting PyTorch to ONNX Benchmarking model Benchmarking model. Benchmarking model.. Benchmarking model... Benchmarking model Benchmarking model. Benchmarking model.. Benchmarking model... Benchmarking model Benchmarking model. Benchmarking model.. Benchmarking model... Benchmarking model Benchmarking model. Benchmarking model.. Benchmarking model... Benchmarking model Benchmarking model. Benchmarking model.. Benchmarking model... Benchmarking model Benchmarking model. Benchmarking model.. Benchmarking model... + Benchmarking model electra.py: model (executed 1x - 0.08s) Location: C:\\work\\turnkeyml\\models\\transformers\\electra.py, line 24 Parameters: 13,483,008 (51.43 MB) Input Shape: 'attention_mask': (1, 128), 'input_ids': (1, 128) Build dir: C:\Users\jefowers/.cache/turnkey\electra_transformers Status: Successful build! Throughput: 128.424 inferences per second (IPS) Mean Latency: 7.787 milliseconds (ms)
Bug fix: process isolation mode wasn't working with Tool args because it was missing a space between the arg value and the next tool name.
This PR also:
Demo
Here is a more complex example to show that things are fixed: