onnx / turnkeyml

The no-code AI toolchain
Apache License 2.0
73 stars 16 forks source link

Hit the spacebar one time #212

Closed jeremyfowers closed 2 months ago

jeremyfowers commented 2 months ago

Bug fix: process isolation mode wasn't working with Tool args because it was missing a space between the arg value and the next tool name.

This PR also:

Demo

Here is a more complex example to show that things are fixed:

(tkml) PS C:\work\turnkeyml\models\transformers> turnkey -i .\electra.py --process-isolation discover --max-depth 0 --script-args="" export-pytorch --opset 17 benchmark --iterations 1 --runtime ort

Info: Running turnkey on .\electra.py

Info: Starting process with command: turnkey -i C:\work\turnkeyml\models\transformers\electra.py --cache-dir="~/.cache/turnkey"  discover --max-depth 0 --script-args= export-pytorch --opset 17 benchmark --iterations 1 --runtime ort

Info: Running turnkey on C:\work\turnkeyml\models\transformers\electra.py

Building "electra_transformers"
    + Discovering PyTorch models   
    + Exporting PyTorch to ONNX   
      Benchmarking model   
      Benchmarking model.  
      Benchmarking model.. 
      Benchmarking model...
      Benchmarking model   
      Benchmarking model.  
      Benchmarking model.. 
      Benchmarking model...
      Benchmarking model   
      Benchmarking model.  
      Benchmarking model.. 
      Benchmarking model...
      Benchmarking model   
      Benchmarking model.  
      Benchmarking model.. 
      Benchmarking model...
      Benchmarking model   
      Benchmarking model.  
      Benchmarking model.. 
      Benchmarking model...
      Benchmarking model   
      Benchmarking model.  
      Benchmarking model.. 
      Benchmarking model...
    + Benchmarking model

electra.py:
        model (executed 1x - 0.08s)
                Location:       C:\\work\\turnkeyml\\models\\transformers\\electra.py, line 24
                Parameters:     13,483,008 (51.43 MB)
                Input Shape:    'attention_mask': (1, 128), 'input_ids': (1, 128)
                Build dir:      C:\Users\jefowers/.cache/turnkey\electra_transformers
                Status:         Successful build!
                                Throughput:     128.424 inferences per second (IPS)
                                Mean Latency:   7.787 milliseconds (ms)