Refactor inference to use a python script instead of bash

ersilia-os / model-inference-pipeline

Ersilia's batch inference pipeline on the AWS cloud

MIT License

2 stars 0 forks source link

Refactor inference to use a python script instead of bash #22

Closed kartikey-vyas closed 1 month ago

kartikey-vyas commented 4 months ago

Currently, predict.yml uses several shell commands to:

split the input CSV into a slice for the worker to look at
call the ersilia model hub
fetch and run the specified model
upload predictions to S3

All of this can be done in python efficiently, in a manner which will allow us to better maintain and test the code. We want to write this python script and replace the bash with a call to this script..

kabilank6 commented 3 months ago

Now having a look!

kabilank6 commented 3 months ago

Do I have write access to this repo @kartikey-vyas ?

kartikey-vyas commented 3 months ago

have added you