search

NVIDIA / aistore

AIStore: scalable storage for AI applications
https://aistore.nvidia.com
MIT License
1.21k stars 160 forks source link

Questions about init ETL from spec #141

Closed yingca1 closed 1 year ago

yingca1 commented 1 year ago
  1. Why is the ["sh", "-c", "/server"] command mandatory when using ais etl init spec?
  2. Where can I find the source code for the server?
gaikwadabhishek commented 1 year ago

Hello @yingca1 !

  1. The command param is only replaced when the communication type is io. More information on communication types. Otherwise, we want you to provide command to run your own transformer server (if there exists one) in the pods spec.yaml file. Here are some sample transformers - https://github.com/NVIDIA/ais-etl/tree/master/transformers.

  2. The server executable file for running io-comm is made here https://github.com/NVIDIA/ais-etl/blob/master/runtime/python/io-comm/Makefile#L3. We are working on updating the ais-etl repo.