Fix `--sharded` consumption in template

princeton-ddss / blackfish

Machine learning as a service (MLaaS) for busy researchers

https://princeton-ddss.github.io/blackfish/

0 stars 0 forks source link

Closed cswaney closed 1 month ago

cswaney commented 2 months ago

For TGI, the --sharded option is not a flag. Update text_generation_<slurm>/<local>.sh to fix:

{%- if 'sharded' in container_config %}
  --sharded {{ container_config['sharded'] }}\
{%- endif %}

cswaney commented 1 month ago

Closed by #39