Closed cswaney closed 1 month ago
For TGI, the --sharded option is not a flag. Update text_generation_<slurm>/<local>.sh to fix:
--sharded
text_generation_<slurm>/<local>.sh
{%- if 'sharded' in container_config %} --sharded {{ container_config['sharded'] }}\ {%- endif %}
Closed by #39
For TGI, the
--sharded
option is not a flag. Updatetext_generation_<slurm>/<local>.sh
to fix: