Open krishnanpooja opened 2 months ago
We would like to have configuration options to pass parameters while encoding and decoding using Huggingface tokenizer. Ex:- in https://github.com/microsoft/DeepSpeed-MII/blob/2d5a2e77cb5d172c6652bbc7a6a1d6885d31d504/mii/batching/ragged_batching.py#L630, we need option to set truncation based on the max_length
We would like to have configuration options to pass parameters while encoding and decoding using Huggingface tokenizer. Ex:- in https://github.com/microsoft/DeepSpeed-MII/blob/2d5a2e77cb5d172c6652bbc7a6a1d6885d31d504/mii/batching/ragged_batching.py#L630, we need option to set truncation based on the max_length