inferencing unixcoder code-generation model

[Shreeshsbhat]

hi, i have trained the model on the custom dataset, but i am not getting how to run the model for inference. the solution provided as a script which takes a json file, but i want to pass the input as string. any help is appriciated, thanks.

[guoday]

If you use decoder-only mode, you can use this code. If you use encoder-decoder mode, you can use this code.