Current flow for vertex gen ai defaults the value of max_tokens to 500 and does not consider the value mentioned in smss file. This pr has changes after which the value for max_tokens will be taken from smss file and if the value the is not defined in the smss file then it will take 500 as default value.
Current flow for vertex gen ai defaults the value of max_tokens to 500 and does not consider the value mentioned in smss file. This pr has changes after which the value for max_tokens will be taken from smss file and if the value the is not defined in the smss file then it will take 500 as default value.