Closed FanhaiLu1 closed 3 months ago
This PR add gemma and update recent changes to multiple host. In the end, the multiple host and single host should share as much code as possible after we finished multiple host support, but right now the code are diverged.
This PR add gemma and update recent changes to multiple host. In the end, the multiple host and single host should share as much code as possible after we finished multiple host support, but right now the code are diverged.