[Model] add interface for seq meta.

intel / xFasterTransformer

Apache License 2.0

367 stars 61 forks source link

[Model] add interface for seq meta. #366

Closed Duyi-Wang closed 5 months ago

Duyi-Wang commented 5 months ago

Replace Model::input() and Model::config() with Model::set_input(). Refactor Decoder.forward() params to std::vector<xft::SequenceMeta *> &seq, bool logits_all = false.